Electronic device, video system including the same, and method for generating test video
By generating and using test videos in electronic devices, detecting errors in video reproduction, the problem of image interruption during video reception and reproduction is solved, accurate identification and positioning of errors is achieved, and the stability of video output is improved and quality.
Patent Information
- Application Number
- CN202410529643.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2023-05-02
- Filing Date
- 2024-04-29
- Publication Date
- 2024-11-05
AI Technical Summary
During the process of receiving and reproducing video from the input device, image interruptions such as jitter and stuttering are prone to occur, and an effective detection method is needed to identify the wrong components and the location of the error.
By generating and using test videos, it is leveraged to perform standardized operations, scaling, image quality processing in the electronic device, and detecting errors in the source device or display based on pixel values, achieving accurate positioning of the error occurs.
An effective method is provided to detect and locate errors in the video reproduction process, ensure the stability and quality of video output, and improve the video processing capabilities of electronic devices.
Smart Images

Figure CN118900320A_ABST
Abstract
Description
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0002] This application claims the priority of Korean Patent Application No. 10-2023-0056893 filed in the Korean Intellectual Property Office on May 2, 2023, the contents of which are incorporated herein by reference in their entirety. Technical Field
[0003] Various example embodiments of the inventive concept relate to an electronic device, and more particularly, to an electronic device that processes and reproduces a video, a video system, and / or a method for generating an image pattern of a test video that is reproduced for error detection in the electronic device. Background Art
[0004] Various video services send video images for display on a display panel through a network environment. Input devices can send video through, for example, a mobile industry processor interface (MIPI), a high-definition multimedia interface (HDMI), a display port (DP), or a peripheral component interconnect express (PCIe).
[0005] When a video is received from an input device or processed and reproduced by an electronic device, an image interruption phenomenon such as a jitter phenomenon and / or a stuttering phenomenon may occur. When the image interruption phenomenon is caused by the input device, it is necessary to solve the error of the input device, and when the image interruption phenomenon is caused by the electronic device, it is necessary to solve the error of the electronic device.
[0006] Therefore, there is a need for a technology for easily and / or accurately detecting a portion and / or component in which an error occurs in the process of receiving and reproducing a video. Summary of the invention
[0007] One or more example embodiments of the inventive concept provide an electronic device for detecting an error occurrence and an error occurrence location of the electronic device by reproducing a test video and / or a video system including the electronic device, etc.
[0008] One or more example embodiments of the inventive concept also provide a method for generating a test video of an electronic device, in which a type pattern for detecting an error occurrence and an error occurrence location is encoded.
[0009] One or more exemplary embodiments of the present inventive concept provide a sink device, the sink device including a processing circuit, the processing circuit being configured to: receive a test video from a source device, the test video including a plurality of frames, and each of the plurality of frames including a type pattern corresponding to a frame number of a corresponding frame, perform a standardization operation on the test video to generate a standardized video, scale the standardized video to generate a scaled video, perform an image quality processing operation on the scaled video to generate a sampled video, output the sampled video to a display, the display being configured to display the sampled video as a final sampled video, and detect at least one error generated in any one of the source device, the processing circuit, or the display based on pixel values of the test video, the standardized video, the scaled video, the sampled video, and the final sampled video, and an expected pixel value corresponding to the type pattern included in each of the plurality of frames.
[0010] One or more exemplary embodiments of the inventive concept provide a method for generating a test video of an electronic device, the method comprising: setting a first frame size of a first test video, generating a plurality of binary patterns representing a plurality of frame numbers using binary bits, the plurality of frame numbers corresponding to the order of a plurality of frames to be included in the first test video, generating a plurality of color patterns based on the binary bits, and sending the first test video to the electronic device to test the operation of the electronic device. The first test video includes a plurality of test frames, and the plurality of test frames include a plurality of color patterns.
[0011] One or more exemplary embodiments of the present invention provide an electronic device including a processing circuit configured to: receive a test video from an input device, the test video including multiple frames, process the test video and convert it into an intermediate sampling video, process the intermediate sampling video into a final sampling video, and output the final sampling video to a display, and detect a frame output sequence error or a color output error in the processing circuit or the display based on pixel values corresponding to multiple frame numbers included in each of the test video, the intermediate sampling video, and the final sampling video, each video including a binary pattern and a color pattern, the binary pattern using binary bits to represent the frame number of the corresponding frame, and the color pattern is generated based on the binary pattern.
[0012] One or more exemplary embodiments of the present invention provide an electronic device including a processing circuit configured to: receive a test video from an input device, the test video including a plurality of frames, and each of the plurality of frames including at least one type pattern corresponding to a frame number of the corresponding frame, process the test video and convert it into an intermediate sampling video, process the intermediate sampling video into a final sampling video, and output the final sampling video to a display, and use a weighted model regarding the test video, the intermediate sampling video, and the final sampling video to determine whether an error has occurred in the processing circuit or the display. BRIEF DESCRIPTION OF THE DRAWINGS
[0013] The above and other aspects and features of one or more example embodiments of the present inventive concept will become more apparent by describing in detail various example embodiments of the present inventive concept with reference to the accompanying drawings, in which:
[0014] Figure 1 is a block diagram illustrating a video system according to at least one example embodiment of the inventive concepts.
[0015] Figure 2 is a view for describing an operating method of an electronic device according to some example embodiments.
[0016] Figure 3 is a flow chart illustrating a method for generating a test video according to some example embodiments.
[0017] Figure 4 is a view illustrating an image pattern of a test video according to at least one example embodiment.
[0018] Figure 5 is a view illustrating an image pattern of a test video according to at least one example embodiment.
[0019] Figure 6 is a view illustrating an image pattern of a test video according to at least one example embodiment.
[0020] Figure 7 is a view illustrating an image pattern of a test video according to at least one example embodiment.
[0021] Figure 8 is a view illustrating an image pattern of a test video according to some example embodiments.
[0022] Fig. 9 is a view illustrating an image pattern of a test video according to at least one example embodiment.
[0023] Fig.10 and Fig.11 is a view illustrating an image pattern of a test video according to some example embodiments.
[0024] Fig.12 is a view for describing the operation of a weighted model learned through machine learning according to some example embodiments.
[0025] Fig.13 is a view illustrating an error detection method according to reproduction of a test video according to at least one example embodiment.
[0026] Fig.14 and Fig.15is a flowchart illustrating a method of generating an image pattern of a test video according to some example embodiments.
[0027] Fig.16 and Fig.17 is a flow chart illustrating a method of operation for error detection of an electronic device. DETAILED DESCRIPTION
[0028] In the following, reference will be made to Figures 1 to 17 An electronic device, a system including the electronic device, and / or a method for generating an image pattern of a test video, etc. according to various example embodiments of the inventive concept are described.
[0029] Figure 1 is a block diagram illustrating a video system according to at least one example embodiment of the inventive concepts.
[0030] refer to Figure 1 , the video system 10 may include a source device 100 and / or a sink device 200, etc., but example embodiments are not limited thereto. According to at least one example embodiment, in addition to Figure 1 In addition to the components shown, the video system 10 may further include other general components, etc. Each of the source device and the sink device may be a multimedia device implemented as an electronic device, etc.
[0031] The source device 100 may be an electronic device that generates content video by itself and / or receives content video. The content video may include video frames, and may be generated as content data in the form of, for example, a data stream, and sent to the sink device 200, but is not limited thereto. The source device 100 may be included in an input device, etc., but is not limited thereto. The source device 100 may be implemented in various forms, such as, for example, an optical media playback device, such as a DVD or Blu-ray player, a UHD player, a set-top box, a TV, a computer, a mobile device, a home theater, a game console device, a content server, etc. The content data may include video data and / or audio data.
[0032] In at least one example embodiment, the source device 100 may include a user input module 110, a first memory 120, a source processor 130 and / or a transmitter 140, etc., but is not limited thereto. According to some example embodiments, one or more of the user input module 110, the first memory 120, the source processor 130 and / or the transmitter 140, etc. may be implemented as a processing circuit. The processing circuit may include hardware or a hardware circuit, including a logic circuit; a hardware / software combination, such as a processor that executes software and / or firmware; or a combination thereof. For example, the processing circuit may more specifically include, but is not limited to, a central processing unit (CPU), an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a system on a chip (SoC), a programmable logic unit, a microprocessor, an application specific integrated circuit (ASIC), etc., but is not limited thereto.
[0033] The user input module 110 (e.g., a user input device, etc.) may be a module to be manipulated by a user, or in other words, a device configured to receive user input. The user input module 110 may include various types of input interface-related circuits. For example, the user input module 110 may be implemented in various forms, such as a mechanical and / or electronic button of the source device 100, a remote controller separated from the main body of the source device 100, a touch pad and / or a touch screen, a keyboard, a mouse, a microphone, a camera, etc.
[0034] The first memory 120 can read the stored data and / or output the read data under the control of the source processor 130. In addition, the first memory 120 can store data under the control of the source processor 130. For example, the first memory 120 can store content video and / or content audio, etc. The first memory 120 can be implemented as a non-volatile memory that stores data regardless of the power supply and / or a volatile memory that operates only when the power is supplied. The non-volatile memory includes, for example, a flash memory and / or a read-only memory (ROM), etc., and the flash memory may include, for example, a NAND flash memory and / or a NOR flash memory, etc. The volatile memory may include, for example, a DRAM and / or an SRAM, etc.
[0035] The source processor 130 may overall control the source device 100. The source processor 130 may control the first memory 120 so that the first memory 120 outputs content data (eg, content video and / or content audio), etc. The source processor 130 may output content data in a format supported by the sink device 200.
[0036] The transmitter 140 may transmit the content video to the sink device 200, but is not limited thereto. For example, the transmitter 140 may transmit the content video to the receiver 250 of the sink device 200. Specifically, the transmitter 140 may transmit the content video to the receiver 250 through at least one communication channel 150, etc.
[0037] The communication channel 150 can transmit the content video and / or content audio output from the source device 100 to the receiver 250. The communication channel 150 may include any wireless and / or wired communication medium such as a radio frequency (RF) spectrum, an infrared (IR) spectrum, etc., one or more physical transmission lines, and / or any combination of wireless and wired media. The communication channel 150 may form part of a packet-based network such as a local area network, a wide area network, and / or a global network such as the Internet, but is not limited thereto. The communication channel 150 generally represents any suitable communication medium and / or a collection of different communication media for transmitting the content video from the source device 100 to the sink device 200.
[0038] The source device 100 may send a test video to the sink device 200, but is not limited thereto. The test video may be an image pattern for confirming that an error has occurred in the video system 10. The test video may include a plurality of frames. Each of the plurality of frames may include at least one pattern. The test video may be sent in the form of a data stream, and the data stream may include pixel values included in at least one test video frame. For example, the data stream may include pixel values included in at least one pattern included in the test video frame.
[0039] According to some example embodiments, the test video may be stored in the first memory 120, etc. The source processor 130 may control the first memory 120 so that the first memory 120 outputs the test video. The transmitter 140 may transmit the test video to the sink device 200. For example, the transmitter 140 may transmit the test video to the receiver 250 through the communication channel 150, etc.
[0040] The test video may include various types of patterns for detecting which component in the sink device 200 and / or the source device 100 has a problem. In some example embodiments, each of the multiple frames of the test video may include a pattern of an expected and / or predetermined type. For example, a first type of pattern may correspond to the output order of each of the multiple frames, but the example embodiments are not limited thereto. For example, when a test video includes four frames, the first frame may include a first type of pattern corresponding to the first output order, the second frame may include a first type of pattern corresponding to the second output order, the third frame may include a first type of pattern corresponding to the third output order, and the fourth frame may include a first type of pattern corresponding to the fourth output order, and so on. For example, the first type of pattern may be a pattern of an expected and / or preset color corresponding to the frame order, but is not limited thereto.
[0041] For example, the second type pattern may represent a plurality of colors, but is not limited thereto. For example, the second type pattern may be a grayscale pattern including black and white, but is not limited thereto. In addition, for example, the second type pattern may be a pattern including R (red), G (green) and B (blue) colors (hereinafter referred to as an RGB pattern). In addition, for example, the second type pattern may be a pattern including Y, Cb and Cr colors (hereinafter referred to as a YCbCr pattern). In addition, for example, the second type pattern may include RGB colors and complementary RGB colors for each frame. In addition, for example, the second type pattern may include YCbCr colors and complementary YCbCr colors for each frame. The first type pattern and the second type pattern will be described in more detail later.
[0042] The test video may be represented by N bits. The N bits may be a representation of a unique number for identifying each frame. For example, when the test video is 2 bits, the first type pattern may be represented as 4 frames identified by 2 bits. At 00, the first frame of the first type pattern corresponding to the first in the output order may be displayed in the convergence point device 200, at 01, the second frame of the first type pattern corresponding to the second in the output order may be displayed in the convergence point device 200, at 10, the third frame of the first type pattern corresponding to the third in the output order may be displayed in the convergence point device 200, and at 11, the fourth frame of the first type pattern corresponding to the fourth in the output order may be displayed in the convergence point device 200, and so on.
[0043] According to some example embodiments, the first type pattern displayed by two bits 00, 01, 10 and 11 may be a color whose density is divided into four levels. For example, the first type pattern may also be a color divided into four levels from white to black, or may also be a color divided into four levels from white or black to blue, etc. According to some example embodiments, the first type pattern displayed by two bits 00, 01, 10 and 11 may be a pattern in which each bit is displayed in one color. 0 may be displayed as a first color, and 1 may be displayed as a second color. For example, when 0 is white and 1 is red, 10 may be displayed in a pattern of white and red, etc.
[0044] Example embodiments are not limited thereto, and the number of frames may vary, and the number of bits represented may also vary according to the number of frames. For example, when the number of frames is 256, the test pattern may be a color pattern represented by 8 bits, etc.
[0045] For example, the third type pattern may be a pattern including at least two of a grayscale pattern, an RGB pattern, and / or a YCbCr pattern, but is not limited thereto. For example, the third type pattern may include an RGB pattern and a grayscale pattern for each frame. In addition, for example, the third type pattern may include a YCbCr pattern and a grayscale pattern for each frame. In addition, for example, the third type pattern may include an RGB pattern and a YCbCr pattern for each frame.
[0046] For example, the fourth type pattern may be a pattern that also includes integrity information of the first type pattern to the third type pattern. The integrity information is information used to confirm the integrity of the image pattern itself of the first to third type patterns. According to various example embodiments, the integrity information may be parity check bits, checksum information, and / or CRC information, etc. The fourth type pattern may be a pattern including the integrity information in the first type pattern, a pattern including the integrity information in the second type pattern, and / or a pattern including the integrity information in the third type pattern, etc.
[0047] According to some example embodiments, the test video may include a learning image pattern according to a result obtained by learning a normal image output during normal operation and an error image output during abnormal operation. For example, the test video may include a first area and a second area in one frame, output a normal image to the first area, and output a learning image to the second area, but example embodiments are not limited thereto.
[0048] The source device 100 may send at least one test video of the plurality of test videos to the sink device 200. Each of the plurality of test videos may include a plurality of frames, and each of the plurality of frames may include at least one pattern described above, but is not limited thereto. In at least one example embodiment, each of the plurality of test videos may have a different video resolution, but is not limited thereto, and for example, two or more test videos may have the same resolution. For example, the resolution of the first test video may be 3840×2160, etc. The resolution of the second test video may be 512×480. However, the example embodiments of the inventive concept are not limited to the examples listed, and the number of test videos may vary, such as 100 or 1000, and the test videos may have different resolutions.
[0049] A plurality of test videos may be stored in the first memory 120. The source processor 130 may control the first memory 120 so that the first memory 120 outputs at least one of the plurality of test videos. The transmitter 140 may transmit the at least one test video to the sink device 200. Specifically, the transmitter 140 may transmit the at least one test video to the receiver 250 through the communication channel 150 or the like.
[0050] Despite Figure 1 2 has described sending the test video from the source device 100, but the test video is not limited thereto. The test video may also be sent to the sink device 200 from an external storage device (not shown) and / or a network, etc. The external storage device may be connected to the sink device 200 to store the test video. Specifically, the external storage device may receive a command and an address from the sink device 200, and access a memory cell among the memory cells selected by the address, etc.
[0051] The external storage device may be, for example, a storage device based on flash memory, but example embodiments are not limited thereto. The flash memory may include, for example, NAND flash memory, NOR flash memory, etc. The storage device based on flash memory may include, for example, a flash drive device based on a solid state drive (SSD) and / or a universal serial bus (USB), etc. The external storage device may be implemented as a removable drive, but is not limited thereto. The external storage device may be implemented as a non-temporary recording medium, such as a video compact disk (CD), a digital video disc (DVD), etc.
[0052] The convergence point device 200 may be an electronic device that receives, processes and / or reproduces the received video. The convergence point device 200 may receive, process and / or reproduce the test video sent from the source device 100. In this document, the term "reproduction" refers to performing a processing operation to display a video, display an image based on processed video data, output audio based on processed audio data, and / or represent video and / or audio based on processed video data and / or audio data, etc. The convergence point device 200 may be implemented in various forms, such as a TV, a monitor, a portable multimedia player, a mobile phone, a tablet device, an electronic photo frame, an electronic blackboard, a game console, a virtual reality and / or augmented reality headset, and / or an electronic billboard, etc.
[0053] In at least one example embodiment, the convergence point device 200 may include a plurality of video processors VP1, VP2, ..., VPn, at least one processor 210, a second memory 220, a display 230, an audio device 240, and / or a receiver 250, etc., but the example embodiments are not limited thereto. According to some example embodiments, one or more of the plurality of video processors, at least one processor 210, the second memory 220, and / or the receiver 250, etc. may be implemented as a processing circuit. The processing circuit may include hardware or a hardware circuit, including a logic circuit; a hardware / software combination, such as a processor that executes software and / or firmware; or a combination thereof. For example, the processing circuit may more specifically include, but is not limited to, a central processing unit (CPU), an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a system on a chip (SoC), a programmable logic unit, a microprocessor, an application specific integrated circuit (ASIC), etc., but is not limited thereto.
[0054] The video processors VP1, VP2, ..., VPn may perform processing operations for reproducing a video, etc. The processing operation may refer to processing a video so that the video can be displayed on a display (e.g., a display panel, a display device, a projector, etc.). For example, the processing operation may include a normalization operation, a decoding operation, a scaling operation, a color correction operation, a frame rate change operation, an image quality processing operation, etc. However, the processing operation is not limited to the listed examples.
[0055] The video processors VP1, VP2, ..., VPn may perform a processing operation for reproducing a content video, etc. Each of the video processors VP1, VP2, ..., VPn may perform a processing operation corresponding to each of the video processors VP1, VP2, ..., VPn.
[0056] Each of the video processors VP1, VP2, ..., VPn may perform corresponding processing operations on the test video and / or generate a sample video, etc. Each of the multiple frames of the sample video may include at least one pattern. Figure 2 The video processor is described in more detail.
[0057] For example, the first video processor VP1 may perform a normalization operation, and the second video processor VP2 may perform a scaling operation, etc. The first video processor VP1 may receive a test video and perform a normalization operation on the test video. The second video processor VP2 may perform a scaling operation on the test video. Specifically, the second video processor VP2 may perform a scaling operation on the standardized test video.
[0058] For example, the first video processor VP1 may be an input module (eg, Figure 2 The input module 260 in the first video processor VP1 may receive the test video tvd and perform a standardization operation on the test video. The standardization operation may refer to an operation of changing the received video to adapt to the characteristics (e.g., expected characteristics, etc.) of the sink device 200. The first video processor VP1 may output a first sampled video sv1 in which the test video tvd is standardized.
[0059] The second video processor VP2 may be a scaler (eg, Figure 2 The scaler 270 in the display 230). The scaler may perform a scaling operation on the test video sv1. The processing operation corresponding to the scaler may be a scaling operation. The scaling operation may refer to an operation of changing the size (e.g., resolution) of the video to adapt to the size (e.g., resolution) of the display 230. Specifically, the second video processor VP2 may receive the first sampled video from the first video processor VP1, and perform a scaling operation on the first sampled video sv1, etc.
[0060] The third video processor VP3 may be an output module (eg, Figure 2 The output module 280 in FIG. 10 ). The output module may receive the scaled sampled video sv2, perform an image quality processing operation, and output a third sampled video sv3.
[0061] The processor 210 may determine whether an error has occurred in at least one of the source device 100 and the sink device 200 as input devices. The processor 210 may receive a sampled video from at least one of the video processors VP1, VP2, ..., VPn that performs a processing operation corresponding to each video processor on a test video. However, the example embodiments are not limited thereto. For example, the processor 210 may receive a sampled video (e.g., an output video) from each of the video processors VP1, VP2, ..., VPn. However, the example embodiments are not limited thereto. For example, the processor 210 may first receive a sampled video from the nth video processor VPn, and then receive sampled videos from other video processors.
[0062] The processor 210 may check the output order of each of the plurality of frames of the sampled video, and determine whether the sampled video is normally output (e.g., properly output, correctly output, correctly processed, etc.) based on at least one pattern (e.g., a test pattern), etc. Specifically, the processor 210 may check the image output order and normal output based on at least one pattern included in each of the plurality of frames of the sampled video.
[0063] Based on the pattern of the test video, the processor 210 may check the output order of each of the multiple frames, the position where an error occurs, the color where an error occurs, etc., but is not limited thereto. According to some example embodiments, the test video may include a frame number assigned to each frame of the test video. The processor 210 may allocate the number of bits corresponding to the frame number differently for each type of pattern, but is not limited thereto. For example, a frame number including 7 bits may be assigned to the first type of pattern, and a frame number including 9 bits may be assigned to the second type of pattern, etc.
[0064] For example, the processor 210 may receive a video from at least one of the video processors VP1, VP2, ..., VPn and check frame information included in the video. Specifically, the processor 210 may detect at least one error from a frame in an input video included in any one of the test video tvd, the standardized video sv1, the scaled video sv2, the sampled video sv3, and / or the final sampled video lsv, etc.
[0065] According to some example embodiments, the processor 210 may check the output order of the frames including the first type pattern based on the first type pattern included in each frame. For example, when there are four frames, the processor 210 may check whether the first frame, the second frame, the third frame, and the fourth frame, etc. are output in sequence. In this case, the frame number includes 2 bits,
[00] may be assigned to the first frame,
[01] may be assigned to the second frame,
[10] may be assigned to the third frame, and
[11] may be assigned to the fourth frame, etc. The processor 210 may check whether an error occurs in the image output order by checking whether the frame numbers of the output frames are output as
[00] ,
[01] ,
[10] , and
[11] , etc. when the first frame to the fourth frame are input in sequence.
[0066] According to some example embodiments, the processor 210 may check whether the input video is normally output based on displaying a type pattern of black and white colors and / or a plurality of other colors. For example, the processor 210 may check whether the output is normally performed based on the pixel values of the pixels implementing the second type pattern to the fourth type pattern, etc. For example, when the frame numbers of the output frames are
[00] ,
[01] ,
[10] , and
[11] , the processor 210 may check whether the output is normally performed by displaying the pixel values of the colors corresponding to each frame number, etc. For example, when represented in grayscale, on the display 230 of the sink device 200, 00 may be displayed as black, 01 may be displayed as a first gray, 10 may be displayed as a second gray, and 11 may be displayed as white. However, the example embodiments of the inventive concept are not limited thereto, and according to various example embodiments, the pixel value may also be RGB data, YCbCr data, black and white data, and / or other color type data, and / or may also be color data including at least two of RGB data, YCbCr data, black and white data, and other color type data, etc.
[0067] The processor 210 can determine whether the input video is output normally based on the comparison between the pixel values of the pixels of the type pattern implemented according to various example embodiments and the expected and / or preset pixel values. The processor 210 can receive the input video from at least one of the video processors VP1, VP2, ..., VPn and check whether each input video is output normally based on the comparison result between the pixel values. Normal output may refer to the processing operations performed normally in the video processor, and no output order errors and / or color display errors occur (for example, the output video matches the expected and / or desired video). For example, the processor 210 can check whether the first sampled video is output normally based on the second type pattern included in the first sampled video, and can determine whether the first sampled video matches the expected and / or desired output video of the second type pattern, etc. Reference will be made to Figure 4 Describe in more detail whether the first sample video is output normally.
[0068] The processor 210 may determine whether an error has occurred in at least one of the input device and / or the electronic device based on the output order of each of the plurality of frames of the input video and whether the plurality of frames are normally output. The input video includes at least one of the test video tvd, the standardized video sv1, the scaled video sv2, the sampled video sv3, and the final sampled video lsv, etc. Here, the input device may refer to the source device 100, and the electronic device may refer to the sink device 200, etc.
[0069] The processor 210 may determine whether an error has occurred in at least one of the input device and the video processors VP1, VP2, ..., VPn based on an output sequence error of the input video and / or whether the input video is output normally. If the input video output from at least one of the video processors (e.g., video processors VP1, VP2, ..., VPn) does not have a frame output sequence error and the input video is output normally, the processor 210 may determine that no error has occurred in the input device 100 and the sink device 200.
[0070] If at least one of an output sequence error of the frame of the first sampled video output from the first video processor VP1 and an abnormal output of the first sampled video occurs, the processor 210 may determine that an error has occurred in the input device. For example, if an output sequence error of the first sampled video occurs (e.g., the frames of the first sampled video are output in an incorrect order and / or one or more frames of the first sampled video are lost, etc.), the processor 210 may determine that an error has occurred in the source device 100.
[0071] If at least one of the output sequence error and the abnormal output of the sampled video output from at least one of the video processors VP2, ..., VPn other than the first video processor VP1 is an output sequence error and an abnormal output occurs, and the output sequence error and abnormal output of the first sampled video do not occur, the processor 210 can determine that an error has occurred in the electronic device. For example, if an output sequence error of the second sampled video output from the second video processor VP2 occurs, and the output sequence error and abnormal output of the first sampled video do not occur (for example, the first sampled video is correctly output), the processor 210 can determine that an error has occurred in the sink device 200.
[0072] In at least one example embodiment, the processor 210 may determine whether an error has occurred in at least one of the input device and the video processors VP2, ..., VPn based on the output order of each of the plurality of frames of the input video and whether the plurality of frames are output normally. For example, if an output order error of the second sampled video output from the second video processor VP2 occurs, and an output order error and abnormal output of the first sampled video do not occur (e.g., the first sampled video is output correctly), the processor 210 may determine that an error has occurred in the second video processor VP2.
[0073] The processor 210 may include one or more of a central processing unit (CPU), a graphics processor unit (GPU), a microcontroller unit (MCU), a microprocessing unit (MPU), an application processor (AP), and / or an ARM processor, but is not limited thereto. In addition, the processor 210 may also be implemented as a system on chip (SoC) and / or a large scale integration (LSI) in which a processing algorithm is embedded, and / or may also be implemented in the form of a field programmable gate array (FPGA), etc., but is not limited thereto.
[0074] The second memory 220 can store pixel values of pixels that implement the test video. Specifically, the second memory 220 can store expected and / or preset pixel values for the processor 210 to check whether the output sequence of multiple frames of the sampled video is wrong and whether the sampled video is output normally. The second memory 220 can be implemented as a non-volatile memory that stores data regardless of the power supply and / or a volatile memory that operates only when powered. The non-volatile memory can be a flash memory and / or ROM, etc., and the flash memory can include, for example, NAND flash memory and / or NOR flash memory, but the example embodiments are not limited thereto. The volatile memory can include, for example, a dynamic random access memory (DRAM) and / or a static random access memory (SRAM), etc.
[0075] The display 230 may display at least one image based on the content video. According to at least one example embodiment, the display 230 may also display at least one image based on a test video on which a processing operation is performed by the video processors VP1, VP2, ..., VPn. The convergence point device 200 may display output data to a user through the display 230. The display 230 may refer to a display panel, a display device, a projector, and the like. The display panel is a display unit on which an image is actually displayed, and may be one of the display devices that displays a 2D image by receiving an electrically transmitted image signal, such as a thin film transistor liquid crystal display (TFT-LCD), an organic light emitting diode (OLED) display, a field emission display, a plasma display panel (PDP), and the like. The display panel may be implemented as a flat panel display and / or another type of flexible display panel, and the like. In at least one example embodiment, the display 230 may display an 8K-class image, but is not limited thereto.
[0076] In at least one example embodiment, when at least one error is detected in at least one of the input device and the electronic device while displaying the test video, the display 230 may display that at least one error has occurred. When an error occurs in at least one of the input device and the electronic device, the display 230 may display and / or identify the device where the error occurred. Specifically, if an error occurs in at least one of the source device 100 and the sink device 200, the processor 210 may control the display 230 to display an error occurrence notification and an error occurrence location, etc., but is not limited thereto.
[0077] The processor 210 receives a first sample video in which a test video is standardized, and when at least one of a frame output sequence error of the first sample video and / or an abnormal output of the first sample video occurs, it can be determined that at least one error has occurred in the input device. For example, the processor 210 can determine that an error has occurred in the source device 100. If an error occurs in the source device 100, the processor 210 can control the display 230 to display an error occurrence notification and / or an error occurrence location about the source device 100, but is not limited thereto. The processor 210 can control the display 230 to display information about the A / S center of the source device 100.
[0078] If at least one of a frame output sequence error and an abnormal output of a final sampled video in which a processing operation is performed on a first sampled video occurs, and a frame output sequence error and an abnormal output of the first sampled video do not occur, the processor 210 may determine that an error has occurred in the convergence point device 200. For example, the processor 210 may determine that an error has occurred in the convergence point device 200, but is not limited thereto. If an error occurs in the convergence point device 200, the processor 210 may control the display 230 to display an error occurrence notification and / or an error occurrence location about the convergence point device 200. The processor 210 may control the display 230 to display information about the A / S center of the convergence point device 200, but is not limited thereto. If an error occurs in the convergence point device 200, the processor 210 may notify the user that an error has occurred in the convergence point device 200 through communication, etc.
[0079] If an error occurs in at least one of the input device and the video processors VP1, VP2, ..., VPn, the display 230 may display an error occurrence notification and / or an error occurrence location, etc. For example, if an error occurs in the second video processor VP2, the processor 210 may control the display 230 to display that an error occurs in the second video processor VP2, but is not limited thereto.
[0080] The audio device 240 (eg, a speaker, etc.) may output audio based on the audio data transmitted from the source device 100 .
[0081] The receiver 250 may receive the content video from the source device 100 through the communication channel 150. The receiver 250 may receive the test video from the source device 100 through the communication channel 150.
[0082] The transmitter 140, the communication channel 150 and the receiver 250 can be configured to communicate according to and / or based on any wired and / or wireless communication system including one or more Ethernet, telephone, cable, power line and fiber optic systems, and / or one or more code division multiple access (CDMA or CDMA2000) communication systems, frequency division multiple access (FDMA) systems, orthogonal frequency division multiple access (OFDM) access systems, time division multiple access (TDMA) (such as Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS) or Enhanced Data GSM Environment (EDGE)), Terrestrial Trunked Radio (TETRA) mobile phone systems, Wideband Code Division Multiple Access (WCDMA), high data rate 1xEV-DO (1st Generation Evolution Data Only) or 1xEV-DO Gold Multicast systems, IEEE 802.18 systems, DMB systems, DVB-H systems and / or wireless systems including other methods for data communication between two or more devices, etc.
[0083] Figure 2is a view for describing an operating method of an electronic device according to some example embodiments. Figure 2 The electronic device 200 can be used with Figure 1 The convergence point device 200 corresponds to the Figure 2 The processor 210 can be connected with Figure 1 For the sake of brevity and clarity, descriptions of repeated contents are omitted.
[0084] refer to Figure 2 , the electronic device 200 can receive the test video tvd. The electronic device 200 may include at least one processor 210, an input module 260, a scaler 270, an output module 280 and / or a display 230, etc., but is not limited thereto. Each of the input module 260, the scaler 270 and / or the output module 280 may be included in a video processor (and / or may be implemented as a processing circuit), but is not limited thereto. Figure 2 A case where the electronic device 200 includes three video processors is shown. However, the electronic device 200 is not limited thereto and may include various numbers of video processors.
[0085] The input module 260 can receive the test video tvd. The input module 260 can be connected to Figure 1 The input module 260 may correspond to the first video processor VP1 of the electronic device 200, but is not limited thereto. The input module 260 may output the first sampled video sv1 by performing a standardization operation on the test video tvd. The processing operation corresponding to the input module 260 may be a standardization operation, but is not limited thereto. The standardization operation may refer to an operation of changing the received test video tvd to adapt to the characteristics of the electronic device 200. Specifically, the input module 260 may transform the spatial information and / or temporal information of the test video tvd to internally process the test video tvd in the electronic device 200, etc.
[0086] The scaler 270 may receive the first sample video sv1. The scaler 270 may be connected to Figure 1 The scaler 270 may output the second sampled video sv2 by performing a scaling operation on the first sampled video sv1. The processing operation corresponding to the scaler 270 may be a scaling operation. The scaling operation may refer to changing the size of the video to fit the display (e.g., Figure 1 Specifically, the scaler 270 may output the second sampled video sv2 by expanding or contracting the first sampled video sv1 in the horizontal direction and / or expanding or contracting the first sampled video sv1 in the vertical direction.
[0087] The output module 280 may receive the second sample video sv2. The output module 280 may output the third sample video sv3 by performing a quality processing operation on the second sample video sv2, but is not limited thereto. The quality processing operation may refer to an operation of improving video quality.
[0088] The display 230 may receive and display the third sampled video sv3. The display 230 may receive the third sampled video sv3 and display the third sampled video sv3 as the final sampled video lsv.
[0089] The processor 210 may receive the first sampled video sv1, the second sampled video sv2, the third sampled video sv3, and the final sampled video lsv from the input module 260, the scaler 270, the output module 280, and / or the display 230, respectively, but example embodiments are not limited thereto. The processor 210 may detect an error generated in any one of the source device 100, the input module 260, the scaler 270, the output module 280, and / or the display 230, etc., by receiving the test video tvd, the standardized video sv1, the scaled video sv2, the sampled video sv3, and / or the final sampled video lsv and mapping these videos with the frame number of each of the plurality of frames.
[0090] For example, when the color level value of each pixel of the first sampled video sv1 corresponds to the frame number of the test video, the sink device determines that no error has occurred. For example, when the color level value of each pixel of the second sampled video sv2 does not correspond to the frame number of the test video, the sink device determines that an error has occurred in the scaler 270. In this way, an error can be detected by comparing the frame number with the sampled video received in each of the blocks 260, 270, 280, and 230, etc. This will refer to Figure 4 Describe in more detail.
[0091] Figure 3 is a flow chart illustrating a method for generating a test video according to some example embodiments.
[0092] To generate Figure 2 Test video tvd, reference Figure 3 , the size of the test video is set based on the maximum resolution (e.g., the first resolution) of the display (S10), but example embodiments are not limited thereto, and for example, different resolutions of the display may be used. For example, when display 230 is a UHD display, according to the maximum resolution, the width w of the test video is set to 3840 pixels and the height h thereof is set to 2160 pixels, but example embodiments are not limited thereto.
[0093] The image pattern generation of the test video is started (S11). Since the test video includes a plurality of frames, a binary pattern and a color pattern associated with a frame number are generated for each frame (S12 and S13). Although the illustration has been described as generating a color pattern after generating a binary pattern, according to various example embodiments, the binary pattern and the color pattern may be generated simultaneously.
[0094] When generating the binary pattern and the color pattern, the sink device checks whether the set size of the test video is the minimum size (e.g., the second resolution) supported by the display 230 (S14). For example, in the case of the UHD display 230, the minimum size may be a width w of 512 pixels and a height h of 480 pixels, but example embodiments are not limited thereto. That is, if the video size has a width w of 512 pixels and a height h of 480 pixels, the generation of the image pattern of the test video is terminated (S14, N).
[0095] If the video pattern of the test video is larger than the minimum size, the convergence point device generates a video pattern of the test video with a smaller size through operations S11 to S13, while gradually reducing the current video size by a desired and / or predetermined unit (e.g., a desired resolution and / or pixel amount, etc.) (S15). For example, in the case of the above-mentioned UHD display 230, the convergence point device may reduce the width and height by 32 pixels starting from 3840×2160, and may sequentially generate an image pattern with a size of 3808×2128 and an image pattern with a size of 3776×2096 to generate an image pattern with a size of 512×480, and so on.
[0096] Figures 4 to 11 1 is a view for describing an image pattern of a test video according to various example embodiments. The test video includes a plurality of frames, and each of the plurality of frames may include a Figures 4 to 11 Image patterns of example embodiments are described.
[0097] Figure 4 is a view illustrating an image pattern of a test video according to at least one example embodiment.
[0098] refer to Figure 4 , a test video according to at least one example embodiment may include a binary pattern and a color pattern, but is not limited thereto.
[0099] The binary pattern may be displayed in the frame tvd to verify an error in the image output sequence of the video system 10. Each of the plurality of frames included in the test video may be identified by a frame number (e.g., a frame identifier, etc.). The binary pattern is a frame number converted into binary bits, and the frame number may be represented by an n-bit value (n is a natural number of 2 or more), but example embodiments are not limited thereto.
[0100] For example, when the frame number is represented by 7 bits, the test video may include 128 (=2 7 ) frames. For the 85th frame among the 128 frames, when its frame number is converted into a bit value, it becomes "1010101" and so on.
[0101] According to some example embodiments, when the binarized frame number is represented by a black and white binary pattern, it is assumed that, for example, 0 is represented by black and 1 is represented by white, but is not limited thereto, and, for example, 1 may be represented by a black value and 0 may be represented by a white value. As shown, the 85th test frame tvd1 may display a binary pattern of 7 pixels corresponding to "1010101" in the BW area. Since the 7-bit frame number increases or decreases sequentially from the first test frame to the 128th test frame of the test video, the black and white pattern of the BW area changes according to and / or based on a certain and / or desired rule as the frame number increases or decreases. If the change in the binary pattern during the reproduction of the test video is not associated with an increase or decrease in the frame number, the processor 210 may detect an error in the image output sequence in the video system 10.
[0102] The color pattern may be displayed in the frame TVD to check whether the display 230 outputs the image normally (e.g., correctly). The color pattern may be a pattern in which a color is displayed using at least two color pixels corresponding to a bit value based on a frame number, but example embodiments are not limited thereto. According to various example embodiments, the color pattern may be represented in various desired and / or preset colors, but for ease of explanation, for example, a case where the color pattern is displayed in R (red), G (green), B (blue), Y (yellow), C (cyan), M (magenta), and W (white) colors will be described, but is not limited thereto.
[0103] According to the first exemplary embodiment, the color pattern may represent the same color of R, G, B, Y, C, M, and W in the color region of each frame. That is, the R, G, B, Y, C, M, and W colors may be displayed and / or fixedly displayed in the regions of C6, C5, C4, C3, C2, C1, and C0, respectively. In this case, if a change is detected by checking the color pattern according to and / or based on an increase or decrease in the frame number during the reproduction of the test video, the processor 210 may detect an error caused by an abnormal image and / or an unexpected image being output.
[0104] In addition, according to the second example of the embodiment, the color pattern may also be expressed so that R, G, B, Y, C, M, and W are shifted for each frame. That is, in the regions of C6, C5, C4, C3, C2, C1, and C0, R, G, B, Y, C, M, and W may be expressed for the first frame, W, R, G, B, Y, C, and M may be expressed for the second frame, and M, W, R, G, B, Y, and C may be expressed for the third frame. In this case, in the change of the color pattern according to and / or based on the increase or decrease of the frame number tested during the reproduction of the video, an abnormal output error (for example, other colors are well expressed in C2, but blue is not properly expressed) and the like may be detected in some regions of C6, C5, C4, C3, C2, C1, and C0.
[0105] According to some example embodiments, the color pattern and the binary pattern included in one frame may be set to be spaced apart from each other at a desired and / or predetermined interval on the display 230. That is, according to the third example embodiment, the binary pattern indicating the frame number may be represented in the second area (BW area), while the same colors of R, G, B, Y, C, M, and W for each frame are fixed and represented as the first area (color area), as in the first example embodiment. According to the fourth example embodiment, the binary pattern for displaying the frame number may be represented in the second area (BW area), while the colors of R, G, B, Y, C, M, and W for each frame are shifted and represented in the first color area, as in the second example embodiment.
[0106] In the illustrated example embodiment, the first region (color region) may be displayed on a portion spaced apart from the edge of the screen of the display 230 by, for example, 15% in the left and right directions, and on a region spaced apart from the top by, for example, 10% and from the bottom by, for example, 30%, but example embodiments are not limited thereto. The second region (BW region) may be displayed on a portion spaced apart from the edge of the screen of the display 230 by, for example, 15% in the left and right directions, and on a region spaced apart from the lower side of the first region (color region) by, for example, 10% and from the bottom by, for example, 10%, but example embodiments are not limited thereto.
[0107] However, in the illustrated exemplary embodiment, it is described that the first region (color region) and the second region (BW region) are vertically spaced apart from each other and displayed on the screen, but the exemplary embodiments of the inventive concept are not limited thereto. According to various exemplary embodiments, for example, the first region and the second region may be displayed to be spaced apart from each other in the left and right directions, or may be displayed in a diagonal direction or a polygonal shape and spaced apart from each other in at least two directions, and the like.
[0108] Figure 5is a view showing an image pattern of a test video according to at least one example of an embodiment.
[0109] refer to Figure 5 , the test video according to at least one example embodiment may include a binary pattern and a color pattern, but is not limited thereto. In the illustrated example, the CB area (color-black) may be represented by 0 as black and by 1 as color (e.g., any one of R, G, B, Y, C, M, and W, etc.). In the frame number "1010101", LC6, LC4, LC2, and LC0 corresponding to 1 may be represented by color, and BW5, BW3, and BW1 corresponding to 0 may be represented by black, and so on.
[0110] Specifically, Figure 4 Differently, in the binary pattern of the second region (CB region), according to some example embodiments, at least one pixel corresponding to the binary pattern of the frame number may be represented in two different colors. According to at least one example embodiment, the binary pattern may be represented in black and blue, and according to another example embodiment, the binary pattern may also be represented in white and red. In addition, if the binary pattern is represented in two different colors such as red and green, it will be said that it corresponds to at least one example embodiment of the inventive concept.
[0111] As shown in the figure, when the color pattern is displayed as a 7-bit pattern, according to at least one example of the embodiment, the color pattern can represent the same color of R, G, B, Y, C, M and W in the color area for each frame. That is, the color of a specific color can be displayed and / or fixedly displayed in the areas of uC6, uC5, uC4, uC3, uC2, uC1 and uC0. For example, the convergence point device displays and / or fixedly displays different first colors, second colors, third colors, fourth colors, fifth colors, sixth colors and seventh colors in the areas of uC6, uC5, uC4, uC3, uC2, uC1 and uC0 during the reproduction of the test video, and checks the pixel value of the color area according to and / or based on the increase or decrease of the frame number. When a change in the pixel value is detected, the processor 210 can detect an error caused by an abnormal image and / or an unexpected image being output.
[0112] In addition, according to the second example of the embodiment, the color pattern may be represented so that the color of each different sub-region displayed in the color region is shifted for each frame. That is, in the regions of uC6, uC5, uC4, uC3, uC2, uC1, and uC0, R, G, B, Y, C, M, and W may be represented for the first frame, W, R, G, B, Y, C, and M may be represented for the second frame, and M, W, R, G, B, Y, and C may be represented for the third frame, but the example embodiment is not limited thereto. In this case, in the change of the color pattern according to and / or based on the increase or decrease of the frame number during the reproduction of the test video, an abnormal output error may be detected in some regions of uC6, uC5, uC4, uC3, uC2, uC1, and uC0 (for example, red (R) is mostly well represented, but is not correctly represented in uC3).
[0113] Figure 6 is a view illustrating an image pattern of a test video according to at least one example embodiment.
[0114] refer to Figure 6 , the image pattern of the test video may be generated to correspond to the color difference of the pixel value, but is not limited thereto. If the color is divided into m levels (where m is a natural number of 2 or more) based on the pixel value, the color can be represented by a total of up to log 2 (m) levels of bits. If a plurality of frames included in the test video are displayed on the display 230, in which pixels have color level values corresponding to the frame numbers, an output order error of the image may be detected.
[0115] For example, suppose a test video contains 512 (=2 9 If the 286th frame among the 512 frames is represented by a binary pattern, it can be represented by 9 bits, such as "100011110".
[0116] For example, it is assumed that the pixel information is represented by a total of 8 levels divided into 3 bits. The pixel value that can be represented by 3 bits has a value of 0 to 255. For example, if the pixel information belongs to 0 to 31, the pixel information can be represented as a color corresponding to a color level value of 0, and if the pixel information belongs to 32 to 63, the pixel information can be represented as a color corresponding to a color level value of 1, and so on. In the illustrated example, the pixel information is represented as ranging from black with a color level value of 0 to white with a color level value of 7, and can be represented as changing from black to light gray to white as the color level value increases from 0 to 7, but is not limited thereto.
[0117] If the pixel information of the BW1 area is 200 (Y0=200), the pixel information is represented by a color corresponding to the color level value 6, if the pixel information of the BW2 area is 100 (Y1=100), the pixel information is represented by a color corresponding to the color level value 3, and if the pixel information of the BW3 area is 150 (Y2=150), the pixel information is represented by a color corresponding to the color level value 4, but the example embodiments are not limited thereto.
[0118] In this case, color level values 6, 3, and 4 may each be converted to a 3-bit pattern, and the frame number may be represented by a pattern of three bars, and thus may be represented by 9 bits. The frame number may be 100 011 110 with a bit pattern of BW1, BW2, BW3, and so on.
[0119] That is, the test frame tvd3 includes three sub-areas BW1, BW2, and BW3 divided by 3 bits, each sub-area can represent pixel information in a color corresponding to a color level value, and the color level values of all sub-areas are coupled to the frame number to change. Therefore, when reproducing the test video, the color level value of each sub-area changes according to and / or based on an increase or decrease in the frame number, and the processor 210 can detect an error in the image output sequence by checking the color change of the sub-area according to the change of the color level value, etc.
[0120] For ease of explanation, the pixel information has been described as being divided into 3 bits and transmitted in 8 (=2 3 ) levels, but according to various other exemplary embodiments, the pixel information may also be divided into 4 (=2 2 ) levels of pixels or 16 (=2 4 ) level of pixels, etc.
[0121] Figure 7 is a view illustrating an image pattern of a test video according to at least one example embodiment, and Figure 8 is a view illustrating an image pattern of a test video according to another example embodiment.
[0122] When representing image data, the video system 10 classifies and processes the image data into R (red), G (green) and B (blue) channels, or Y (luminance), U (chrominance blue, Cb) and V (chrominance red, Cr) channels, etc., but example embodiments are not limited thereto. Figure 7 The example embodiment of describes the case of processing image data in RGB channels, and Figure 8 The example embodiments describe the case of processing image data in YUV channels.
[0123] refer to Figure 7 ,and Figure 6 Differently, the test frame tvd4 can display the color pattern of the RGB channels represented by two different color level values of one color.
[0124] For example, when each color is represented in 8 stages, the color of each sub-region can be represented as a 3-bit pattern, but is not limited thereto. Figure 6 As described in , colors can be represented as colors of different densities according to and / or based on color level values.
[0125] In the case of R (red) in the illustrated example, an R1 region having pixel information 250 may be represented by a red color corresponding to a color level value of 7, and an R2 region having pixel information 100 may be represented by a red color corresponding to a color level value of 3, etc. In the case of G (green), a G1 region having pixel information 200 may be represented by a green color corresponding to a color level value of 6, and a G2 region having pixel information 50 may be represented by a green color corresponding to a color level value of 1, etc. In the case of B (blue), a B1 region having pixel information 150 may be represented by a blue color corresponding to a color level value of 4, and a B2 region having pixel information 0 may be represented by a blue color corresponding to a color level value of 0, and so on.
[0126] Therefore, the frame number can be expressed by 18 bits obtained by combining the previous RGB colors R1, G1, and B1 and the subsequent RGB colors R2, G2, and B2, etc. The frame number can be expressed in the order of [B2 G2 R2 B1 G1 R1] from the 0th bit to the 17th bit, and 2 18 The frame number of the 5943rd frame among the frames may be "000001 011 100 110 111", but is not limited thereto.
[0127] That is, when the 18-bit frame number sequence increases or decreases, the color of the color pattern also changes according to and / or based on the increase or decrease of the frame number. Therefore, the processor 210 can detect errors in the image output sequence, and can check whether the image is output normally by checking the color of the color pattern displayed on the display 230.
[0128] refer to Figure 8 ,and Figure 6 Differently, the test frame tvd5 may display a color pattern of a YUV channel represented by two different color level values of one color, but example embodiments are not limited thereto.
[0129] According to at least one example of the embodiment, Figure 7As described above, in the YUV channel, by checking the color of the color pattern of the YUV channel according to and / or based on the frame number, it is possible to check whether the image is output normally and / or check whether there is an error in the image output sequence, etc.
[0130] According to another example embodiment, the color pattern may be displayed as colors represented by bits that complement each other. For example, the frame number may be set so that the color level value of the previous YUV is the complement of the color level value of the next YUV, but example embodiments are not limited thereto.
[0131] In the illustrated example, in the case of Y (yellow), the Y region may be represented by a yellow color corresponding to a color level value of 6 (e.g., a bit value of 110) having pixel information 200, and the subsequent complementary-Y region may be represented by a yellow color corresponding to a color level value of 1 (e.g., a bit value of 001) having pixel information 55, but example embodiments are not limited thereto. In the case of CB (chromaticity blue), the CB region may be represented by a chromaticity blue color corresponding to a color level value of 3 (e.g., a bit value of 011) having pixel information 100, and the subsequent complementary-CB region may be represented by a chromaticity blue color corresponding to a color level value of 4 (e.g., a bit value of 100) having pixel information 155, but example embodiments are not limited thereto. In the case of CR (chromaticity red), the CR region may be represented by a chromaticity red color corresponding to a color level value of 4 (e.g., a bit value of 100) having pixel information 150, and the subsequent complementary-CR region may be represented by a chromaticity red color corresponding to a color level value of 3 (e.g., a bit value of 011) having pixel information 105, but example embodiments are not limited thereto.
[0132] Therefore, the frame number can be represented by combining the normal color and the complementary color of the normal color. In the example shown, the frame number can be represented as 18 bits obtained by combining the YUV color and the complementary ~Y~U~V color, but the example embodiment is not limited thereto. The frame number can be represented in the order of [CR CB Y~Cr~Cb~Y] from the 0th bit to the 17th bit, the YUV color can be the 286th frame in 512 frames, and the complementary ~Y~Cb~Cr can be the 225th frame in 512 frames, and can be "100011 110 011 100 001", but is not limited thereto. That is, in the case of complementarity between the upper 9 bits and the lower 9 bits, the processor 210 can use only the upper 9 bits or the lower 9 bits represented by the bits of the image pattern corresponding to the frame number to check whether there is an error in the image output order. At the same time, the processor 210 can use the remaining bits not used for error detection (for example, the lower 9 bits when the upper 9 bits are used for error detection) to check whether the image is output normally, but the example embodiment is not limited thereto.
[0133] exist Figure 8In the description of , the YUV channel has been described, but even when a color pattern is generated using an RGB channel or another color channel, each sub-region can be represented by RGB (normal color) and ˜R˜G˜B (complementary color), respectively.
[0134] Fig. 9 is a view illustrating an image pattern of a test video according to at least one example embodiment.
[0135] refer to Fig. 9 , the test frame tvd6 may be represented as a color pattern in which a first color channel and a second color channel are combined, but example embodiments are not limited thereto. In the example shown, the test frame tvd6 may be represented as a color pattern including both RGB and YUV channel colors, but is not limited thereto. By representing a color pattern in which two types of channels are mixed, regardless of which type of color channel is supported, a test video may be displayed on the display 230, regardless of whether it is an RGB channel and / or a YUV channel. The processor 210 may detect whether an image is output normally (e.g., output correctly) by whether the frame output sequence is normal (e.g., correct) and whether various types of color channels are displayed.
[0136] In this case, as described above, according to some example embodiments, by setting a different color level value for each pixel information of each sub-region, the pixel information may be represented as color density according to and / or based on the color level value.
[0137] Fig.10 and Fig.11 is a view illustrating an image pattern of a test video according to some example embodiments.
[0138] The multiple frames included in the test video each have a frame number for identifying each frame, but if there is a problem with the frame number itself, there is a problem with data integrity. For data integrity, according to some example embodiments, the test frame may also include error information for detecting errors in the frame number itself.
[0139] For example, it is assumed that the image pattern corresponding to the frame number is represented by RGB color and complementary RGB color, but not limited thereto. The image pattern is converted into a frame number corresponding to the RGB color and the complementary RGB color, such as "100 011 110 011 100001", which represents the 286th frame and the 225th frame in 512 frames, but example embodiments are not limited thereto.
[0140] refer to Fig.10, according to at least one example embodiment, the error information may be a parity bit, but is not limited thereto. The parity bit region P may also be included at the end of the test image pattern, and the parity bit P may be represented as error information according to and / or based on the number of "1"s in the frame number. Assume that if the number of "1"s is an odd number, the parity bit is represented by "1" and the parity bit region P is represented by white, and if the number of "1"s is an even number, the parity bit is represented by "0" and the parity bit region P is represented by black, but example embodiments are not limited thereto. In the example shown, since the number of "1"s in the frame number is an odd number, the parity bit region P may be displayed in white, but is not limited thereto.
[0141] According to various example embodiments, the parity bit region is not limited to the above example embodiments and may be represented by two or more bits, and / or its color may also be represented by a desired and / or preset color other than black and white, etc.
[0142] refer to Fig.11 According to at least one example of the embodiment, the error information may be a checksum. The test image pattern further includes a checksum area CS, and a value obtained by dividing a value obtained by adding all color level values by all level stages may be represented as a color of the checksum area CS as a checksum value, but the example embodiment is not limited thereto.
[0143] In the illustrated example, a value of 5 obtained as a residual value by dividing the sum of the color level values 6+3+4+1+4+3 of the RGB color and the complementary RGB color by all level stages 8 may be used as a checksum value, etc. The checksum area CS may be represented as a gray color having a density corresponding to level 5 among levels 0 to 7, but example embodiments are not limited thereto.
[0144] Although not shown, according to another exemplary embodiment, the error information may be a cyclic redundancy check (CRC), but is not limited thereto. The test image pattern may further include a CRC area, and a CRC calculation value of a binary pattern of a frame number may be represented in the CRC area, and the like.
[0145] That is, according to various example embodiments capable of checking integrity, error information may be included in the image pattern, such as a parity bit, a checksum value, and / or a CRC value, etc.
[0146] Fig.12 is a view for describing the operation of a weighted model learned through machine learning according to some example embodiments.
[0147] refer to Fig.12, the video system 10 includes a training module 1250 and / or a weighted model 1270, etc., but is not limited thereto. According to some example embodiments, one or more of the training module 1250 and / or the weighted model 1270, etc. may be implemented as a processing circuit. The processing circuit may include hardware or a hardware circuit, including a logic circuit; a hardware / software combination, such as a processor that executes software and / or firmware; or a combination thereof. For example, the processing circuit may more specifically include, but is not limited to, a central processing unit (CPU), an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a system on a chip (SoC), a programmable logic unit, a microprocessor, an application specific integrated circuit (ASIC), etc., but is not limited thereto.
[0148] The training module 1250 (e.g., a machine learning module, a neural network training module, an artificial intelligence learning module, etc.) receives the sample videos SV1, SV2, SV3, and LSV output from the sink device 200, and the sample videos SV1, SV2, SV3, and LSV are received, and / or reflected in the input module (e.g., Figure 2 at least one input processing error image 1211, wherein at least one error occurs in the input module 260 in the image processing module 1211, wherein the image processing error image 1211 exists and / or is reflected in the scaler (e.g., Figure 2 The error occurred in the scaler 270 in the output module (e.g., Figure 2 The output processing error image 1213 and / or the error image 1213 that occurs in the output module 280 in the display (for example, Figure 2 The processing error image 1214 is displayed for detecting errors that occur in the display 230 in the display 230, and a normal image (e.g., an error-free image, an error-free video, etc.) including a binary pattern and / or a color pattern and not containing an error is received for training to detect errors in video frames, but example embodiments are not limited thereto. The training module 1250 trains various processing error images compared to normal images, and the weighted model 1270 is trained by assigning weights according to and / or based on the error type and the cause and source of the error from the trained processing error image.
[0149] For example, the training module 1250 assigns weights of error types, error causes and / or sources, etc. to image patterns mapped to frame numbers of processing error images, and stores the weights in the weighting model 1270, but example embodiments are not limited thereto.
[0150] Fig.13 is a view illustrating an error detection method according to reproduction of a test video according to at least one example of an embodiment.
[0151] refer to Fig.13, the video system 10 includes a weighting model 1370 and / or a decision logic 1350, etc., but is not limited thereto. According to some example embodiments, one or more of the weighting model 1370 and / or the decision logic 1350, etc. may be implemented as a processing circuit. The processing circuit may include hardware or a hardware circuit, including a logic circuit; a hardware / software combination, such as a processor that executes software and / or firmware; or a combination thereof. For example, the processing circuit may more specifically include, but is not limited to, a central processing unit (CPU), an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a system on a chip (SoC), a programmable logic unit, a microprocessor, an application specific integrated circuit (ASIC), etc., but is not limited thereto. When the test video 1310 is input to the video system 10, the video system 10 reproduces the test video. The decision logic 1350 of the video system 10 checks whether at least one error occurs when reproducing the video. If an error is detected, the decision logic 1350 refers to the weighting model 1370 and determines the type of error, the cause of the error, and / or the source of the error based on an image pattern, etc. included in the test video in which the error occurs.
[0152] For example, if an error is detected by reproducing the test video 1310, the decision logic 1350 can determine based on data trained from the weighted model 1370, etc. that the input video 1310 is processed normally in another block in the sink device 200, but the processing error 1392 is caused by the operation of the scaler 270.
[0153] Fig.14 and Fig.15 is a flowchart illustrating a method of generating an image pattern of a test video according to some example embodiments.
[0154] Will refer to Fig.14 and Fig.15 A more detailed description is provided, but example embodiments are not limited thereto. In the video system 10, the source device sends an input image (S110), and upon receiving a video, the sink device checks whether the received video is a test video including a binary pattern and a color pattern and / or a normal video (S210), but example embodiments are not limited thereto. If the video is checked as a test video (S210, yes), a test mode is entered and a video test is started (S220).
[0155] If the video test starts, the sink device records and / or identifies the pixel positions of the image pattern included in the test video based on the display 230 (S230). Since the pixel position may vary according to the setting (e.g., resolution) of the display 230, the pixel positions of the colors included in the pattern are mapped and recorded.
[0156] Thereafter, processing operations such as a normalization operation, a scaling operation, an image quality processing operation, etc. are sequentially repeated for each frame of the test video received from each of the video processors 260, 270, and 280 of the sink device (S240), but example embodiments are not limited thereto.
[0157] The sink device initializes previously set frame information (e.g., stored and / or pre-stored frame numbers, etc.) before a full-scale test operation (e.g., A1 to A2) (S250), and checks whether a vertical synchronization signal of a new frame can be input (S260).
[0158] According to some example embodiments, the test video may include only a binary pattern per frame, but is not limited thereto. Fig.15 , if the vertical synchronization signal is switched and a new frame is input, the sink device checks the position pixel value of the binary pattern in the received frame image (S310). That is, based on the position recorded in S230, the sink device checks the position of the binary pattern and checks the pixel value at the position. The pixel value of the binary pattern can be displayed in black or white with a bit corresponding to the current frame number, but is not limited thereto. For example, the pixel value of the binary pattern can be as follows Figure 4 In addition, if the pixels of the binary pattern (e.g., Figure 4 If the BW4 block in the block is 2 bits or more, the sink device determines whether the black and white color level corresponding to the bit value matches the expected pixel value, but example embodiments are not limited thereto.
[0159] The sink device checks whether the current frame number is continuous with the previous frame number (e.g., sequential with the previous frame) based on the pixel value of the displayed binary pattern, and if the sink device determines that the current frame number is sequentially output (S320, Y), the sink device checks whether such sequential output is performed for all frames of the test video (S340). If the sink device does not repeatedly check the position pixel values of all frames (S340, N), the sink device initializes the current frame number (S250), checks the vertical synchronization signal (S260), receives the next frame, and repeats operations S310 and S320.
[0160] If, in operation S320, the pixel value corresponding to the current frame number of the binary pattern is not sequentially output compared with the pixel value of the previous frame (S320, N), the sink device determines that an error has occurred in which the frames are not sequentially output, and sends error information corresponding to the output sequence error to the source device (S330).
[0161] The source device receives the error information (S120), detects an output sequence error in the frame (S121), and checks the device (e.g., component) causing the output sequence error, i.e., the error position (S123). According to some example embodiments, the source device may display the checked error information and / or the error position on a display of the sink device, and / or may send the error information and the error position to a desired and / or preset external device, etc.
[0162] Fig.16 and Fig.17 is a flow chart illustrating a method of operation for error detection of an electronic device.
[0163] According to some example embodiments, the test video may include a single test pattern per frame, but example embodiments are not limited thereto, and for example, a plurality of test patterns may be included in a frame. Fig.16 , if the vertical synchronization signal is triggered and a new frame is input, the sink device checks whether the current frame number is continuous with the previous frame number, and if it is checked that the current frame number is continuously output after the previous frame number (S410, Y), the sink device checks the position pixel value of the color pattern in the received frame image (S430). However, if it is determined that the current frame number is not sequentially output compared with the previous frame number, such as skipping and / or rewinding, etc. (S410, N), the sink device considers that an output sequence error has occurred and stores the output sequence error as error information (S420). In addition, according to some example embodiments, such as Fig.10 or Fig.11 As shown, if it is determined that there is an error in the frame number itself based on the integrity information of the frame number, the sink device determines and / or considers that an error in the frame output sequence has occurred, and stores the output sequence error as error information according to and / or based on the integrity information (S420).
[0164] The sink device checks the position pixel value of the color pattern, and checks whether each pixel value (e.g., pixel value (Curr_FR)) in the color pattern in the current frame is an expected pixel value (e.g., EX_Pixel (Curr_FR)) corresponding to the current frame number (S440). Figure 7 As shown, the sink device checks whether the pixel values displayed in the color pattern R1, G1, B1, R2, G2 and B2 of the current frame are equal to the expected pixel values 250, 200, 150, 100, 50, 0, etc. corresponding to the current frame number 000 001 011 100 110 111.
[0165] If the pixel values of the color pattern do not match the expected pixel values (S440, N), the sink device determines that a color output error has occurred. The color output error may be based on a frame number output sequence error, may be an error generated by the video processors 260, 270, and 280 in the sink device, and / or may be due to an error in the display 230 itself. According to some example embodiments, as shown in FIG. Fig.12 and Fig.13 As described, the color pattern within the frame can be the color pattern of the learned and / or determined error image 1310 to easily detect the error of each video processor. If the pixel value of the color pattern matches the expected pixel value (S440, Y), operations S410 to S450 are repeated for all frames (S460).
[0166] If the repetition of the output error check is completed for all frames (S460, Y), the output order error and / or the color output error stored during the test is sent as error information to the source device (S470). The source device receives the error information (S130), checks and / or determines what type of error it is (S131), and checks the error position where the error occurred (S133). According to some example embodiments, the source device may display the checked error information and / or error position on a display of the sink device, and / or may send the error information and the error position to a desired and / or preset external device.
[0167] According to some example embodiments, the test video may include a binary pattern and / or a color pattern, etc., for each frame. Fig.17 , if the vertical synchronization signal is switched and a new frame is input, the sink device checks the position pixel value of the binary pattern in the received frame image (S510). That is, based on the position recorded in S230, the sink device checks the position of the binary pattern and checks the pixel value of the position, but is not limited thereto. The pixel value of the binary pattern may be displayed in black or white with a bit corresponding to the current frame number, but the example embodiment is not limited thereto. For example, the pixel value of the binary pattern may be as follows Figure 4 or Figure 5 The binary pattern may be displayed as shown in, but not limited to, a binary pattern.
[0168] The sink device checks whether the current frame number is in sequence with the previous frame number, and if the sink device determines that the current frame number is output sequentially (e.g., sequentially, etc.) (S520, Yes), the sink device checks the position pixel value of the color pixel in the received frame image (S540). However, if the sink device determines that the current frame number is not output sequentially, for example, compared with the previous frame number, the frame is skipped, repeated, etc. (S520, N), the sink device determines that an output sequence error has occurred and stores the output sequence error as error information (S530). In addition, according to some example embodiments, as Fig.10 or Fig.11 As shown, if it is determined that there is an error in the frame number itself based on the integrity information of the frame number, the sink device determines that an error in the frame output sequence has occurred and stores the output sequence error as error information according to the integrity information (S530).
[0169] The sink device checks the position pixel value of the color pattern, and checks whether each pixel value (e.g., pixel value (Curr_FR)) in the color pattern in the current frame is (e.g., matches) an expected pixel value (e.g., EX_Pixel (Curr_FR)) corresponding to the current frame number (S550). Figures 7 to 11 As shown, the sink device checks whether a pixel value displayed in a color pattern of a current frame is equal to an expected pixel value corresponding to a current frame number, but example embodiments are not limited thereto.
[0170] If the pixel values of the color pattern do not match the expected pixel values (S550, N), the sink device determines that a color output error has occurred. The color output error may be based on a frame number output sequence error, may be an error generated by the video processors 260, 270, and 280 in the sink device, and / or may be due to an error in the display 230 itself. According to some example embodiments, as shown in FIG. Fig.12 and Fig.13 As described, the color pattern within the frame may be a color pattern of the error image 1310 learned and / or determined to easily detect the error of each video processor, but example embodiments are not limited thereto. If the pixel value of the color pattern matches the expected pixel value (S550, Y), operations S510 to S560 are repeated for all frames (S570).
[0171] If the repetition of the output error check is completed for all frames (S570, Y), the output order error and / or the color output error stored during the test is sent as error information to the source device (S580). The source device receives the error information (S140), checks what type of error it is (S141), and checks the error position where the error occurred (S143). According to some example embodiments, the source device may display the checked error information and / or error position on a display of the sink device, and / or may send the error information and the error position to a desired and / or preset external device, etc.
[0172] Thereafter, the sink device initializes the images of the current frame and the past frame (S250, Fig.14), and the sink device determines whether a new frame is input as a vertical synchronization signal of the frame (S260). The video system 10 maps the pixel positions recorded in operation S230 and the binary pattern of the test video to check the pixel values at each position (S510), and checks whether the frames are output sequentially. That is, if the current frame is output sequentially to the past frame, the sink device checks whether an error also occurs in the color pattern (S520). If the current position pixel value of the color pattern has an expected color value corresponding to the frame number of the test video (S550), the sink device determines that there is no error, and repeats operations S510 to S560 for the next frame. However, if the current position pixel value of the color pattern does not match the expected color value corresponding to the frame number of the test video (S550, N), the sink device determines that an error has occurred in the video system 10, and sends information about the error position and the error occurrence (S560 to S580).
[0173] Various exemplary embodiments of the present invention have been described above with reference to the accompanying drawings, but those skilled in the art will appreciate that various modifications and changes may be made without departing from the technical spirit or basic features of the present invention. Therefore, it should be understood that the above exemplary embodiments are illustrative and not restrictive in all aspects.
Claims
1. A convergence device, include: The processing circuit is configured to: receiving a test video from a source device, the test video comprising a plurality of frames and each of the plurality of frames comprising a type pattern corresponding to a frame number of the corresponding frame, Perform a normalization operation on the test video to generate a normalized video, scaling the normalized video to generate a scaled video, performing an image quality processing operation on the scaled video to generate a sampled video, outputting the sampled video to a display, the display being configured to display the sampled video as a final sampled video, and At least one error generated in any one of a source device, a processing circuit, or a display is detected based on pixel values of the test video, the standardized video, the scaled video, the sampled video, and the final sampled video and expected pixel values corresponding to a type pattern included in each of the plurality of frames.
2. The convergence point device according to claim 1, in, Each frame includes at least one type pattern corresponding to a frame number, the at least one type pattern being at least one of a binary type pattern and a color type pattern.
3. The convergence point device according to claim 2, in, Each frame also includes integrity information corresponding to the frame number.
4. The convergence point device according to claim 2, in, The processing circuit is further configured to: determining whether frame numbers of a plurality of frames are sequentially output based on pixel values corresponding to type patterns of corresponding frame numbers; and A frame output sequence error is detected based on a result of the determining.
5. The convergence point device according to claim 1, wherein The frame number is a bit value identifying a corresponding frame among the plurality of frames; and The type pattern of each frame is displayed in color, with at least two pixels corresponding to the bit values of the corresponding frame.
6. The convergence point device according to claim 5, wherein Each frame of the test video includes a binary pattern displayed in a first sub-region within the frame, the binary pattern representing a bit value of the frame number using two different colors.
7. The convergence point device according to claim 5, wherein Each frame of the test video includes a color pattern displayed in a second sub-region within the frame, the color pattern representing a bit value of a frame number using a plurality of colors.
8. The convergence point device according to claim 7, wherein The color pattern includes at least two pixels, and each of the at least two pixels of the color pattern has a color level value representing at least a two-bit value.
9. The convergence point device according to claim 2, in, The color pattern includes a first channel color and a second channel color, the first channel color and the second channel color having color values based on a frame number.
10. The convergence point device according to claim 9, in, The second channel color is a channel color of a different type than the first channel color.
11. The convergence point device according to claim 9, in, The second channel color has a color value corresponding to a complementary bit value of the bit value of the first channel color.
12. An electronic device, the electronic device include: The processing circuit is configured to: receiving a test video from an input device, the test video comprising a plurality of frames; Process the test video and convert it into an intermediate sampled video; processing the intermediate sampled video into a final sampled video and outputting the final sampled video to a display; as well as detecting a frame output sequence error or a color output error in a processing circuit or a display based on pixel values corresponding to a plurality of frame numbers included in each of a test video, an intermediate sampling video, and a final sampling video, Each video includes a binary pattern and a color pattern, the binary pattern represents a frame number of a corresponding frame using binary bits, and the color pattern is generated based on the binary pattern.
13. The electronic device according to claim 12, in, The test video includes a first sub-region in each frame, and a binary pattern of the corresponding frame is included in the first sub-region, the binary pattern being based on two different colors.
14. The electronic device according to claim 13, in, The test video includes a second sub-region spaced apart from the first sub-region in each frame, and a color pattern of the corresponding frame is included in the second sub-region.
15. The electronic device according to claim 12, in, The binary pattern includes binary bits associated with the frame number and error information.
16. An electronic device, wherein the electronic device include: The processing circuit is configured to: receiving a test video from an input device, the test video comprising a plurality of frames and each of the plurality of frames comprising at least one type pattern corresponding to a frame number of the corresponding frame; Process the test video and convert it into an intermediate sampled video; Processing the intermediate sampled video into a final sampled video, and outputting the final sampled video to a display; as well as A weighted model regarding the test video, the intermediate sampled video, and the final sampled video is used to determine whether an error has occurred in the processing circuit or the display.
17. The electronic device according to claim 16, in, Test videos include: a binary pattern in the first sub-region of the corresponding frame, the binary pattern corresponding to the frame number of the corresponding frame converted into binary bits, the binary pattern represented in two different colors; and A color pattern in the second sub-region of the corresponding frame, the color pattern corresponds to a frame number of the corresponding frame, and the color pattern is represented by a plurality of colors in a plurality of pixels.
18. The electronic device according to claim 17, wherein Each frame of the test video includes multiple sub-regions, each sub-region uses a different color channel; and Each color channel among the different color channels in each of the plurality of sub-regions is a color channel representing a frame number of a corresponding frame by dividing binary bits corresponding to the frame number into at least two bits mapped to each sub-region.
19. The electronic device according to claim 18, in, A color pattern of each of the plurality of sub-regions is represented by at least one of a BW channel, an RGB channel, and a YCBCR channel.
20. The electronic device according to claim 19, in, The plurality of sub-regions include RGB colors and complementary RGB colors corresponding to binary bits.
Citation Information
Cited By
Image testing device and method for LED video processor
CN121357320A
