Signal processing device, image display device, and signal processing method

Abstract

A signal processing device according to one aspect of the present disclosure is provided with a first processing unit, an image signal storage unit, a second processing unit, a detecting unit, and a determining unit. The first processing unit subjects an image signal to first processing. The image signal storage unit stores the image signal that has been subjected to the first processing. The second processing unit carries out second processing including, at least, processing to read the stored image signal from the image signal storage unit. The detecting unit detects the completion of the first processing. The determining unit determines, at least on the basis of the first processing completion timing, whether to advance the scheduled start timing of the second processing. Further, the second processing unit starts the second processing earlier than the scheduled start timing if it is determined that said advancement is to be carried out.

Description

[Technical field]

[0001] The present disclosure relates to a signal processing device, an image display device, and a signal processing method. [Background technology]

[0002] In image display devices such as television receivers, frame control and image quality control are performed to display high-quality images. In recent years, in addition to image control, a wide variety of functions such as connection to the Internet have been added, and the number of signal paths that image display devices must support has also increased. As the processing of image display devices has become more diverse and complex, software that realizes these controls and functions has become increasingly important.

[0003] In order to output an image without distortion, it is necessary to perform processing related to image output after processing on the input image is reliably completed. Therefore, processing related to image output is set to start after a fixed time has elapsed from the start timing of processing on the input image, and the length of the fixed time is determined assuming the case where processing on the input image is delayed to the maximum. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2008-252585 A Summary of the Invention [Problem to be solved by the invention]

[0005] In recent years, as the processes performed by software have become more diverse and complicated, the time required to process an input image has become longer, and the length of the fixation time also tends to become longer.

[0006] However, the responsiveness of image display devices is also becoming important. For example, when a game image is displayed, emphasis is placed on the responsiveness to game operations. Also, emphasis is placed on the responsiveness from when an instruction to perform a function is given until the instruction is actually performed. In other words, the longer the fixed time, the more the responsiveness is lost, and the lower the evaluation of the image display device.

[0007] The present disclosure provides a signal processing device and the like that achieves both high image quality and responsiveness. [Means for solving the problem]

[0008] A signal processing device according to one aspect of the present disclosure includes a first processing unit, an image signal storage unit, a second processing unit, a detection unit, and a determination unit. The first processing unit performs a first processing on an image signal. The image signal storage unit stores the image signal on which the first processing has been performed. The second processing unit performs a second processing including at least a process of reading out the image signal stored in the image signal storage unit. The detection unit detects the end of the first processing. The determination unit determines whether or not to advance the scheduled start timing of the second processing based on at least the end timing of the first processing. Furthermore, when it is determined that the second processing should be advanced, the second processing unit starts the second processing before the scheduled start timing.

[0009] The signal processing device may be configured such that the scheduled start timing of the second processing is separated from the scheduled start timing of the first processing by a predetermined fixed time, and if it is determined not to carry out the advance, the second processing unit starts the second processing at the scheduled start timing of the second processing.

[0010] The signal processing device may be configured to further include a calculation unit that calculates a differential time length from the end timing of the first processing to the scheduled start timing of the second processing, and the determination unit determines whether or not to implement the advance based on the differential time length.

[0011] The signal processing device may be configured such that the detection unit detects the end of the first processing and the start of the second processing and notifies the determination unit, and when a predetermined time has elapsed between receiving a notification of the end of the first processing and receiving a notification of the start of the second processing, the determination unit decides to advance the scheduled start timing of the second processing.

[0012] The signal processing device may be configured so as to further include a calculation unit that calculates the length of time required from the start timing of the first processing to the end timing of the first processing, the detection unit detects the start and end of the first processing and notifies the calculation unit, and the determination unit determines whether or not to advance the scheduled start timing of the second processing based on the required time.

[0013] The signal processing device may be configured such that the detection unit detects the start and end of the first processing and notifies the determination unit, and if the determination unit receives a notification of the end of the first processing before a predetermined time has elapsed since receiving the notification of the start of the first processing, the determination unit decides to advance the scheduled start timing of the second processing.

[0014] The signal processing device may be configured to further include a timing determination unit that determines a start timing of the second processing, and the second processing unit starts the second processing at the determined start timing.

[0015] The signal processing device may be configured such that the timing determination unit determines the start timing of the second processing between a timing when a predetermined time has elapsed from the scheduled start timing of the first processing and the scheduled start timing of the second processing.

[0016] The signal processing device may be configured so as to further include an information detection unit that detects image signal information from the image signal used when displaying an image based on the image signal, and the judgment unit judges whether or not to advance the scheduled start timing of the second processing based further on the image signal information.

[0017] The signal processing device may be configured so as to further include a user interface unit that generates or receives operation information regarding operations performed on the signal processing device, and the determination unit determines whether or not to advance the scheduled start timing of the second processing based on the operation information.

[0018] The signal processing device may be configured such that, when the processing time of a current cycle of the first processing is longer than the processing time of a previous cycle of the first processing, and a predetermined condition is satisfied, the timing determination unit sets the scheduled start timing of the current cycle of the second processing to be the same as the scheduled start timing of the previous cycle of the second processing.

[0019] The signal processing device may be configured so that, after the second processing, a third processing unit performs a third processing including at least a process of reading out the image signal stored in the image signal storage unit, the detection unit detects the end of the second processing, the judgment unit judges whether or not to advance the scheduled start timing of the third processing based on at least the end timing of the second processing, and the third processing unit starts the third processing before the scheduled start timing of the third processing when it is decided to advance the scheduled start timing of the third processing.

[0020] In another aspect of the present disclosure, a first processing unit that performs a first processing on the image signal; an image signal storage unit that stores the image signal that has been subjected to the first processing; a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit; a display unit that displays the image signal that has been subjected to the second processing; A detection unit that detects the end of the first process; A determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process; Equipped with The second processing unit starts the second process before the scheduled start timing when it is determined that the process is to be brought forward. An image display device is provided.

[0021] In another aspect of the present disclosure, detecting an end of a first processing performed on the image signal; determining whether or not to advance a scheduled start timing of a second process, the second process including at least a process of reading out an image signal stored in an image signal storage unit that stores the image signal on which the first process has been performed, based on at least a timing of the end of the first process; When it is determined that the operation is to be brought forward, starting the second process before the scheduled start timing; A signal processing method is provided, comprising: [Brief description of the drawings]

[0022] [Figure 1] FIG. 1 is a block diagram showing a configuration example of an image display device according to an embodiment of the present disclosure. [Diagram 2] FIG. 4 is a diagram for explaining start timings of an input task and an output task. [Diagram 3] 11A and 11B are diagrams for explaining the advancement of the scheduled start timing of an output task. [Figure 4] 11 is a diagram showing an example of the transition of the end timing of an input task and the start timing of an output task. [Diagram 5] 11 is a flowchart of an example of adjusting the start timing of an output task. [Figure 6] FIG. 13 is a diagram for explaining the advancement of the scheduled start timing of an output task when an interrupt output is required. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0023] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0024] Fig. 1 is a block diagram showing a configuration example of an image display device according to an embodiment of the present disclosure. The image display device 100 of Fig. 1 includes a UI (user interface) unit 110, an input processing unit (first processing unit) 120, an image signal storage unit 130, an output processing unit (second processing unit) 140, a control unit 150, and a synchronization signal generating unit 160. The input processing unit 120 includes an image signal receiving unit 121, an information detecting unit 122, and a pre-processing unit 123. The output processing unit 140 includes an image processing unit 141 and a display unit 142. The control unit 150 includes a detection unit 151, a calculation unit 152, a determination unit 153, and a timing determination unit 154.

[0025] In addition, the embodiment of the present disclosure may have components or functions that are not shown or described. The following description does not exclude components or functions that are not shown or described. For example, it is conceivable that the image display device 100 includes a first storage unit that stores information that should be permanently held by the image display device 100, such as selectable image quality settings, and a second storage unit that temporarily stores information input to the image display device 100.

[0026] The image display device 100 is a device that performs image processing on an image represented by an input image signal and displays the processed image. For example, the image display device 100 is realized by a television receiver that receives broadcast waves from each broadcast station and displays an image. Also, for example, the image display device 100 is realized by a computer that receives an image signal from a communication network and displays an image, such as a personal computer, a tablet, or a smartphone.

[0027] In this disclosure, the term "image" is a concept that encompasses both still images and moving images. Therefore, "image" in this disclosure may be replaced with still images or moving images, unless there is a particular problem. In other words, the image displayed on the image display device 100 may be a moving image or a still image. The concept of "video" is also included in "image." The image displayed on the image display device 100 may be an image that can give the viewer a three-dimensional impression, such as a stereoscopic image or a 3D image.

[0028] In the present disclosure, it is assumed that the image display device 100 displays an image as a general aspect. However, a series of processes of the image display device 100 of the present disclosure may be distributed and performed among a plurality of devices. For example, a series of processes for an image signal may be performed by a personal computer, but the image may ultimately be displayed on a display device such as a monitor. In this way, the image display device 100 may be divided into a device that processes images and a device that displays images. In such a case, the image display device 100 corresponds to a system including both a computer that processes images and a monitor that displays images.

[0029] Moreover, image display device 100 and the above-mentioned image processing devices can be called signal processing devices from the viewpoint of processing signals related to images, and can be called image processing devices from the viewpoint of performing processing such as image manipulation.

[0030] The UI unit 110 is a user interface that generates information related to operations performed on the image display device 100. The generated information is output to the control unit 150. This information is referred to as operation information.

[0031] The UI unit 110 is realized by operation members such as a keyboard, buttons, dials, a touch panel, etc. When a user of the image display device 100 operates these operation members, operation information is generated.

[0032] Alternatively, the UI unit 110 may not generate operation information but may only receive operation information from an operation member. For example, the UI unit 110 may include a receiver that receives a wireless signal including operation information from an operation member, such as a wireless keyboard or a remote controller, that is separate from the image display device 100.

[0033] For example, a plurality of image quality settings may be preregistered in the image display device 100, and the user may select a desired image quality setting via the UI unit 110. In this case, the desired image quality setting corresponds to the operation information. Alternatively, which of a plurality of buttons provided in the UI unit 110 has been pressed corresponds to the operation information, and the desired image quality setting may be determined by the control unit 150 based on the operation information and the display screen.

[0034] The input processing unit (first processing unit) 120 processes the input image signal and writes the processed image signal into the image signal storage unit 130. An example of components included in the input processing unit 120 will be described below.

[0035] The image signal receiving unit 121 receives an image signal. For example, the image signal receiving unit 121 is realized by a tuner of a television receiver. The image signal receiving unit 121 may receive the image signal via either a wired line or a wireless line. An image generating unit (not shown) may be present in the image display device 100, and the image signal receiving unit 121 may receive an image signal related to an image generated by the image generating unit. That is, the transmission source of the image signal may be inside the image display device 100 or outside the image display device 100.

[0036] The information detection unit 122 detects image information related to the image signal received by the image signal receiving unit 121. For example, the image signal may contain information about a format such as 4K broadcasting or 8K broadcasting, and the image display device 100 may change the image quality setting to a suitable format. In addition, the image signal may contain information about an optimal frame rate, and the writing and reading of the image signal to the image signal storage unit 130 may be adjusted to the frame rate. Information detected from the image signal is described as image signal information. In this manner, the image signal information is assumed to be various information. In the present disclosure, the image signal information is sent to the control unit 150, and the control unit 150 or a component instructed by the control unit 150 performs processing based on the image signal information. However, the image signal information may be sent directly from the information detection unit 122 to a component that performs processing based on the image signal information.

[0037] Pre-processing unit 123 processes the image signal and then writes the processed image signal to image signal storage unit 130. The processing performed by pre-processing unit 123 is for implementing the processing of image processing unit 141, and is performed before the processing of image processing unit 141. Therefore, this processing is referred to as pre-processing. Note that pre-processing unit 123 may receive the image signal directly from image signal receiving unit 121, or may receive it via information detection unit 122 or the like.

[0038] In order to output an image without disturbance, processing such as writing an image signal by the input processing unit 120 must be completed before processing such as reading an image signal by the output processing unit 140 begins. In this way, processing by the input processing unit 120 that needs to be coordinated with processing related to image output is defined as an input task (first processing). Note that input tasks are not necessarily performed only by the input processing unit 120, and some are performed by the control unit 150. Note that it is assumed that there are multiple input tasks, and when there are multiple input tasks, the multiple input tasks are collectively defined as an input task (first processing). Each of the combined input tasks will be described as a part of the input task.

[0039] The tasks included in the input task vary depending on the situation. For example, if the image signal information indicates that the image format has been changed, a task related to the changed format is executed. The time required for the input task also varies depending on the situation. For example, if an image quality setting that displays images in high quality is set, the processing time for each task increases compared to when an image quality setting is set.

[0040] The image signal storage unit 130 is a memory that holds (captures) the image signal that has been preprocessed by the preprocessing unit 123 on a frame-by-frame basis. The image signal storage unit 130 is generally called a frame memory, a frame buffer, or a VRAM (Video Random Access Memory), but is not limited to these names. The image signal held in the image signal storage unit 130 is read out by the output processing unit 140.

[0041] The output processing unit (second processing unit) 140 reads out the image signal from the image signal storage unit 130, processes the read-out image signal, and then displays the image. An example of components included in the output processing unit 140 will be described below.

[0042] The image processing unit 141 reads out the image signal stored in the image signal storage unit 130, and performs various processes on the image signal. Examples of image processes performed by the image processing unit 141 include I / P (Interlace / Progressive) conversion, zoom display processing, cropping, colorimetry processing, image quality control processing, etc. In addition, a type of image processing, a superimposition process, such as superimposing an OSD (On Screen Display) image on the image signal that has been subjected to image processing, may also be performed.

[0043] The display unit 142 displays an image corresponding to the image signal from the image processing unit 141. The display unit 142 is realized by, for example, a display panel. Although there is a processing delay in the display unit 142, the input image is displayed at the timing when the image signal is input from the image processing unit 141 to the display unit 142.

[0044] In order to output an image without disturbance, processing such as reading an image signal by the output processing unit 140 must be started after processing such as writing an image signal by the input processing unit 120 is completed. In this way, processing by the output processing unit 140 that needs to be coordinated with processing on an input image is defined as an output task (second processing). Note that output tasks are not necessarily performed only by the output processing unit 140, and some are performed by the control unit 150. Note that when there are multiple output tasks, the multiple output tasks are collectively defined as an output task (second processing). Each of the combined output tasks will be described as a part of the output task. In this case, the processing to read out an image signal is at least included in the output task.

[0045] The output task is the vertical sync signal (V sync In other words, the start timing of an output task is based on a signal such as the vertical synchronization signal (V sync ) The start timing of the output task is separated from the scheduled start timing of the input task by a predetermined fixed time. In other words, the scheduled start timing of the output task is set to a timing when a fixed time has elapsed from the scheduled start timing of the input task. This fixed time is referred to as a fixed delay. The length of the fixed delay is determined appropriately taking into consideration the specifications of the image display device 100, the contents of the input task, etc.

[0046] FIG. 2 is a diagram explaining the start timing of an input task and an output task. Blocks A, B, and C are the tasks in the input task. As shown in FIG. 2, the input task is executed periodically every time a period equivalent to one frame elapses. Blocks D and E are the tasks in the output task. The output task is also executed periodically, like the input task. The period between the scheduled start timing of the input task and the scheduled start timing of the output task within the same period corresponds to the fixed delay.

[0047] In Fig. 2, each task in the input task and output task is the same in the next cycle (next frame), but this is not necessarily the case. For example, in a stable state where there is no image quality setting change for some time, only tasks that are performed periodically are performed, so the tasks may be the same as shown in Fig. 2. For example, immediately after changing the image quality setting, a temporary task related to the change is performed, so the tasks may be different.

[0048] Tasks within an input task vary depending on the situation, and the end timing of the input task is not necessarily the same for each cycle. Therefore, the fixed delay is long enough so that the end timing of the input task is not later than the start timing of the output task. This allows images to be output without distortion. On the other hand, responsiveness is reduced because the output task is not started until the fixed delay has elapsed.

[0049] The control unit 150 performs various controls on the other components of the image display device 100. As one of the controls, the control unit 150 determines whether to advance the scheduled start timing of an output task. Advancing the scheduled start timing of an output task means that the output task is executed before its scheduled start timing. The advancement improves the responsiveness of the image display device 100. The components for executing the control related to the advancement are described below.

[0050] The detection unit 151 monitors input tasks and detects the end of the input tasks. If necessary, the detection unit 151 may detect the start of an input task. If necessary, the detection unit 151 may also monitor output tasks and detect the start or end of an output task.

[0051] For example, when the image display device 100 is realized by a computer, the monitoring of the input task and the output task can be realized by using a function of the OS running on the computer. Furthermore, the start or end of a task can be detected by a general method. For example, the detection may be performed based on a specific event when a task starts or ends, or based on the generation or disappearance of a process on the OS corresponding to the task to be monitored.

[0052] Note that the process in which the detection unit 151 detects the end of the input task also corresponds to a task within the input task. Therefore, the timing for detecting the end of the input task is actually performed before the end of the input task. For example, the task for detection is performed in parallel with other tasks or periodically, and the end of a task other than the detection task (the end of task C in FIG. 2) is detected. Then, after the detection is notified to the determination unit 153 or the like, the task for detection ends, and the input task ends.

[0053] The calculation unit 152 calculates the length of the differential time from the detected end timing of the input task to the scheduled start timing of the output task. The scheduled start timing of the output task may be the timing detected by the detection unit 151. Alternatively, the length of the fixed delay or the end timing of the input task, which is determined in advance, may be used.

[0054] The calculation unit 152 may also calculate the time from the scheduled start timing of the input task to the detected end timing of the input task, that is, the required time of the input task.

[0055] The determination unit 153 determines whether or not to advance the scheduled start timing of the output task. This determination is made based on at least the end timing of the input task.

[0056] For example, the determination unit 153 may determine whether to advance the task based on the length of the differential time. For example, if the length of the differential time is equal to or greater than a threshold, it may be determined to advance the task. Alternatively, the determination unit 153 may determine based on the time required for the input task. If the time required for the input task is equal to or less than a threshold, it may determine that the length of the differential time is sufficient and to advance the task. Since the length of the differential time and the required time are calculated based on the end timing of the input task, a determination based on the length of the differential time or the required time can also be said to be a determination based on the end timing of the input task.

[0057] Furthermore, the determination unit 153 may receive a notification of the end of an input task and a notification of the start of an output task from the detection unit 151. If a predetermined time has elapsed between receiving the notification of the end of the input task and receiving the notification of the start of the output task, the determination unit 153 may determine that the difference time is long enough and may decide to move the task forward. In this case, the calculation unit 152 may be omitted because the processing result of the calculation unit 152 is not used.

[0058] Furthermore, the determination unit 153 may determine whether or not to advance the task based on at least one of the operation information from the UI unit 110 and the image signal information from the image signal receiving unit 121. For example, when the determination unit 153 receives an instruction to change the settings from the operation information or the image signal information, the determination unit 153 may determine that the time required for the input task increases with the setting change and determine not to advance the task. Alternatively, a rule may be set in advance that when setting change A is performed, the task is not advanced, but when setting change B is performed, the task may be advanced. When multiple tasks occur, a predetermined value may be added for each of the multiple tasks, and when the sum of the values ​​exceeds a threshold, the task may be determined not to be advanced.

[0059] 3 is a diagram for explaining the advancement of the scheduled start timing of an output task. The length of the differential time is determined by the detection unit 151 detecting the end of the input task. The length of the differential time is the maximum length of time that can be advanced. However, it is possible that an unexpected task occurs in the input task, causing the end of the input task to be delayed more than expected. Therefore, in practice, it is preferable to provide a margin and make the length of time related to the advancement, that is, the length from the start timing of the output task to the scheduled start timing of the output task, shorter than the length of the differential time.

[0060] When it is determined that the task is to be moved forward, the timing determination unit 154 determines the start timing of the output task. When it is determined that the task is to be moved forward, the length of time related to the moving forward may be changed as appropriate. For example, a time shorter than the difference time by a predetermined margin may be determined as the time that can be moved forward. That is, the time when a predetermined margin has passed from the expected end timing of the input task may be determined as the start timing of the output task. In FIG. 3, the output task is moved forward to the time when a predetermined margin has passed from the expected end timing of the input task. Note that the thick black line on the start timing of the output task represents the interruption process of the output. Since the output task is registered and executed at the timing of the output interrupt, the timing of the output interrupt is also moved forward in the same manner as the output task. Therefore, as described above, it is preferable to make the length from the start timing of the output task to the scheduled start timing of the output task shorter than the length of the difference time, but more precisely, it is preferable to make the length from the start timing of the output task to the interruption of the output task shorter than the length of the difference time. Alternatively, the task may be moved forward by a predetermined fixed time. Furthermore, the timing determination section 154 may adjust the length of time related to the advancement based on at least one of the operation information and the image signal information.

[0061] Alternatively, the length of time to be brought forward may be determined based on past performance of bringing forward. For example, if bringing forward was performed in the previous cycle, the time of bringing forward in the current cycle may be shorter than the previous time, and the time of bringing forward may be different for each cycle. Also, if the input task in the current cycle is the same as the input task in the previous cycle, or if the required time of the input task in the current cycle is the same as the required time of the input task in the previous cycle, the length of the advance in the current cycle may be set to the same as the length of the advance in the previous cycle. The start timing of the output task is determined according to the advance time determined in this way.

[0062] 4 is a diagram showing an example of the transition of the end timing of an input task and the start timing of an output task. The horizontal axis indicates the frame (cycle) number, and the vertical axis indicates the elapsed time from the start timing of the input task. The dotted line graph indicates the end timing of the input task. The solid line graph indicates the start timing of the output task.

[0063] At the origin of FIG. 4, various processes are started, and the end timing of the input task is initially slow, but as the number of tasks gradually decreases, the end timing of the input task is advanced. In other words, the graph of the end timing of the input task is initially large, but gradually becomes smaller. The start timing of the output task also gradually becomes earlier due to the advancement. Then, in the stable period of FIG. 4, the output task is started with a delay of a predetermined margin α from the end timing of the input task. Note that here, only registers with settings changes are controlled, and unnecessary tasks are not generated.

[0064] In addition, even if the end timing of the input timing is delayed from the previous cycle, if it is sudden or sufficiently small compared to the margin, the length of the advance may remain the same as the previous cycle. For example, in the stable period shown in FIG. 4, there is a frame in which the end timing of the input task rises for a moment, but the start timing of the corresponding output task remains the same as the previous frame. In this way, even if the required time of the input task in the current cycle is longer than the required time of the input task in the previous cycle, the timing determination unit may make the scheduled start timing of the output task in the current cycle the same as the scheduled start timing of the output task in the previous cycle when a predetermined condition is satisfied. The predetermined condition may be, for example, the difference time of the current cycle, or the processing time of the input task in the current cycle is equal to or less than a predetermined threshold. Alternatively, the difference between the difference time between the current cycle and the previous cycle, or the difference between the required time of the input task in the current cycle and the previous cycle, may be equal to or less than a predetermined threshold.

[0065] The synchronization signal generating unit 160 generates a signal indicating the start timing of the output task determined by the timing determining unit 154, and transmits the signal to the output processing unit 140. This allows the output processing unit 140 to recognize the start timing of the output task whether or not the output task is moved forward. That is, when it is determined that the output task is moved forward, the output processing unit 140 can start the output task before the scheduled start timing of the output task. Also, when it is determined that the output task is not moved forward, the output processing unit 140 can start the output task at the scheduled start timing of the output task.

[0066] Next, the flow of processing by each component will be described. Fig. 5 is a flowchart of an example of adjusting the start timing of an output task. Here, a case is shown in which the scheduled start timing is determined based on the difference time.

[0067] The detection unit 151 detects the end of an input task (S101). After that, the detection unit 151 detects the start of an output task (S102). In response to these detections, the calculation unit 152 calculates a differential time (S103).

[0068] Meanwhile, the control unit 150 receives operation information from the UI unit 110 (S104), and receives image signal information from the information detection unit 122 (S105). Then, the determination unit 153 determines whether or not to advance the schedule based on the difference time, the operation information, the image signal information, and the like (S106).

[0069] If it is determined that the task is to be moved forward (YES in S107), the timing determination unit 154 determines the task start timing to be earlier than the scheduled start timing (S108). If it is determined that the task is not to be moved forward (NO in S107), the timing determination unit 154 determines the task start timing to be the originally scheduled start timing (S109).

[0070] The synchronization signal generating unit 160 generates a synchronization signal indicating the determined task start timing (S110). The synchronization signal is transmitted to the output processing unit 140, and the output processing unit 140 starts the output task based on the synchronization signal (S111). In this manner, the start timing of the output task is adjusted.

[0071] Note that this flowchart is an example, and the advance processing does not necessarily have to be performed according to this flow. For example, in a case where the advance is determined not based on the difference time, the processing of S103 may be omitted. In addition, in a case where the determination unit 153 does not use the operation information or the image signal information, the processing of S104 or S105 may be omitted. In addition, although not shown, the processing results of each process may be sequentially stored in another storage unit different from the image signal storage unit 130, and each component may acquire the processing results via the storage unit.

[0072] Note that there may be a further interrupt output. FIG. 6 is a diagram for explaining the advancement of the scheduled start timing of the output task when there is a further interrupt output. Hereinafter, the further interrupt output is simply referred to as an interrupt output, and the output in FIG. 3 is referred to as a normal output. The interrupt output is performed before the normal output. Therefore, the timing when a first fixed delay has elapsed from the scheduled start timing of the input task is defined as the scheduled start timing of the output task related to the interrupt output. Also, the timing when a second fixed delay has elapsed from the scheduled start timing of the output task related to the interrupt output is defined as the scheduled start timing of the normal output task. Hereinafter, the output task related to the interrupt output is described as an interrupt output task.

[0073] The output of the interrupt may be processed by the output processing unit 140. Alternatively, although not shown, the image display device 100 may include an interrupt output processing unit (third processing unit) that outputs the interrupt, separate from the output processing unit 140.

[0074] The advancement of an interrupt output task is the same as when the interrupt output task is regarded as a normal output task in Fig. 3. On the other hand, the advancement of a normal output task is the same as when the interrupt output task is regarded as an input task. Therefore, when there is an interrupt output, the detection unit 151 of the control unit 150 also monitors the tasks of the output processing unit 140 or the interrupt output processing unit. Note that the advancement of an interrupt output task and the advancement of an output task are performed independently, and it is not necessary for the implementation of advancement and the length of advancement to be the same.

[0075] As described above, according to this embodiment, the image display device 100 capable of performing various processes by software can output high-quality images without distortion, and can improve responsiveness.

[0076] Furthermore, performing complex processing to determine the start timing of processing related to image output places an additional burden on the software, which is undesirable, but the image display device 100 of the present disclosure can determine the start timing of an output task without placing a burden on the software. For example, when calculating the differential time, the end timing of the input task and the start timing of the output task are detected, and these processes can be performed simply by using the functions of the OS running on the computer that realizes the image display device 100. For example, complex processing such as monitoring the image signal line by line and detecting lines on which writing has not been completed is not required. Therefore, the image display device 100 of the present disclosure is also superior in terms of the load on the image display device 100.

[0077] The processing of the device in the embodiment of the present disclosure can be realized by software (programs) executed by a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit), etc. Note that instead of executing all the processing of the device by software, some of the processing may be executed by hardware such as a dedicated circuit.

[0078] The above-described embodiment shows an example for realizing the present disclosure, and the present disclosure can be implemented in various other forms. For example, various modifications, substitutions, omissions, or combinations thereof are possible without departing from the gist of the present disclosure. Such modifications, substitutions, omissions, etc. are also included in the scope of the present disclosure, as well as in the scope of the invention and its equivalents described in the claims.

[0079] The processing steps described in the above embodiments may be regarded as a method having a series of steps. Alternatively, the processing steps may be regarded as a program for causing a computer to execute the series of steps, or as a recording medium for storing the program. The type of recording medium is not particularly limited, since it does not affect the embodiments of the present disclosure.

[0080] The present disclosure can also be configured as follows. [1] a first processing unit that performs a first processing on the image signal; an image signal storage unit that stores the image signal that has been subjected to the first processing; a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit; A detection unit that detects the end of the first process; A determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process; Equipped with The second processing unit starts the second process before the scheduled start timing when it is determined that the process is to be brought forward. Signal processing device. [2] The scheduled start timing of the second process is separated from the scheduled start timing of the first process by a predetermined fixed time, The second processing unit starts the second process at a scheduled start timing of the second process when it is determined not to advance the process. The signal processing device according to [1] above. [3] a calculation unit that calculates a differential time length from an end timing of the first process to a scheduled start timing of the second process Further equipped with The determination unit determines whether or not to advance the schedule based on the length of the difference time. A signal processing device according to the above [1] or [2]. [4] the detection unit detects the end of the first process and the start of the second process and notifies the calculation unit; The calculation unit calculates the length of the differential time based on a notification from the detection unit. The signal processing device according to [3] above. [5] The detection unit detects the end of the first process and notifies the determination unit; The determination unit calculates the length of the differential time based on the detected end timing of the first process and a predetermined scheduled start timing of the second process. The signal processing device according to [3] above. [6] the detection unit detects the end of the first process and the start of the second process and notifies the determination unit; When a predetermined time has elapsed since the determination unit received a notification of the end of the first process or from the end timing of the first process until the determination unit receives a notification of the start of the second process, the determination unit decides to advance the scheduled start timing of the second process. A signal processing device according to the above [1] or [2]. [7] a calculation unit that calculates a length of time required from a start timing of the first process to an end timing of the first process Further equipped with the detection unit detects the start and end of the first process and notifies the calculation unit; The determination unit determines whether or not to advance the scheduled start timing of the second process based on the required time. A signal processing device according to the above [1] or [2]. [8] the detection unit detects the start and end of the first process and notifies the determination unit; When the determination unit receives a notification of the end of the first process before a predetermined time has elapsed since receiving a notification of the start of the first process, the determination unit determines to advance the scheduled start timing of the second process. A signal processing device according to the above [1] or [2]. [9] a timing determination unit that determines a start timing of the second process; Further equipped with The second processing unit starts the second processing at the determined start timing. A signal processing device according to any one of [1] to [8] above.

[10] The timing determination unit determines the start timing of the second process between a timing when a predetermined time has elapsed from the scheduled start timing of the first process and the scheduled start timing of the second process. The signal processing device according to [9] above.

[11] A synchronization signal generating unit that generates a synchronization signal indicating the determined start timing, The second processing unit starts the second process or a task related to the second processing unit based on the synchronization signal. A signal processing device according to any one of [9] or

[10] above.

[12] an information detection unit that detects, from the image signal, image signal information used when displaying an image based on the image signal; Further equipped with The determination unit determines whether or not to advance the scheduled start timing of the second process based on the image signal information. A signal processing device according to any one of [1] to

[11] above.

[13] a user interface unit that generates or receives operation information regarding an operation performed on the signal processing device; Further equipped with The determination unit determines whether or not to advance the scheduled start timing of the second process based on the operation information. A signal processing device according to any one of [1] to

[12] above.

[14] When a processing time of a current cycle of the first process is longer than a processing time of a previous cycle of the first process, if a predetermined condition is satisfied, the timing determination unit sets a scheduled start timing of the current cycle of the second process to be the same as a scheduled start timing of the previous cycle of the second process. A signal processing device according to any one of [1] to

[13] above.

[15] a third processing unit that performs a third processing including at least a processing of reading out the stored image signal from the image signal storage unit after the second processing; Further equipped with The detection unit detects the end of the second process, The determination unit determines whether or not to advance the scheduled start timing of the third process based on at least the end timing of the second process; The third processing unit starts the third processing before the scheduled start timing of the third processing when it is determined that the scheduled start timing of the third processing is brought forward. A signal processing device according to any one of [1] to

[14] above.

[16] a first processing unit that performs a first processing on the image signal; an image signal storage unit that stores the image signal that has been subjected to the first processing; a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit; a display unit that displays the image signal that has been subjected to the second processing; A detection unit that detects the end of the first process; A determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process; Equipped with The second processing unit starts the second process before the scheduled start timing when it is determined that the process is to be brought forward. Image display device.

[17] detecting an end of a first processing performed on the image signal; determining whether or not to advance a scheduled start timing of a second process, the second process including at least a process of reading out an image signal stored in an image signal storage unit that stores the image signal on which the first process has been performed, based on at least a timing of the end of the first process; When it is determined that the operation is to be brought forward, starting the second process before the scheduled start timing; A signal processing method comprising: [Explanation of symbols]

[0081] 100 Image display device 110 UI section 120 Input processing section (first processing section) 121 Image signal receiving unit 122 Information detection unit 123 Pretreatment section 130 Image signal storage unit 140 Output processing section (second processing section) 141 Image processing section 142 Display section 150 Control section 151 Detection unit 152 Calculation section 153 Judgment section 154 Timing decision unit 160 Synchronization signal generator

Claims

1. a first processing unit that performs a first processing on the image signal; an image signal storage unit that stores the image signal that has been subjected to the first processing; a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit; A detection unit that detects the end of the first process; a determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process; Equipped with the second processing unit, when it is determined that the processing is to be brought forward, starts the second processing prior to the scheduled start timing; the detection unit detects the end of the first process and the start of the second process and notifies the determination unit; When a predetermined time has elapsed from when the determination unit receives a notification of the end of the first process to when the determination unit receives a notification of the start of the second process, the determination unit determines to advance the scheduled start timing of the second process. Signal processing device.

2. a first processing unit that performs a first processing on the image signal; an image signal storage unit that stores the image signal that has been subjected to the first processing; a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit; A detection unit that detects the end of the first process; a determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process; Equipped with the second processing unit, when it is determined that the processing is to be brought forward, starts the second processing prior to the scheduled start timing; a calculation unit that calculates a length of time required from a start timing of the first process to an end timing of the first process Further equipped with the detection unit detects the start and end of the first process and notifies the calculation unit; The determination unit determines whether or not to advance the scheduled start timing of the second process based on the required time. Signal processing device.

3. a first processing unit that performs a first processing on the image signal; an image signal storage unit that stores the image signal that has been subjected to the first processing; a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit; A detection unit that detects the end of the first process; a determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process; Equipped with the second processing unit, when it is determined that the processing is to be brought forward, starts the second processing prior to the scheduled start timing; the detection unit detects the start and end of the first process and notifies the determination unit; When the determination unit receives a notification of the end of the first process before a predetermined time has elapsed since receiving a notification of the start of the first process, the determination unit determines to advance the scheduled start timing of the second process. Signal processing device.

4. a first processing unit that performs a first processing on the image signal; an image signal storage unit that stores the image signal that has been subjected to the first processing; a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit; A detection unit that detects the end of the first process; a determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process; Equipped with the second processing unit, when it is determined that the processing is to be brought forward, starts the second processing prior to the scheduled start timing; a timing determination unit that determines a start timing of the second process; Further equipped with The second processing unit starts the second process at the determined start timing; The timing determination unit determines the start timing of the second process between a timing when a predetermined time has elapsed from the scheduled start timing of the first process and the scheduled start timing of the second process. Signal processing device.

5. a first processing unit that performs a first processing on the image signal; an image signal storage unit that stores the image signal that has been subjected to the first processing; a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit; A detection unit that detects the end of the first process; a determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process; Equipped with the second processing unit, when it is determined that the processing is to be brought forward, starts the second processing prior to the scheduled start timing; an information detection unit that detects, from the image signal, image signal information used when displaying an image based on the image signal; Further equipped with The determination unit determines whether or not to advance the scheduled start timing of the second process based on the image signal information. Signal processing device.

6. 1. A signal processing device, comprising: a first processing unit that performs a first processing on the image signal; an image signal storage unit that stores the image signal that has been subjected to the first processing; a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit; A detection unit that detects the end of the first process; a determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process; Equipped with the second processing unit, when it is determined that the processing is to be brought forward, starts the second processing prior to the scheduled start timing; a user interface unit that generates or receives operation information regarding an operation performed on the signal processing device; Further equipped with The determination unit determines whether or not to advance the scheduled start timing of the second process based on the operation information. Signal processing device.

7. a first processing unit that performs a first processing on the image signal; an image signal storage unit that stores the image signal that has been subjected to the first processing; a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit; A detection unit that detects the end of the first process; a determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process; Equipped with the second processing unit, when it is determined that the processing is to be brought forward, starts the second processing prior to the scheduled start timing; a timing determination unit that determines a start timing of the second process; Further equipped with The second processing unit starts the second process at the determined start timing; When a processing time of the current cycle of the first process is longer than a processing time of the previous cycle of the first process, if a predetermined condition is satisfied, the timing determination unit sets a scheduled start timing of the current cycle of the second process to be the same as a scheduled start timing of the previous cycle of the second process. Signal processing device.

8. a first processing unit that performs a first processing on the image signal; an image signal storage unit that stores the image signal that has been subjected to the first processing; a second processing unit that performs a second process including at least a process of reading out the image signal stored in the image signal storage unit; A detection unit that detects the end of the first process; a determination unit that determines whether or not to advance a scheduled start timing of the second process based on at least an end timing of the first process; Equipped with the second processing unit, when it is determined that the processing is to be brought forward, starts the second processing prior to the scheduled start timing; a third processing unit that performs a third processing including at least a processing of reading out the stored image signal from the image signal storage unit after the second processing; Further equipped with The detection unit detects the end of the second process, The determination unit determines whether or not to advance the scheduled start timing of the third process based on at least the end timing of the second process, The third processing unit starts the third processing before the scheduled start timing of the third processing when it is determined that the scheduled start timing of the third processing is brought forward. Signal processing device.

9. the scheduled start timing of the second process is separated from the scheduled start timing of the first process by a predetermined fixed time, The second processing unit starts the second process at a scheduled start timing of the second process when it is determined not to advance the process. The signal processing device according to any one of claims 1 to 8.

10. a calculation unit that calculates a difference in time from the end timing of the first process to the scheduled start timing of the second process; Further equipped with The determination unit determines whether or not to advance the schedule based on the length of the difference time. The signal processing device according to any one of claims 1 to 9.

11. A signal processing device according to any one of claims 1 to 10; a display unit that displays the image signal that has been subjected to the second processing; Equipped with Image display device.

12. detecting an end of a first processing performed on the image signal; determining whether or not to advance a scheduled start timing of a second process, the second process including at least a process of reading out an image signal stored in an image signal storage unit that stores the image signal on which the first process has been performed, based on at least a timing at which the first process has been completed; When it is determined that the operation is to be brought forward, starting the second process before the scheduled start timing; The signal processing device executes the above. The detecting step detects an end of the first process and a start of the second process, The determining step determines to advance the scheduled start timing of the second process when a predetermined time has elapsed from when the end of the first process is detected to when the start of the second process is detected. Signal processing methods.

13. detecting an end of a first processing performed on the image signal; determining whether or not to advance a scheduled start timing of a second process, the second process including at least a process of reading out an image signal stored in an image signal storage unit that stores the image signal on which the first process has been performed, based on at least a timing at which the first process has been completed; When it is determined that the operation is to be brought forward, starting the second process before the scheduled start timing; The signal processing device executes the above. the detecting step detects the start and end of the first process; The signal processing device further executes a step of calculating a length of time required from a start timing of the first process to a finish timing of the first process; The step of determining whether or not to advance the scheduled start timing of the second process based on the required time. Signal processing methods.

14. detecting an end of a first processing performed on the image signal; determining whether or not to advance a scheduled start timing of a second process, the second process including at least a process of reading out an image signal stored in an image signal storage unit that stores the image signal on which the first process has been performed, based on at least a timing at which the first process has been completed; When it is determined that the operation is to be brought forward, starting the second process before the scheduled start timing; The signal processing device executes the above. the detecting step detects the start and end of the first process; When the end of the first process is detected before a predetermined time has elapsed since the start of the first process is detected, the determining step determines to advance the scheduled start timing of the second process. Signal processing methods.

15. detecting an end of a first processing performed on the image signal; determining whether or not to advance a scheduled start timing of a second process, the second process including at least a process of reading out an image signal stored in an image signal storage unit that stores the image signal on which the first process has been performed, based on at least a timing at which the first process has been completed; When it is determined that the operation is to be brought forward, starting the second process before the scheduled start timing; The signal processing device executes the above. determining a start timing of the second process; The signal processing device further executes the starting step starts the second process at the determined start timing; The step of determining the start timing determines the start timing of the second process between a timing when a predetermined time has elapsed from the scheduled start timing of the first process and the scheduled start timing of the second process. Signal processing methods.

16. detecting an end of a first processing performed on the image signal; determining whether or not to advance a scheduled start timing of a second process, the second process including at least a process of reading out an image signal stored in an image signal storage unit that stores the image signal on which the first process has been performed, based on at least a timing at which the first process has been completed; When it is determined that the operation is to be brought forward, starting the second process before the scheduled start timing; The signal processing device executes the above. detecting image signal information from the image signal for use in displaying an image based on the image signal; The signal processing device further executes The determining step determines whether or not to advance the scheduled start timing of the second process based on the image signal information. Signal processing methods.

17. detecting an end of a first processing performed on the image signal; determining whether or not to advance a scheduled start timing of a second process, the second process including at least a process of reading out an image signal stored in an image signal storage unit that stores the image signal on which the first process has been performed, based on at least a timing at which the first process has been completed; When it is determined that the operation is to be brought forward, starting the second process before the scheduled start timing; The signal processing device executes the above. The determining step determines whether or not to advance the scheduled start timing of the second process based on operation information generated or received by a user interface unit that generates or receives the operation information. Signal processing methods.

18. detecting an end of a first processing performed on the image signal; determining whether or not to advance a scheduled start timing of a second process, the second process including at least a process of reading out an image signal stored in an image signal storage unit that stores the image signal on which the first process has been performed, based on at least a timing at which the first process has been completed; When it is determined that the operation is to be brought forward, starting the second process before the scheduled start timing; The signal processing device executes the above. determining a start timing of the second process; The signal processing device further executes The step of starting the second process includes starting the second process at a determined start timing; The step of determining the start timing includes, when a processing time of the current cycle of the first process is longer than a processing time of the previous cycle of the first process, and if a predetermined condition is satisfied, setting a scheduled start timing of the current cycle of the second process to be the same as a scheduled start timing of the previous cycle of the second process. Signal processing methods.

19. detecting an end of a first processing performed on the image signal; determining whether or not to advance a scheduled start timing of a second process, the second process including at least a process of reading out an image signal stored in an image signal storage unit that stores the image signal on which the first process has been performed, based on at least a timing at which the first process has been completed; When it is determined that the operation is to be brought forward, starting the second process before the scheduled start timing; The signal processing device executes the above. A step of performing a third process including at least a process of reading out the image signal stored in the image signal storage unit after the second process. The signal processing device further executes the step of detecting detects an end of the second process, The step of determining whether or not to advance a scheduled start timing of the third process based on at least an end timing of the second process, The step of performing the third process includes starting the third process before a scheduled start timing of the third process when it is determined that the scheduled start timing of the third process is brought forward. Signal processing methods.

Images