Image capture device with variable refresh rate signal processing capability and image processing method thereof

Abstract

This invention provides an image capturing device and an image processing method thereof. The image processing method includes the following steps: First, a receiving unit receives an image signal source, wherein the image signal source has a plurality of image frames and their corresponding plurality of image information or corresponding plurality of variable refresh rate associated information. Next, it is determined whether the image signal source is a variable refresh rate signal, and a determination result is generated. When the determination result is positive, a timestamp corresponding to each image frame is generated based on the variable refresh rate associated information, wherein each timestamp corresponds to a dynamic frame interval. Next, each image frame is converted into a corresponding output packet. Finally, each output packet is integrated with its corresponding timestamp to generate a dynamic frame interval output packet.

Description

Image capturing device and image processing method with variable refresh rate signal processing capability This invention relates to an electronic device and its image processing method, and more particularly to an image capturing device and its image processing method. High-quality and high-resolution images are highly sought after by modern users, especially gamers. To achieve better image quality, increasing the refresh rate is a common approach, such as using a 144Hz or 240Hz refresh rate system (including monitors, CPUs, and GPUs). However, maintaining a high refresh rate for extended periods increases system power consumption and reduces hardware performance. Therefore, variable refresh rate (VRR) technology is one method used to address these issues. VRR (Dynamic Refresh Rate) technology uses a higher refresh rate for dynamic images requiring high detail and a lower refresh rate for static images. However, if either the input or output of the system cannot perform the calculations required by VRR technology, it will result in image loss or choppy display. In addition, gamers often use video capture devices to capture or record streaming video. Video capture devices, such as video capture cards, are electronic devices that capture consecutive digital still frames from analog video signals or digital video streams. The frames are captured in digital form, and the resulting digital signal is displayed, stored, or transmitted to other devices directly or after compression. However, because current video capture devices cannot handle VRR signals, the traditional approach is to discard excess frames or pad insufficient frames based on the existing refresh rate setting of the video capture device. In other words, after passing through the video capture device, only a signal with a fixed refresh rate can be output. This defeats the purpose of using VRR technology, and discarding or padding frames also leads to choppy display. Therefore, providing an image capturing device and its image processing method with variable refresh rate signal processing capability is one of the important current research topics. One objective of this invention is to provide an image capturing device and an image processing method thereof, which can select the corresponding image processing mode according to whether the image signal source is a variable refresh rate signal. To achieve the above objectives, an image processing method of an image capturing device according to the present invention includes the following steps. First, a receiving unit receives an image signal source, wherein the image signal source has a plurality of image frames and their corresponding plurality of image information or corresponding plurality of variable refresh rate associated information. Next, it is determined whether the image signal source is a variable refresh rate signal, and a determination result is generated. When the determination result is positive, a timestamp corresponding to each image frame is generated based on the variable refresh rate associated information, wherein these timestamps correspond to a dynamic frame interval. When the determination result is negative, a timestamp corresponding to each image frame is generated based on the image information, wherein these timestamps correspond to a fixed frame interval. Next, these image frames are converted into corresponding output packets. Finally, these output packets are integrated with their corresponding timestamps to generate a dynamic frame interval output packet or a fixed frame interval output packet. In one embodiment, before determining whether the image signal source is a variable refresh rate signal, the method further includes detecting whether the receiving unit has the capability to detect a variable refresh rate setting parameter. When the receiving unit does not have the capability to detect the variable refresh rate setting parameter, the variable refresh rate related information in the image signal source is collected. In one embodiment, the variable refresh rate associated information includes resolution information, frame output frequency, image width information, image height information, and clock frequency information. In one embodiment, the step of detecting whether the receiving unit has the ability to detect variable refresh rate setting parameters involves simultaneously or sequentially detecting whether the receiving unit can detect an HDMI variable refresh rate signal, a FreeSync variable refresh rate signal, and / or a G-Sync variable refresh rate signal. In one embodiment, the output packet is a USB-compliant packet. In one embodiment, the image processing method further includes the following steps: First, while outputting packets within a dynamic frame interval or a fixed frame interval, the image signal source received by the receiving unit is simultaneously monitored. Next, it is determined whether the image signal source exists. If the image signal source does not exist, a fixed frame interval is used. If another image signal source exists, it is determined whether the image signal source has changed. If the determination result is no change, the monitoring of other image signal sources received by the receiving unit continues. If the determination result is a change, it is further determined whether the image signal source is a variable refresh rate signal. In one embodiment, the dynamic frame interval output packet or the fixed frame interval output packet is output to an electronic device. Before the step of converting these image frames into corresponding output packets, the method further includes determining whether the settings of the electronic device can achieve the best image smoothness, and when the determination result is negative, the electronic device prompts the best setting value. In addition, to achieve the above objectives, the present invention provides another image processing method for an image capturing device, which includes the following steps. First, a receiving unit receives an image signal source, the image signal source having a plurality of image frames and their corresponding plurality of variable refresh rate associated information. Next, when the image signal source is a variable refresh rate signal, a timestamp corresponding to each image frame is generated based on the variable refresh rate associated information, and these timestamps respectively correspond to a dynamic frame interval. Next, these image frames are converted into corresponding output packets. Finally, these output packets are integrated with their corresponding timestamps to generate a dynamic frame interval output packet. In one embodiment, the image signal source further has corresponding multiple image information, and the image processing method further includes the following steps. When the image signal source is not a variable refresh rate signal, the timestamp corresponding to each image frame is generated based on the image information, and the timestamps correspond to a fixed frame interval. Furthermore, after converting the image frames into corresponding output packets, a fixed frame interval output packet is generated. In addition, to achieve the above objectives, the present invention also provides an image capturing device, comprising a receiving unit, an image processing unit, a computing unit, and a transmission processing unit. The receiving unit receives an image signal source having a plurality of image frames and their corresponding plurality of image information or corresponding plurality of variable refresh rate associated information. The image processing unit is coupled to the receiving unit to receive the image signal source, determine whether the image signal source is a variable refresh rate signal, and output a determination result and the image signal source. The computing unit is coupled to the image processing unit to receive the determination result and the image signal source, and processes the image signal source according to the determination result. When the determination result is affirmative, the computing unit generates a timestamp corresponding to each image frame based on the variable refresh rate associated information, and these timestamps correspond to a dynamic frame interval. When the determination result is negative, the computing unit generates the timestamp corresponding to each image frame based on the image information, and these timestamps correspond to a fixed frame interval. The transmission processing unit is coupled to the computing unit and converts the image frames into corresponding output packets. Then, it integrates these output packets with their corresponding timestamps to generate a dynamic frame interval output packet or a fixed frame interval output packet. In one embodiment, the timestamps are calculated based on resolution information, clock frequency information, and / or counter value information of one of the image signal sources. 10: Image capturing device 11: Receiving Unit 111: Receiver Module 112: Detection Module 12: Image Processing Unit 121: Collection Module 122: Detect Module 13: Computing Unit 131: Timestamp Generation Module 14: Transmission Processing Unit 141: Conversion Module 142: Marking Module 143: Output Module 15: Monitoring Unit 20: Image signal source 30: Electronic devices S21: Image frame S22: Image Information S23: Variable Refresh Rate Related Information S24: Dynamic frame interval output packet S25: Fixed frame interval output packet F1B, F2B, F3B: Drawing frame C1B, C2B, C3B: Count values CT1, CT2: Counting interval S101~S116, S1011~S1015, S1021~S1023: Steps S1021a~S1023a, S1161~S1163: Steps [Figure 1] is a block diagram of an image capturing device according to a preferred embodiment of the present invention. [Figure 2] is a flowchart of an image processing method of an image capturing device with variable refresh rate signal processing capability according to a first preferred embodiment of the present invention. [Figure 3] is a schematic diagram showing the correspondence between the image frame and the count value. [Figure 4] is a partial flowchart of an image processing method of an image capturing apparatus with variable refresh rate signal processing capability according to a second preferred embodiment of the present invention. [Figure 5] is a partial flowchart of an image processing method of an image capturing apparatus with variable refresh rate signal processing capability according to a third preferred embodiment of the present invention. [Figure 6] is a partial flowchart of an image processing method of an image capturing apparatus with variable refresh rate signal processing capability according to a third preferred embodiment of the present invention. [Figure 7] is a partial flowchart of an image processing method of an image capturing apparatus with variable refresh rate signal processing capability according to a fourth preferred embodiment of the present invention. To enable those skilled in the art to understand the content of this invention and to implement it accordingly, the following description is provided in conjunction with preferred embodiments and drawings. The term "coupled" as used in this article can refer to two or more components or devices making direct physical contact with each other, or making indirect physical contact with each other, or two or more components or devices operating or acting with each other, or electrical (electrical or electrical signal) connections being made directly or indirectly. Referring to Figure 1, in a preferred embodiment of the present invention, an image capturing device 10 is coupled to an image signal source 20 and an electronic device 30, respectively, and outputs the processed image signal source 20 to the electronic device 30. The image signal source 20 can be a digital image signal output by any device, and it can output an image signal with a fixed refresh rate and / or a variable refresh rate. In addition, the image signal source 20 has a plurality of image frames S21 and corresponding plurality of image information S22 or plurality of variable refresh rate associated information S23. The so-called image information S22 may include, but is not limited to, metadata or Infoframes, wherein the metadata may include, for example, VTEM (Video Timing Extended Metadata), and the Infoframes may include, for example, SPD Infoframes. The variable refresh rate associated information S23 may include, but is not limited to, resolution information, Infoframe output frequency, image width information, image height information, and pixel clock information. It should be noted that the image information S22 and the variable refresh rate associated information S23 may include some of the same information, such as metadata or resolution information. The electronic device 30 includes, but is not limited to, display devices, audio / video recording devices, or computers, any device capable of processing or playing images. Additionally, it is worth mentioning that the aforementioned variable refresh rate video signals can originate from the same signal source. The corresponding screen scenarios are, for example, firstly, using a higher refresh rate for high-resolution dynamic video and a lower refresh rate for static video; secondly, using different refresh rates for different scenes or page selections in the game, such as using a lower refresh rate for the game menu screen and a higher refresh rate for the game screen. The image capturing device 10 is, for example, an image capturing card or an image capturing box, which includes a receiving unit 11, an image processing unit 12, a computing unit 13, a transmission processing unit 14, and a monitoring unit 15. The receiving unit 11 has a receiving module 111 and a detection module 112 that are coupled to each other, and is also coupled to the image signal source 20, the image processing unit 12, the computing unit 13, and the monitoring unit 15, respectively. The receiving unit 11 outputs the image frame S21, image information S22, and / or variable refresh rate associated information S23 of the image signal source 20 to each relevant unit. The image processing unit 12 has a collection module 121 and a judgment module 122 that are coupled to each other. The image processing unit 12 performs the necessary processing on the image signal source 20 before outputting it. The computing unit 13 has a timestamp generation module 131. The computing unit 13 is coupled to the receiving unit 11, the image processing unit 12 and the monitoring unit 15 respectively to receive relevant data (including raw data and processed data) of the image signal source 20, and output the image signal source 20 and its relevant data to the transmission processing unit 14 after calculation. The transmission processing unit 14 has a conversion module 141, a marking module 142, and an output module 143 coupled together. The transmission processing unit 14 is coupled to the electronic device 30 to convert the processed image signal source 20 into a dynamic frame interval output packet S24 or a fixed frame interval output packet S25, and output it to the electronic device 30. Please refer to Figures 1 and 2 below to illustrate the image processing method of the image capturing device with variable refresh rate signal processing capability according to the first preferred embodiment of the present invention. As shown in Figure 2, the image processing method includes steps S101 to S111. Step S101 involves the receiving module 111 of the receiving unit 11 receiving the image signal source 20, which includes the image frame S21, image information S22, and variable refresh rate association information S23. Step S102 involves the detection module 112 of the receiving unit 11 detecting whether the receiving unit 11 has the ability to detect a variable refresh rate setting parameter. If the receiving unit 11 does not have the ability to detect a variable refresh rate setting parameter, step S103 is executed; if the receiving unit 11 has the ability to detect a variable refresh rate setting parameter, step S104 is executed. Step S103 enables the image processing unit 12's collection module 121 to collect the variable refresh rate associated information S23 from the image signal source 20. The variable refresh rate signal is characterized by potential changes in resolution, frame rate output frequency, image width, image height, and pixel clock speed; therefore, the variable refresh rate associated information S23 can be used as a basis for judgment. In this embodiment, the detection module 112 enables the collection module 121. In other embodiments, the detection module 112 can also notify other modules, such as the control module, to execute the enabling procedure. Step S104 involves the judgment module 122 of the image processing unit 12 determining whether the image signal source 20 is a variable refresh rate signal. If the judgment result is negative, i.e., the image signal source 20 is not a variable refresh rate signal, step S105 is executed; if the judgment result is positive, i.e., the image signal source 20 is a variable refresh rate signal, step S106 is executed. Further explanation: when the image signal source 20 is a variable refresh rate signal, and the receiving unit 11 has the ability to detect variable refresh rate setting parameters, the receiving unit 11 can directly transmit one of the timestamps corresponding to each image frame S21 in the image signal source 20 to the calculation unit 13. In addition, when the image signal source 20 is a variable refresh rate signal and the receiving unit 11 does not have the ability to detect the variable refresh rate setting parameters, the judgment module 122 can determine whether the image signal source 20 is a variable refresh rate signal based on the variable refresh rate association information S23 of the image signal source 20 (collected by the collection module 121). Step S105 involves the timestamp generation module 131 of the calculation unit 13 generating timestamps corresponding to each image frame S21 based on the image information S22. These timestamps correspond to a fixed frame interval. Further explanation: when a new image frame is input to the image capturing device 10, an interrupt signal (interval) can be sent or polling can be used to confirm that the receiving unit 11 has received the new image frame and record the image information S22. After calculation, the timestamp corresponding to the image frame S21 can be obtained. Here, assuming that device 10 claims a clock frequency of 100MHz and a resolution of 1080p60, the generation of timestamps (timestamp P1A, timestamp P2A, and timestamp P3A) for three corresponding image frames (frame F1A, frame F2A, and frame F3A) is illustrated as follows: interval=100000000(Hz) / 60=1666666; Timestamp P1A = 0 + interval = 1666666; Timestamp P2A = Timestamp P1A + interval = 3333332; Timestamp P3A = Timestamp P2A + interval = 4999998. Therefore, the timestamps of frame F1A, frame F2A and frame F3A correspond to a fixed frame interval and are 1666666. Step S106 involves the timestamp generation module 131 of the calculation unit 13 generating timestamps corresponding to each image frame S21 based on the variable refresh rate association information S23. These timestamps correspond to a dynamic frame interval. Further explanation: when the calculation unit 13 has received the timestamps corresponding to each image frame S21, it can directly obtain the timestamp corresponding to that image frame S21. Additionally, when a new image frame is input to the image capturing device 10, an interrupt signal can be issued or the receiving unit 11 can be polled to confirm receipt of the new image frame and record its image information, such as a counter value. After calculation, the timestamp corresponding to that image frame can be obtained. Next, referring to Figure 3, assuming that the clock frequency of device 10 is claimed to be 100MHz, and the counter counts 150 times (counts) as 1 microsecond (us), the following explanation is given as an example of generating timestamps (timestamp P1B, timestamp P2B, and timestamp P3B) for the three image frames (frame F1B, frame F2B, and frame F3B) in Hz units: When frame F1B, frame F2B, and frame F3B are received sequentially, count values ​​C1B, C2B, and C3B can be obtained respectively. As shown in Figure 3, the counting interval CT1 between count values ​​C1B and C2B is 1,250,000 counts, while the counting interval CT2 between count values ​​C2B and C3B is 2,500,000 counts. Counting interval CT1 = C2B - C1B = 1250000; interval 1B=(1250000 / 150)(us)x 100(Hz)=833333; Timestamp P1B = 0 + interval 1B = 833333; Counting interval CT2 = C3B - C2B = 2500000; interval 2B=(2500000 / 150)(us)x 100(Hz)=1666666; Timestamp P2B = Timestamp P1B + interval 2B = 2499999. Based on this, the timestamps of frame F1B and frame F2B can be obtained, while the timestamp of frame F3B must be calculated by combining it with the image information of the next frame. Next, returning to Figures 1 and 2, step S107 involves the conversion module 141 of the transmission processing unit 14 converting the image frames S21 into corresponding output packets. These image frames can be image information conforming to formats such as RGB, NV12, YUY12, P010, H.264, H.265, and MJPEG. Furthermore, the output packets conform to USB specifications or network transmission specifications. Next, in step S108, the marking module 142 of the transmission processing unit 14 integrates these output packets with their corresponding timestamps to generate a dynamic frame interval output packet S24 or a fixed frame interval output packet S25, which is then output by the output module 143. In short, when the image frames S21 and their corresponding timestamps are generated in step S105, a fixed frame interval output packet S25 will be generated after integration; and when the image frames S21 and their corresponding timestamps are generated in step S106, a dynamic frame interval output packet S24 will be generated after integration. Next, in step S109, when outputting the dynamic frame interval output packet S24 or the fixed frame interval output packet S25, the monitoring unit 15 simultaneously monitors the image signal source received by the receiving unit 11. It is worth noting that the monitoring unit 15 simultaneously monitors image signals in the image signal source that have a time difference from the previously processed image signals, rather than referring to the same image signal. Step S110 involves the monitoring unit 15 determining whether another image signal source exists. If the other image signal source does not exist, the process returns to step S105; if the other image signal source exists, step S111 is executed. In the case where the other image signal source does not exist, for example, due to signal interruption, a fixed frame interval can be used to output an image with "no signal". Step S111 determines whether the other image signal source has changed compared to the image signal source 20. Here, "change" refers to, for example, a change in image information (e.g., resolution, width, height) between the previous and current image signal sources. If the previous and current image signal sources have not changed, the process returns to step S109; if the previous and current image signal sources have changed, step S104 is executed again. It is worth mentioning that another implementation of the image processing method of the first preferred embodiment is that the image capturing device 10 can directly determine whether the image signal source is a variable refresh rate signal. Therefore, the determination step S104 can be omitted. At the same time, when the image signal source is a variable refresh rate signal, step S105 can also be omitted and only step S106, which generates dynamic interval frame data and its subsequent related steps, can be executed. Next, please refer to Figures 1, 2, and 4 to illustrate the image processing method of the image capturing apparatus with variable refresh rate signal processing capability according to the second preferred embodiment of the present invention. As shown in Figure 4, the difference from the first preferred embodiment is that the second preferred embodiment adds steps S112 and S113 before step S107. To avoid redundancy, the same steps as described above will not be repeated. Step S112 determines whether the settings of the electronic device 30 can display optimal image smoothness. If the settings of the electronic device 30 are optimal image smoothness, step S107 is executed; if the settings of the electronic device 30 are not optimal image smoothness, step S113 is executed. For example, if the image signal source 20 is 1080p120, and the dynamic frame interval output packet or fixed frame interval output packet output by the transmission processing unit 14 is 1080p60, then 50% of the frames may need to be discarded, which will affect the image smoothness. Step S113 involves the electronic device 30 displaying the optimal setting value, followed by step S107. Here, for example, the electronic device 30 displays a suggested optimal setting value of 1080p120 to conform to the specifications of the image signal source 20. Next, please refer to Figures 1, 2, 5, and 6 simultaneously to illustrate the image processing method of the image capturing apparatus with variable refresh rate signal processing capability according to the third preferred embodiment of the present invention. The difference between the third preferred embodiment and the second preferred embodiment is that the third preferred embodiment further explains steps S101 and S102, and adds steps S114 and S115. To avoid redundancy, steps identical to those described above will not be repeated. As shown in Figure 5, the receiving of the image signal source in step S101 also includes steps S1011 to S1015. Step S1011 announces the variable refresh rate signals supported by the image capturing device 10. In this embodiment, the image capturing device 10 announces the types of variable refresh rate signals and frame rate ranges supported by the receiving unit 11 through Extended display identification data (EDID) or Display Identification Data (DisplayID). Step S1012 involves connecting the image signal source. This means connecting the device providing the image signal source 20 to the image capturing device 10. In this embodiment, the connection interface may include, but is not limited to, USB, HDMI, or a DisplayPort. Next, steps S1013 to S1015 can be executed simultaneously. Step S1013 involves the source end outputting an HDMI variable refresh rate signal. Step S1014 involves the source end outputting a FreeSync variable refresh rate signal. Step S1015 involves the source end outputting a G-Sync variable refresh rate signal. In addition, step S102 also includes steps S1021 to S1023, wherein step S1021 is executed immediately after step S1013, step S1022 is executed immediately after step S1014, and step S1023 is executed immediately after step S1015. Step S1021 determines whether the receiving unit 11 can detect the HDMI variable refresh rate signal. If the determination result is positive, step S104 is executed; if the determination result is negative, step S103 is executed. Step S1022 determines whether the receiving unit 11 can detect the FreeSync variable refresh rate signal. If the determination result is positive, step S104 is executed; if the determination result is negative, step S103 is executed. Step S1023 determines whether the receiving unit 11 can detect the G-Sync variable refresh rate signal. If the determination result is positive, step S104 is executed; if the determination result is negative, step S103 is executed. Next, as shown in Figure 6, step S114 is added after step S104. Step S114 involves the electronic device 30 initiating the streaming. In this embodiment, the connection interface between the image capturing device 10 and the electronic device 30 is a USB interface, and the electronic device 30 initiates the USB streaming. Next, after performing step S105 to generate fixed-range frame data or performing step S106 to generate dynamic-range frame data according to the type of image signal source 20, step S115 is then performed. In Figure 6, for illustrative purposes, the same step S115 is divided into two blocks to illustrate the processing of image signal sources with fixed-range frame data or dynamic-range frame data respectively. Step S115 processes the image signal source 20 according to the settings of the electronic device 30. In this embodiment, the processing includes, but is not limited to, performing frame rate conversion (FRC) or image scaling on the image signal source 20. In the example of fixed-range frame data, after processing the image signal, step S115 proceeds to step S107. In the example of dynamic-range frame data, after processing the image signal, step S115 proceeds to step S112. Step S112 is as described in the second preferred embodiment and will not be repeated here. Next, please refer to Figures 1, 2, and 7 simultaneously to illustrate the image processing method of the image capturing apparatus with variable refresh rate signal processing capability according to the fourth preferred embodiment of the present invention. As shown in Figure 7, the difference from the first preferred embodiment is that the fourth preferred embodiment further explains steps S101 and S102, and adds step S116 after step S102. To avoid redundancy, the same steps as described above will not be repeated. Step S101 includes the aforementioned steps S1011 and S1012. Step S1011 declares the variable refresh rate signal supported by the image capturing device 10. Step S1012 connects the image signal source, which connects the image capturing device 10 to the source end, and after connection, the source end outputs the image signal source according to the declaration. Step S102 further includes steps S1021a to S1023a. In this embodiment, steps S1021a to S1023a are executed sequentially. Step S1021a determines whether the receiving unit 11 can detect the HDMI variable refresh rate signal. If the determination result is positive, step S1161 is executed; if the determination result is negative, step S1022a is executed. Step S1022a determines whether the receiving unit 11 can detect the FreeSync variable refresh rate signal. If the determination result is positive, step S1162 is executed; if the determination result is negative, step S1023a is executed. Step S1023a determines whether the receiving unit 11 can detect the G-Sync variable refresh rate signal. If the determination result is positive, step S1163 is executed; if the determination result is negative, step S103 is executed. Step S116 includes steps S1161 to S1163, which correspond to steps S1021a to S1023a respectively. Step S1161 determines whether the received image signal source 20 is an HDMI variable refresh rate signal. If the determination result is positive, step S114 is executed; if the determination result is negative, step S1022a is executed. Step S1162 determines whether the received image signal source 20 is a FreeSync variable refresh rate signal. If the determination result is positive, step S114 is executed; if the determination result is negative, step S1023a is executed. Step S1163 determines whether the received image signal source 20 is a G-Sync variable refresh rate signal. If the determination result is positive, step S114 is executed; if the determination result is negative, step S103 is executed. In summary, the image capturing device and image processing method with variable refresh rate signal processing capability provided by this invention can generate corresponding output packets according to different image signal sources. For example, if the image signal source is a variable refresh rate signal, dynamic frame interval output packets can be generated, enabling the backend electronic device to display or record images with the variable refresh rate signal. Similarly, if the image signal source is a fixed refresh rate signal, fixed frame interval output packets can be generated, enabling the backend electronic device to display or record images with the fixed refresh rate signal. Therefore, the image capturing device and image processing method of this invention enable the image capturing device to process variable refresh rate signals, thereby obtaining high-resolution and smooth images. The above embodiments are merely illustrative of the implementation of the present invention and to explain its technical features, and are not intended to limit the scope of protection of the present invention. Any changes or equivalent arrangements that can be easily made by those skilled in the art are within the scope of the present invention, and the scope of protection of the present invention shall be determined by the scope of the patent application. S101~S111: Steps

Claims

1. An image processing method for an image capturing device, comprising: receiving an image signal source by a receiving unit, the image signal source having a plurality of image frames and their corresponding plurality of image information or corresponding plurality of variable refresh rate association information; determining whether the image signal source is a variable refresh rate signal and generating a determination result; when the determination result is positive, generating a timestamp corresponding to each image frame based on the variable refresh rate association information, the timestamps respectively corresponding to a dynamic frame interval; when the determination result is negative, generating the timestamp corresponding to each image frame based on the image information, the timestamps corresponding to a fixed frame interval; converting the image frames into corresponding output packets; and integrating the output packets with their corresponding timestamps to generate a dynamic frame interval output packet or a fixed frame interval output packet.

2. The image processing method as described in claim 1, further comprising, before determining whether the image signal source is the variable refresh rate signal: detecting whether the receiving unit has the ability to detect a variable refresh rate setting parameter; and when the receiving unit does not have the ability to detect the variable refresh rate setting parameter, collecting the variable refresh rate related information in the image signal source.

3. The image processing method as described in claim 2, wherein the variable refresh rate associated information includes resolution information, frame output frequency, image width information, image height information, and clock frequency information.

4. The image processing method as described in claim 2, wherein in the step of detecting whether the receiving unit has the ability to detect the variable refresh rate setting parameter, it is simultaneously detected whether the receiving unit can detect an HDMI variable refresh rate signal, a FreeSync variable refresh rate signal and / or a G-Sync variable refresh rate signal.

5. The image processing method as described in claim 1 further comprises: simultaneously monitoring another image signal source received by the receiving unit when outputting the dynamic frame interval output packet or the fixed frame interval output packet; determining whether the image signal source exists; when the image signal source does not exist, using the fixed frame interval; when the image signal source exists, determining whether the image signal source has changed; when the determination result is no change, continuing to monitor other image signal sources received by the receiving unit; and when the determination result is a change, further determining whether the image signal source is the variable refresh rate signal.

6. The image processing method as described in claim 1, wherein the dynamic frame interval output packet or the fixed frame interval output packet is output to an electronic device, and prior to the step of converting the image frames into corresponding output packets, the method further includes: Determine whether the settings of the electronic device can achieve optimal image smoothness; And when the judgment result is negative, the electronic device will prompt the optimal setting value.

7. An image processing method for an image capturing device, comprising: receiving an image signal source by a receiving unit, the image signal source having a plurality of image frames and corresponding plurality of variable refresh rate association information; when the image signal source is a variable refresh rate signal, generating a timestamp corresponding to each image frame based on the variable refresh rate association information, the timestamps respectively corresponding to a dynamic frame interval; converting the image frames into corresponding output packets; and integrating the output packets with their corresponding timestamps to generate a dynamic frame interval output packet.

8. The image processing method as described in claim 7, wherein, The image signal source also has multiple image information corresponding to the image frames, and further includes: when the image signal source is not the variable refresh rate signal, the timestamp corresponding to each image frame is generated based on the image information, and the timestamps correspond to a fixed frame interval; and after the image frames are converted into the corresponding output packets, a fixed frame interval output packet is generated.

9. An image capturing apparatus, comprising: a receiving unit for receiving an image signal source, the image signal source having a plurality of image frames and corresponding plurality of image information or corresponding plurality of variable refresh rate association information; an image processing unit coupled to the receiving unit for receiving the image signal source, determining whether the image signal source is a variable refresh rate signal, and outputting a determination result and the image signal source; and a calculation unit coupled to the image processing unit for receiving the determination result and the image signal source, and processing the image signal source according to the determination result, wherein when the determination result is affirmative, the calculation unit generates a timestamp corresponding to each image frame according to the variable refresh rate association information, the timestamps corresponding to a dynamic frame interval. When the judgment result is negative, the calculation unit generates the timestamp corresponding to each image frame based on the image information, and the timestamps correspond to a fixed frame interval; and a transmission processing unit is coupled to the calculation unit, converts the image frames into corresponding output packets, and integrates the output packets with their corresponding timestamps to generate a dynamic frame interval output packet or a fixed frame interval output packet.

10. The image capturing apparatus as claimed in claim 9, wherein the timestamps are calculated based on resolution information, clock frequency information and / or counter value information of the image signal source.

Images