Display device and display method with fast display and system failure backup mechanism

Abstract

The present application provides a display device and a display method with fast display and system failure backup mechanism. The display device comprises at least an image control module, a main system module and a system control module. The image control module continuously receives input images from an external image sensing device after starting and directly outputs the input images. The system control module continuously monitors the main system module after starting to determine whether the main system module is started completely. The main system module runs an operating system after starting to process the input images and generate processed images. After the main system module is started completely, the image control module simultaneously outputs the input images and the processed images. When the main system module is abnormal, the image control module resumes to output the input images alone.

Description

TECHNICAL FIELD

[0001] The present application relates to a display device and a display method, and more particularly to a display device and a display method with fast display and system failure backup mechanism. BACKGROUND

[0002] Generally, an image processing system can analyze, process and correct images generated by image sensing devices, such as endoscopes, ultrasound probes, etc., so that users can easily and clearly view the images.

[0003] In order to perform the above-mentioned actions, an operating system must be run in the image processing system, and the corresponding algorithms and applications are executed through the operating system. Therefore, the boot time of such image processing systems is generally long. However, in some special cases (such as emergency medical behavior), users must be able to immediately obtain the images of the image sensing devices, and cannot tolerate the long boot time of the image processing system.

[0004] As described above, the image processing systems currently available on the market generally need to execute specific operating systems and applications, and when the load of the image processing system is too large, the images are unstable, frozen or even the system directly crashes. In emergency medical behavior, if users cannot continuously and stably obtain the required images, it may cause serious consequences.

[0005] Therefore, the image processing systems currently available on the market need to be further improved. SUMMARY

[0006] The main purpose of the present application is to provide a display device and a display method with fast display and system failure backup mechanism, which can output images immediately after the display device is started, and still maintain stable output of images when the main system in the display device is overloaded or crashes.

[0007] In order to achieve the above-mentioned purpose, the display device with fast display and system failure backup mechanism of the present application comprises:

[0008] An image input interface connected to an image sensing device to continuously receive an input image;

[0009] An image output unit;

[0010] An image control module connected to the image input interface and the image output unit, which continuously receives the input image through the image input interface after startup is completed, and immediately controls the image output unit to continuously output the input image;

[0011] a main system module connected to the image control module, running an operating system after starting, continuously receiving the input image from the image control module, executing an image processing program on the input image to generate a processed image, and continuously returning the processed image to the image control module, wherein the starting completion time of the main system module is later than or equal to the starting completion time of the image control module; and

[0012] a system control module connected to the image control module and the main system module, continuously monitoring the main system module after starting completion;

[0013] wherein the image control module controls the image output unit to simultaneously output the input image and the processed image after receiving the processed image, and controls the image output unit to separately output the input image when the main system module has an abnormality.

[0014] As described above, wherein the image output unit is a display unit, or an image interface for connecting an external display device, wherein the image interface is a High Definition Multimedia Interface (HDMI), a Serial Digital Interface (SDI), or a DisplayPort.

[0015] As described above, wherein a position sensor is further included, electrically connected to the system control module, the position sensor senses a rotation angle of the display device, and the system control module controls the image control module to adjust the display direction and angle of the input image and the processed image according to the rotation angle.

[0016] As described above, wherein the image control module is a Field Programmable Gate Array (FPGA) or an Application Specific Integrated Circuit (ASIC), the main system module is a Central Process Unit (CPU) or a Graphic Process Unit (GPU), and the system control module is a Micro Control Unit (MCU) or an Embedded Controller (EC).

[0017] As described above, further comprising a signal input interface electrically connected to the image control module, wherein the system control module acquires a control signal of the signal input interface via the image control module, and adjusts a display parameter of the image control module according to the content of the control signal.

[0018] As described above, wherein the input image and the processed image are displayed side by side or superimposed.

[0019] As described above, wherein the system control module executes a watchdog program or periodically performs handshaking with the main system module to monitor the main system module, and determines that the main system module is abnormal when the main system module does not respond to a condition that meets a predetermined threshold.

[0020] As described above, wherein the image control module determines that the main system module is abnormal when the main system module stops returning the processed image or the processed image has an image freezing phenomenon.

[0021] As described above, wherein the system control module records a set value of the main system module at the moment when the main system module is abnormal, controls the main system module to restart, and loads the set value into the main system module to restore the state before the restart after the main system module is restarted.

[0022] To achieve the above purpose, the display method with fast display and system failure backup mechanism of the present application is applied to the display device as described above, and comprises the following steps:

[0023] Step a) the system control module continuously monitors the main system module after startup is completed;

[0024] Step b) the image control module continuously receives an input image from an image sensing device after startup is completed, and immediately controls an image output unit to continuously output the input image;

[0025] Step c) the main system module runs an operating system after startup, wherein the startup completion time of the main system module is later than or equal to the startup completion time of the image control module;

[0026] Step d) the operating system continuously receives the input image from the image control module, executes an image processing program on the input image to generate a processed image, and continuously returns the processed image to the image control module;

[0027] Step e) the image control module controls the image output unit to simultaneously output the input image and the processed image after receiving the processed image;

[0028] Step f) judging whether the main system module is abnormal; and

[0029] Step g) the image control module controls the image output unit to output the input image alone when the main system module is abnormal.

[0030] As mentioned above, the image control module is a field programmable logic gate array or a dedicated integrated circuit, the main system module is a central processing unit or a graphics processing unit, and the system control module is a micro control unit or an embedded controller.

[0031] As mentioned above, step f) is performed by the system control module executing a watchdog program or periodically performing handshake with the main system module, and judging that the main system module is abnormal when the main system module does not respond and the state meets a preset threshold condition.

[0032] As mentioned above, step f) is performed by the image control module detecting that the main system module stops returning the processed image or the processed image has an image freezing phenomenon, and judging that the main system module is abnormal.

[0033] As mentioned above, it further comprises:

[0034] Step h) recording a setting value of the main system module at the moment when the main system module is abnormal;

[0035] Step i) restarting the main system module by the system control module;

[0036] Step j) continuously judging whether the main system module is restarted by the system control module after step i).

[0037] Step k) loading the setting value into the main system module to restore the state before restarting after the main system module is restarted; and

[0038] Step l) executing step d) and step e) again after step k).

[0039] The technical effect of the present application relative to the related art is that the user only needs to connect the image sensing device to the display device and start the display device to immediately obtain the required image without waiting for the main system module in the display device to start. Even if the main system module is delayed or dead during use due to overload, the display device can still maintain stable image output and the user cannot perform tasks without obtaining the image. BRIEF DESCRIPTION OF DRAWINGS

[0040] Figure 1 It is a first specific embodiment of the schematic diagram of the display device of the present application.

[0041] Figure 2 First embodiment of a block diagram of a display device of the present application;

[0042] Figure 3A First embodiment of a first flowchart of a display method of the present application;

[0043] Figure 3B First embodiment of a second flowchart of a display method of the present application;

[0044] Figure 4 Second embodiment of a schematic diagram of a display device of the present application;

[0045] Figure 5A Second embodiment of a block diagram of a display device of the present application;

[0046] Figure 5B Third embodiment of a schematic diagram of a display device of the present application;

[0047] Figure 6 Second embodiment of a flowchart of a display method of the present application.

[0048] Wherein, the reference signs:

[0049] 1… display device;

[0050] 101… image control module;

[0051] 102… system control module;

[0052] 103… main system module;

[0053] 11… image output unit;

[0054] 12… image input interface;

[0055] 13… signal input interface;

[0056] 14… orientation sensor;

[0057] 2… image sensing device;

[0058] 31… input image;

[0059] 32… processed image;

[0060] S10~S30, S40~S54… display steps. DETAILED DESCRIPTION

[0061] The present application will be further described below with reference to the drawings and specific embodiments, so that those skilled in the art can better understand the present application and implement it. However, the embodiments are not intended to limit the present application.

[0062] The present application discloses a display device mainly used for emergency medical action (e.g. detection or first aid on an ambulance), and a display method used by the display device. The display device can output the image generated by the image sensing device immediately after power-on, so as to help the user (e.g. a doctor, a nurse, etc.) to obtain the relevant image required for rescue immediately. Moreover, the display device can continuously provide image output when the system is overloaded or dead, so as to avoid the situation that the user stops the rescue action due to the problem of the device.

[0063] Referring to Figure 1 and Figure 2 , Figure 1 FIG. 1 is a schematic diagram of a first embodiment of the display device of the present application, Figure 2 FIG. 2 is a block diagram of the first embodiment of the display device of the present application.

[0064] The present application discloses a display device (hereinafter referred to as display device 1 in the specification) with a fast display and system failure backup mechanism. As shown in Figure 1 , the display device 1 can be connected to an external image sensing device 2, such as an endoscope, an ultrasound probe, etc., but not limited thereto. After receiving the input image sensed by the image sensing device 2, the display device 1 can process the input image through internal algorithms and / or applications, such as artificial intelligence processing, image analysis, image correction, and image editing, etc. Moreover, the display device 1 can also perform recording, video recording, etc. through internal applications, to record the use process of the user for the image sensing device 2 and the display device 1.

[0065] In order to execute the above-mentioned algorithms and applications, the display device 1 generally needs to execute an operating system (Operating System, OS) through an internal processor, such as Windows, Linux, Ubuntu, etc., and then execute the required algorithms and applications through the operating system. The start-up of the operating system requires time, which generally takes one to five minutes. However, as mentioned above, in special use situations, the user cannot wait for such a long start-up time.

[0066] The main technical feature of this invention is that when a user connects the image sensing device 2 to the display device 1 and presses the power button (not shown) of the display device 1 to power it on, the display device 1 can immediately output the image sensed and generated by the image sensing device 2 directly through its image output unit 11. This solves the problem that in emergency medical situations, users must wait for the display device 1 to power on and load the operating system and related applications, thus wasting precious rescue time.

[0067] At Figure 1 and Figure 2 In this embodiment, the display device 1 mainly includes an image control module 101, a system control module 102, a main system module 103, an image output unit 11, and an image input interface 12. The image control module 101 processes images from the display device 1, the system control module 102 processes signals and instructions from the display device 1, and the main system module 103 executes the operating system and related algorithms and applications of the display device 1.

[0068] The image input interface 12 can be an interface, such as a Universal Serial Bus (USB), a Serial Peripheral Interface (SPI), or an I / O interface. 2 Interfaces such as Type-C, or commonly used image output interfaces such as Mobile Industry Processor Interface (MIPI) and Serial Digital Interface (SDI), are not limited to these. The display device 1 connects to the image sensing device 2 via the image input interface 12, so that the image sensing device 2 continuously receives input images (such as...) after power-on. Figure 1 The input image 31 shown is an example of an image sensing device 2, such as an endoscope or an ultrasound probe, which is a medical sensor. The input image 31 may be, for example, a human body image sensed and generated by an endoscope or an ultrasound probe, but is not limited thereto.

[0069] In one embodiment, the image output unit 11 may be an image interface, such as a High Definition Multimedia Interface (HDMI), a Serial Digital Interface (SDI), or a DisplayPort, but is not limited thereto. In this embodiment, the display device 1 can be connected to an external display device (not shown) via the image output unit 11 to display images.

[0070] In another embodiment, the image output unit 11 can be a display unit configured on the display device 1, and the display device 1 can directly display the image through the image output unit 11. The above are only some specific embodiments of the present application, but are not limited thereto.

[0071] The image control module 101 is connected to the image input interface 12 and the image output unit 11. The image control module 101 is a module realized by combining hardware with software. Specifically, the image control module 101 can be, for example, a Field Programmable Gate Array (FPGA) or an Application Specific Integrated Circuit (ASIC), but is not limited thereto.

[0072] If realized by the FPGA or the ASIC, the image control module 101 can complete startup in a very short time (for example, less than 100 ms) after the display device 1 is powered on. In the present application, after startup, the image control module 101 can start to continuously receive the input image 31 through the image input interface 12, and immediately control the image output unit 11 to output the input image 31. In other words, after the user presses the power key of the display device 1, the display device 1 can display the input image 31 of the image sensing device 2 in a very short time (for example, less than 100 ms).

[0073] It is worth mentioning that the display device 1 can include multiple image input interfaces 12, and simultaneously connect multiple sets of image sensing devices 2 and receive multiple sets of input images 31 through the multiple image input interfaces 12. In this case, the image control module 101 can display multiple sets of input images 31 side by side based on a preset value or the control of the system control module 102. For ease of understanding, the following will be described by taking the connection of a single image sensing device 2 and the reception of a single set of input images 31 as an example.

[0074] Specifically, the display device 1 of the present application analyzes and processes (for example, image correction or image editing, etc.) the input image 31 through the main system module 103, so that the user can more easily observe. However, before the main system module 103 has not completed startup, the display device 1 first provides the input image 31 without any processing through the image control module 101, so that the user can obtain the required image information in the shortest time.

[0075] The system control module 102 is connected to the image control module 101 and the main system module 103. The system control module 102 is a module realized by hardware in combination with software. Specifically, the system control module 102 can be, for example, a micro control unit (MCU) or an embedded controller (EC), but is not limited thereto.

[0076] If realized by the MCU or the EC, similar to the image control module 101, the system control module 102 can complete the startup in a very short time after the display device 1 is powered on (generally shorter than or equal to the startup completion time of the image control module 101). In the present application, after the system control module 102 is started, it continuously monitors the main system module 103 to determine whether the main system module 103 is started. Specifically, the system control module 102 can determine that the main system module 103 is started after the operating system and the application program in the main system module 103 are both executed. After the main system module 103 is started, the system control module 102 still continuously monitors the main system module 103 to determine whether the main system module 103 has an overload or a crash.

[0077] One of the technical features of the present application is that when the main system module 103 is started and operates normally, the image control module 101 controls the image output unit 11 to simultaneously display the unprocessed input image 31 and the processed image 32 provided by the main system module 103. When the main system module 103 has not been started or the main system module 103 is started but operates abnormally, the image control module 101 controls the image output unit 11 to display the unprocessed input image 31 alone. In this way, regardless of the status of the main system module 103, the user can obtain images from the display device 1.

[0078] The main system module 103 is connected to the image control module 101 and the system control module 102. The main system module 103 is a module realized by hardware in combination with software. Specifically, the main system module 103 can be, for example, a central processing unit (CPU) or a graphic processing unit (GPU), but is not limited thereto.

[0079] In an embodiment, the startup completion time of the main system module 103 is later than or equal to the startup completion time of the image control module 101. Specifically, after being powered on, the main system module 103 first runs the operating system. After the operating system is run, the operating system executes one or more preset applications. After the one or more applications are started, the system control module 102 can determine that the main system module 103 is started.

[0080] In one embodiment, the main system module 103 sends an image request to the image control module 101 through the operating system after the startup is completed, so as to request the image control module 101 to provide the input image 31. In another embodiment, the system control module 102 sends a control instruction to the image control module 101 after determining that the startup of the main system module 103 is completed, so as to make the image control module 101 start transmitting the input image 31 to the main system module 103.

[0081] The main system module 103 executes an image processing program on the input image 31 through an application program, and generates a corresponding processed image 32. The processed image 32 can include the results of analyzing, correcting, editing, etc. of the input image 31, but is not limited thereto. Moreover, the main system module 103 continuously transmits the processed image 32 back to the image control module 101.

[0082] In the present application, the image control module 101 continuously receives the input image 31 from the image sensing device 2 after the startup is completed, and immediately controls the image output unit 11 to output the input image 31 alone. After the image control module 101 receives the processed image 32 from the main system module 103, it controls the image output unit 11 to switch to outputting the input image 31 and the processed image 32 simultaneously. Specifically, the image output unit 11 can display the input image 31 and the processed image 32 in a side-by-side manner (for example, the display mode shown in FIG. 4), or in a superimposed manner (for example, the display mode shown in FIG. 5), but is not limited thereto. Figure 1 The image output unit 11 can display the input image 31 and the processed image 32 in a side-by-side manner (for example, the display mode shown in FIG. 4), or in a superimposed manner (for example, the display mode shown in FIG. 5), but is not limited thereto. Figure 4

[0083] When the main system module 103 has an abnormality (for example, overloading or crashing), resulting in that the processed image 32 generated by the main system module 103 is unstable, or the transmission of the processed image 32 to the image control module 101 is stopped, the image control module 101 immediately controls the image output unit 11 to resume outputting the input image 31 alone. In this way, the use purpose of the user to obtain images from the display device 1 can be avoided from being interrupted due to the abnormality of the main system module 103.

[0084] It is worth mentioning that the display device 1 is mainly connected to the image control module 101, the system control module 102 and the main system module 103 through the same set of batteries or power supplies (not shown in the figure) at the same time. When the power key of the display device 1 is pressed, the image control module 101, the system control module 102 and the main system module 103 are powered on and started at the same time.

[0085] ​In one embodiment, the system control module 102 has the shortest boot-up completion time, the image control module 101 has a boot-up completion time later than that of the system control module 102, and the main system module 103 has a boot-up completion time later than or equal to that of the image control module 101.

[0086] Please refer to Figure 1 , Figure 2 , Figure 3A and Figure 3B , wherein Figure 3A and Figure 3B are the first and second embodiments of the first and second flowcharts of the display method of the present application. Figure 3A and Figure 3B disclose a display method with fast display and system failure backup mechanism (hereinafter referred to as the display method in the description) of the present application, which is applied to a display device 1 as shown in Figure 1 , Figure 2 .

[0087] First, the display device 1 is powered on (step S10). In one embodiment, the display device 1 is powered on when the power button (not shown in the figure) thereon is pressed, and the image control module 101, the system control module 102 and the main system module 103 are simultaneously powered by the power supply or an external power supply.

[0088] In one embodiment, the system control module 102 completes the boot-up before the image control module 101 and the main system module 103. After the system control module 102 completes the boot-up, it starts to monitor the main system module 103 (step S12) to determine whether the main system module 103 has completed the boot-up.

[0089] For example, the system control module 102 can execute a watchdog program to monitor the main system module 103, or continuously handshake with the main system module 103 to monitor the main system module 103. When the system control module 102 executes the above program and the main system module 103 responds to the call of the system control module 102, the system control module 102 can confirm that the main system module 103 has completed the boot-up. Specifically, the system control module 102 can monitor the main system module 103 itself, the operating system running on the main system module 103, or the application program executed by the operating system through the watchdog program or the handshake program, without limitation.

[0090] In an embodiment, the image control module 101 is started later than the system control module 102 but earlier than the main system module 103. After the image control module 103 is started, the image control module 103 starts to receive the input image 31 from the image sensing device 2 and controls the image output unit 11 to directly output the received input image 31 (step S14). Through the execution of step S14, the display device 1 can immediately provide the input image 31 generated by the image sensing device 2 through the image output unit 11 in a very short time after the user presses the power key, without waiting for the main system module 103 to be started.

[0091] It is worth mentioning that after the image control module 101 is started, the display device (such as the image display unit 11 or an external display device) connected to the display device 1 can be started at the same time, and the display area of the display device is planned, for example, when the currently connected image sensing device 2 is two groups, two display areas need to be planned to display two groups of input images 31.

[0092] After step S14, the system control module 102 continuously judges whether the main system module 103 is started (step S16). Before the main system module 103 is started, the display device 1 continuously executes step S14 to continuously receive and output the input image 31 through the image control module 101 and the image output unit 11.

[0093] Specifically, after being powered on, the main system module 103 runs an operating system, such as Windows, Linux, Ubuntu, etc., without limitation. When the operating system is run, the main system module 103 executes one or more application programs preset through the operating system. When all the preset application programs are started, the main system module 103 is started.

[0094] If it is judged in step S16 that the main system module 103 is started, the image control module 102 can start to transmit the received input image 31 to the main system module 103 based on the control instruction issued by the system control module 101 or the image request issued by the main system module 103 through the operating system (step S18). After step S18, the main system module 103 can execute an image processing program on the input image 31 through one or more application programs that have been started, and generate a corresponding processed image 32 (step S20). And the main system module 103 continuously transmits the generated processed image 32 to the image processing module 101 (step S22).

[0095] In an embodiment, the main system module 103 and the image processing module 101 can be connected through a high-definition multimedia interface (HDMI) or a camera input interface to transmit the input image 31 and the processed image 32 to each other, without limitation.

[0096] After starting to receive the processed image 32 from the main system module 103, the image control module 101 controls the image output unit 11 to switch from the display mode of outputting the input image 31 alone to the display mode of outputting the input image 31 and the processed image 32 simultaneously (step S24).

[0097] After step S24, the user can obtain the input image 31 without any analysis, processing and correction and the processed image 32 processed by one or more image processing programs simultaneously through the display device 1.

[0098] It is worth mentioning that the processed image 32 contains more information after being analyzed and processed by the application program of the main system module 103 than the input image 31. Therefore, in some embodiments, the image control module 101 can also control the image output unit 11 to switch from the display mode of outputting the input image 31 alone to the display mode of outputting the processed image 32 alone in step S24.

[0099] After step S24, the display device 1 continues to determine whether the main system module 103 is abnormal through the image processing module 101 and / or the system control module 102 (step S26). When the main system module 103 is normal, the display device 1 repeats steps S18 to S24 to continuously display the input image 31 and the processed image 32 simultaneously through the image output unit 11.

[0100] If the main system module 103 is abnormal, it may not be able to continue to provide the processed image 32, or the provided processed image 32 may be erroneous or unstable. In order to avoid the user's judgment error, if it is determined that the main system module 103 is abnormal in step S26, the image control module 101 will immediately control the image output unit 11 to restore the display mode of outputting the input image 31 alone (step S28). And when it is determined that the main system module 103 is abnormal, the system control module 102 will force the main system module 103 to restart through the sending of instructions (step S30).

[0101] It is worth mentioning that the steps S28 and S30 do not have an execution sequence relationship, or the display device 1 can execute steps S28 and S30 through the image control module 101 and the system control module 102 simultaneously through multiplexing processing, but not limited.

[0102] By performing step S28, the display device 1 will not stop outputting the image due to the abnormality of the main system module 103, thereby the user can continuously obtain the image generated by the image sensing device 2. By performing step S30, the display device 1 can automatically restart the main system module 103 when the main system module 103 is abnormal, so as to make the main system module 103 recover normal operation as soon as possible.

[0103] After step S28 and step S30, the system control module 102 and / or the image control module 101 judges whether the display device 1 is powered off (step S32), and repeats performing step S12 to step S23 before the display device 1 is powered off. Thereby, the input image 31 can be continuously displayed before the main system module 103 recovers normal, and the input image 31 and the processed image 32 can be simultaneously displayed after the main system module 103 recovers normal. By the above technical solution, it can be ensured that the user is not affected by the state of the main system module 103.

[0104] In an embodiment, step S26 is performed by the system control module 102 to judge whether the main system module 103 is abnormal. Specifically, the system control module 102 can perform a watchdog program after starting, or periodically perform handshake with the main system module 103 to monitor the main system module 103. After the main system module 103 is started, the main system module 103 can receive the inquiry signal sent by the system control module 102 and respond to the inquiry signal.

[0105] When the system control module 102 sends the inquiry signal, but cannot receive the response of the main system module 103, and the state that the main system module 103 does not respond meets a preset threshold condition, the system control module 102 can judge that the main system module 103 is abnormal. The preset threshold condition may, for example, but is not limited to, slow response, no response and number of times greater than a specific number, or no response and duration exceeding a specific time, but is not limited thereto.

[0106] In another embodiment, step S26 can be performed by the image control module 101 to judge whether the main system module 103 is abnormal. As described above, the image control module 101 can start to transmit the input image 31 to the main system module 103 after the main system module 103 is started, and continuously receive the processed image 32 returned by the main system module 103. In this embodiment, the image control module 101 can analyze the processed image 32. When the main system module 103 stops returning the processed image 32, or the processed image 32 has an image freezing phenomenon, the image control module 101 can judge that the main system module 103 is abnormal.

[0107] It is worth mentioning that the processed image 32 is an image that has been analyzed, corrected or edited by an algorithm or an application program in the main system module 103, and can present more details. Therefore, the display device 1 can adjust the display mode of the images according to the user's operation in addition to simultaneously displaying the input image 31 and the processed image 32.

[0108] Please also refer to Figures 1 to 4 wherein Figure 4 is a second specific embodiment of the schematic diagram of the display device of the present application. In this embodiment, the image output unit 11 can be a touch screen. The system control module 102 can receive the control signal sent by the image output unit 11 after accepting the user's operation through the image control module 101, and adjust the display parameters of the image control module 101 according to the content of the control signal. The display parameters can be, for example, the corresponding parameters of the user's actions such as selecting, dragging, zooming in or zooming out the image, but are not limited thereto.

[0109] Through the operation, the user can change the display mode of the input image 31 and / or the processed image 32 on the display device 1. Figure 4 In the above embodiment, the processed image 32 is enlarged and the display mode is adjusted to be superimposed display, so that the user can obtain more image information in the processed image 32. Specifically, the user can specify the priority of different images 31, 32, and when the user enlarges, reduces or moves each image 31, 32 through the operation, the image with lower priority will be covered by the image with higher priority. In this way, the user can adjust the display mode of multiple images 31, 32 as needed.

[0110] In another embodiment, the display device 1 also has one or more signal input interfaces 13 connected to the image control module 101. In this embodiment, the display device 1 can connect external devices (not shown in the figure) such as keyboard, mouse, touchpad, remote control, external touch screen, etc. through the signal input interface 13. The signal input interface 13 can be, for example, a universal serial bus (USB), but is not limited thereto.

[0111] In this embodiment, the user can operate the external device to send the control signal to the system control module 102, and the system control module 102 can adjust the display parameters of the image control module 101 according to the content of the control signal. In other words, by operating the external device, the user can also change the display mode of the input image 31 and / or the processed image 32 on the display device 1.

[0112] It is worth mentioning that the user can also issue editing instructions for the image through the image output unit 11 or external equipment. For example, the user can mark, color, and take screenshots of the image, but not limited thereto. In this case, the system control module 102 can receive the editing instructions through the image control module 101, and transmit the editing instructions to the main system module 103. In this way, the main system module 103 can control the executed algorithm or application program based on the editing instructions, so that the generated processed image 32 can conform to the user's operation content.

[0113] In the foregoing embodiment, the image input interface 12, the signal input interface 13, and the image output unit 11 are connected with the image control module 101, and the system control module 102 receives the signals output by the image input interface 12, the signal input interface 13, and the image output unit 11 through the image control module 101. In other words, the image control module 101 can serve as a communication bridge between the system control module 102 and the peripheral equipment.

[0114] In other embodiments, the image input interface 12, the signal input interface 13, and / or the image output unit 11 can also be connected with the system control module 102 through an I 2 C interface or an SPI interface, respectively, to directly transmit signals to the system control module 102.

[0115] As described above, the display device 1 of the present application can be mainly applied to emergency medical situations, and in addition to the time urgency, the use environment can also be quite limited (for example, performing first aid on an ambulance) when performing emergency medical behavior. Due to the limitation of the environment, the user can not be able to correctly place the display device 1 or the external display device connected with the display device 1, thereby causing inconvenience when observing the image.

[0116] Please refer to Figure 5A and Figure 5B , wherein Figure 5A is a second specific embodiment of a block diagram of the display device of the present application, Figure 5B is a third specific embodiment of a schematic diagram of the display device of the present application.

[0117] As shown in Figure 5A , the display device 1 of the present application can also include an orientation sensor 14 electrically connected with the system control module 102, for sensing the rotation angle of the display device 1. In an embodiment, the orientation sensor 14 can be, for example, a G sensor or an Accelerometer, but not limited thereto.

[0118] As shown in Figure 5BAs shown, the display device 1 can sense its current rotation angle by the orientation sensor 14 and transmit to the system control module 102. By this, the system control module 102 can adjust the display parameters of the image control module 101 according to the rotation angle, thereby adjusting the display direction of the input image 31 and the processed image 32. By this, no matter how the user places the display device 1, the input image 31 and the processed image 32 can be displayed in the correct direction and angle on the image output unit 11.

[0119] In another embodiment, the image output unit 11 is an image interface, and the display device 1 connects an external display device through the image output unit 11. In this embodiment, if the external display device is built-in with the orientation sensor, the system control module 102 of the display device 1 can receive the rotation angle feedbacked by the external display device through the image control module 101, and adjust the display parameters of the image control module 101 according to the rotation angle, thereby adjusting the display direction of the input image 31 and the processed image 32 on the external display device.

[0120] By displaying the input image 31 and the processed image 32 in the correct direction and angle, the convenience of the user using the display device 1 in the emergency medical behavior can be further provided.

[0121] Please refer to Figure 1 , Figure 2 , Figure 3A , Figure 3B and Figure 6 , wherein Figure 6 is the second specific embodiment of the flow chart of the display method of the present application.

[0122] In the present application, after the main system module 103 is started, the display device 1 continuously monitors the main system module 103 through the system control module 102 and / or the image control module 101 (step S40), which includes that the system control module 102 regularly judges whether the main system module 103 does not respond, and the image control module 101 continuously judges whether the image feedbacked by the main system module 103 is abnormal (step S42).

[0123] If the main system module 103 normally responds to the call of the system control module 102, and normally feedbacks the processed image 32 to the image control module 101, it represents that the main system module 103 operates normally. In this case, the display device 1 does not control the main system module 103, and continuously monitors the main system module 103 through the system control module 102 and / or the image control module 101. At this time, the image control module 101 continuously outputs the input image 31 and the processed image 32 through the image output unit 11.

[0124] In step S42, if the system control module 102 judges that the main system module 103 does not respond, or if the image control module 101 judges that the image returned by the main system module 103 is abnormal, it means that the main system module 103 is about to or has already occurred abnormality. In this case, the display device 1 records the current various setting values of the main system module 103 by the system control module 102 (step S44), and controls the main system module 103 to reset (step S46).

[0125] Specifically, after the main system module 103 is started, it sets the operating system, algorithm and application program as necessary, and records the related setting values, for example, stores in the temporary storage (not shown in the figure) of the display device 1, the system control module 102 or the image control module 101, but not limited to this. When the main system module 103 adjusts the operating system, algorithm or application program, it further records the adjusted setting values.

[0126] In the present application, the monitoring of the main system module 103 by the system control module 102 includes recording the setting values used by the main system module 103. Specifically, when the system control module 102 or the image control module 101 judges that the main system module 103 has occurred abnormality in step S42, the system control module 102 immediately obtains the setting values of the main system module 103 at that time, for example, takes out the last recorded setting values of the main system module 103 before the abnormality from the above-mentioned temporary storage, the system control module 102 or the image control module 101, and controls the main system module 103 to reset again.

[0127] After the main system module has occurred abnormality, the image control module 101 controls the image output unit 11 to switch to outputting the input image 31 obtained from the image sensing device 2 alone (step S48). In this way, during the period when the main system module 103 has occurred abnormality and is resetting, the user can still obtain the input image 31 from the display device 1 without being affected by the abnormality of the main system module 103.

[0128] It is worth mentioning that the above-mentioned step S46 and step S48 do not have an execution sequence relationship, the display device 1 can first control the main system module 103 to reset by the system control module 102, and then switch the image output mode by the image control module 101, or first switch the image output mode by the image control module 101, and then control the main system module 103 to reset by the system control module 102. In another embodiment, the display device 1 can also execute steps S46 and S48 simultaneously by multiplexing, without being limited to the order shown. Figure 6

[0129] ​After step S46 and step S48, the system control module 102 continues to determine whether the main system module 103 has completed the restart (step S50), and maintains the display mode of the image output unit 11 outputting the input image 31 alone before the main system module 103 has completed the restart.

[0130] In an embodiment, the system control module 102 can control the main system module 103 to restart, continue to execute the watchdog program or handshake with the main system module 103, and determine whether the main system module 103 has completed the restart after receiving the response of the main system module 103.

[0131] After the main system module 103 has completed the restart, the system control module 102 transmits the setting value obtained in step S44 to the main system module 103, so that the main system module 103 loads the setting value to restore the state before the restart (step S52).

[0132] After step S52, the system control module 102 notifies the image control module 101 that the main system module 103 has completed the restart, or the main system module 103 sends an image request to the image control module 101. In this way, the image control module 101 starts to transmit the input image 31 to the main system module 103, and receives the processed image 32 returned by the main system module 103. In addition, the image control module 101 controls the image output module 11, so that the image output module 11 switches to the display mode of simultaneously outputting the input image 31 and the processed image 32 (step S54).

[0133] It is worth mentioning that the main system module 103 in the present application is mainly used to execute the operating system and the application program, so as to perform the image processing program on the input image 31. Therefore, compared with the image control module 101 and the system control module 102, the main system module 103 consumes more power.

[0134] In an embodiment, the display device 1 can be powered by a battery. When it is determined that the power of the battery is insufficient, the display device 1 can control the main system module 103 to sleep by the system control module 102, and control the image output unit 11 to display the input image 31 alone by the image control module 101. In this way, the power of the display device 1 can be saved, and the user can avoid losing the image during the emergency medical behavior.

[0135] In this embodiment, the display device 1 can control the main system module 103 to restart by the system control module 102 after the user replaces the battery or connects an external power supply, so as to restore the display mode of the image output unit 11 simultaneously displaying the input image 31 and the processed image 32. Through the above technical means, the stability of the display device 1 can be effectively maintained, so as to improve the medical quality.

[0136] Through the technical solution of the present application, the display device 1 can display the input image 31 of the image sensing device 2 immediately after being powered on, and display the input image 31 and the processed image 32 simultaneously after the main system module 103 is started up, thereby achieving the purpose of providing a fast display mechanism. Moreover, the display device 1 can maintain the display of the input image 31 and automatically restart the main system module 103 when the main system module 103 occurs an abnormality, and automatically restore to the display mode of displaying the input image 31 and the processed image 32 simultaneously after the main system module 103 is restarted, thereby achieving the purpose of providing a system failure backup mechanism. That is, the display device 1 of the present application can enable the user to obtain the required image in the fastest time, and maintain the provision of the image, so as to meet the image demand of the user under the emergency medical behavior.

[0137] The above-described embodiments are only preferred embodiments of the present application, and the protection scope of the present application is not limited thereto. Any equivalent replacement or transformation made by those skilled in the art based on the present application is within the protection scope of the present application. The protection scope of the present application is subject to the claims.

Claims

1. A display device with fast display and system failure backup mechanism, characterized in that, The application comprises: an image input interface connected to an image sensing device to continuously receive an input image; an image output unit; an image control module connected to the image input interface and the image output unit, which continuously receives the input image through the image input interface after startup is completed, and immediately controls the image output unit to continuously output the input image; a main system module connected to the image control module, which runs an operating system after startup, continuously receives the input image from the image control module, executes an image processing program on the input image to generate a processed image, and continuously returns the processed image to the image control module, wherein the startup completion time of the main system module is later than or equal to the startup completion time of the image control module; and a system control module connected to the image control module and the main system module, which continuously monitors the main system module after startup is completed, and judges whether the main system module has an abnormality from the image control module and / or the system control module; wherein the image control module controls the image output unit to simultaneously output the input image and the processed image after receiving the processed image, and controls the image output unit to separately output the input image when the main system module has an abnormality.

2. The display device with fast display and system failure backup mechanism according to claim 1, wherein, The image output unit is a display unit, or an image interface connected to an external display device, wherein the image interface is a high-definition multimedia interface, a digital serial interface, or a display interface.

3. The display device with fast display and system failure backup mechanism according to claim 2, wherein, Further comprising an orientation sensor electrically connected to the system control module, which senses a rotation angle of the display device, and the system control module controls the image control module to adjust the display direction and angle of the input image and the processed image according to the rotation angle.

4. The display device with fast display and system failure backup mechanism according to claim 1, wherein, The image control module is a field programmable logic gate array or a dedicated integrated circuit, the main system module is a central processing unit or a graphics processing unit, and the system control module is a micro control unit or an embedded controller.

5. The display device with fast display and system failure backup mechanism according to claim 1, wherein, Further comprising a signal input interface electrically connected to the image control module, wherein the system control module obtains a control signal of the signal input interface through the image control module, and adjusts a display parameter of the image control module according to the content of the control signal.

6. The display device with fast display and system failover backup mechanism according to claim 1, wherein, The input image and the processed image are displayed side by side or superimposed.

7. The display device with fast display and system failover backup mechanism according to claim 1, wherein, The system control module executes a watchdog program or periodically performs handshake with the main system module to monitor the main system module, and judges that the main system module has an abnormality when the state of the main system module without response meets a preset threshold condition.

8. The display device with fast display and system failover backup mechanism according to claim 1, wherein, The image control module judges that the main system module has an abnormality when the main system module stops returning the processed image, or the processed image has an image freezing phenomenon.

9. The display device with fast display and system failover backup mechanism according to claim 1, wherein, The system control module records a setting value of the main system module at the moment when the main system module has an abnormality, controls the main system module to restart, and loads the setting value into the main system module to restore to the state before restart after the main system module restarts is completed.

10. A display method with fast display and system failure backup mechanism, characterized in that, The display method is applied to a display device having an image control module, a main system module and a system control module, and comprises: Step a) continuously monitoring the main system module after the system control module is started up; Step b) continuously receiving an input image from an image sensing device and immediately controlling an image output unit to continuously output the input image after the image control module is started up; Step c) running an operating system after the main system module is started up, wherein the starting-up completion time of the main system module is later than or equal to the starting-up completion time of the image control module; Step d) continuously receiving the input image from the image control module, executing an image processing program on the input image to generate a processed image, and continuously returning the processed image to the image control module by the operating system; Step e) controlling the image output unit to simultaneously output the input image and the processed image after the image control module receives the processed image; Step f) judging whether the main system module has an abnormality by the image control module and / or the system control module; and Step g) controlling the image output unit to output the input image alone when the main system module has an abnormality by the image control module.

11. The method of claim 10, wherein the method further comprises: The image control module is a field programmable logic gate array or a special integrated circuit, the main system module is a central processing unit or a graphic processing unit, and the system control module is a micro control unit or an embedded controller.

12. The method of claim 10, wherein the method further comprises: determining whether the system is in a failover mode; and if the system is in the failover mode, displaying the first image on the display device. The step f) is executed by the system control module to execute a watchdog program or periodically handshake with the main system module, and judges that the main system module has an abnormality when the main system module does not respond to the system control module and the state meets a preset threshold condition.

13. The method of claim 10, wherein the method further comprises: determining whether the system is in a failover mode; and if the system is in the failover mode, displaying the first image on the display device. The step f) is executed by the image control module to detect that the main system module stops returning the processed image or the processed image has an image freezing phenomenon, and judges that the main system module has an abnormality.

14. The method of claim 10, wherein the method further comprises: determining whether the system is in a failover mode; and if the system is in the failover mode, displaying the first image on the display device. Further comprising: Step h) recording a setting value of the main system module at the moment when the main system module has an abnormality; Step i) controlling the main system module to restart by the system control module; Step j) continuously judging whether the main system module is restarted by the system control module after the step i); Step k) loading the setting value into the main system module to restore the state before the restart after the main system module is restarted; And Step l) executing the step d) and the step e) again after the step k).

Images