Image display system

Abstract

To provide an image display system that can generate sharpened images (clear and easy-to-view images) while achieving further compactness, excellent portability, and superior mobility. [Solution] The present invention provides an image display system comprising a first image display device, an image sharpening device, a second image display device, and a storage device, wherein the first image display device displays an image captured by an imaging device, the image sharpening device performs image sharpening processing on the image captured to generate a sharpened image, the second image display device displays the sharpened image, and the first image display device, the image sharpening device, and the second image display device are stored in the storage device.

Description

Technical Field

[0001] The present invention relates to an image display system.

Background Art

[0002] Conventionally, various techniques for generating a sharpened image from a blurred image, a degraded image, an unclear image, an image with insufficient light amount (for example, a nighttime image, a dark image, an underwater image, etc.) have been actively developed and proposed (for example, see Patent Document 1 and Patent Document 2).

Prior Art Documents

Patent Documents

[0003]

Patent Document 2

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the techniques proposed in Patent Document 1 and Patent Document 2, there is a possibility that the apparatus and system for generating a sharpened image may become large-sized, and there is a risk that further compactification, excellent portability, and excellent mobility of the apparatus and system for generating a sharpened image cannot be achieved.

[0005] The present invention has been made in view of such a situation, and a main object thereof is to provide an image display system capable of achieving further compactification, excellent portability, and excellent mobility in generating a sharpened image (an image that is clearly visible).

Means for Solving the Problems

[0006] As a result of diligent research and studies to solve the above-mentioned objectives, the inventors have succeeded in developing an image display system that can generate enhanced images (clear and easy-to-view images) while achieving further compactness, excellent portability, and excellent mobility, thus completing the present invention.

[0007] In other words, in the present invention, It comprises a first image display device, an image sharpening device, a second image display device, and a storage device. The first image display device displays the captured image captured by the imaging device. The image enhancement device performs image enhancement processing on the captured image to generate an enhanced image. The second image display device displays the enhanced image, The present invention provides an image display system in which the first image display device, the image enhancement device, and the second image display device are housed in the storage device.

[0008] The image display system according to the present invention may further include a recording device. In the image display system according to the present invention, The recording device may record the enhanced image. The recording device may be housed in the storage device.

[0009] In the image display system according to the present invention, The storage device may comprise a first case body and a second case body. The first case body is, The first shell section and, The first bottom plate portion is connected to the first shell plate portion, A first top plate portion is connected to the first body plate portion and faces the first bottom plate portion, The first body plate, the first bottom plate, and the first top plate are connected to the first right side plate, The first body plate, the first bottom plate, and the first top plate are connected to the first left side plate which faces the first right side plate, It may have a first opening, The first opening may be surrounded by the first bottom plate, the first right side plate, the first left side plate, and the first top plate. The second case body is, The second shell plate section, The second bottom plate portion is connected to the second body plate portion, A second top plate portion is connected to the second body plate portion and faces the second bottom plate portion, The second body plate, the second bottom plate, and the second top plate are connected to the second right side plate, The second body plate, the second bottom plate, and the second top plate are connected to the second left side plate, and the second right side plate is opposite the second right side plate. It may also have a second opening, The second opening may be surrounded by the second bottom plate, the second right side plate, the second left side plate, and the second top plate. The first bottom plate and the second bottom plate may be connected via a hinge. The first opening and the second opening may be closed by the hinge, with the first top panel and the second top panel joined together, the first right side panel and the second right side panel joined together, and the first left side panel and the second left side panel joined together. The first image display device and the second image display device may be arranged on the first shell plate portion. The image enhancement device may be installed on the second body plate.

[0010] In the image display system according to the present invention, The second image display device and the first image display device may be arranged in close proximity on the first body plate, starting from the first top plate.

[0011] In the image display system according to the present invention, The storage device may comprise a first case body and a second case body. The first case body is, The first shell section and, The first bottom plate portion is connected to the first shell plate portion, A first top plate portion is connected to the first body plate portion and faces the first bottom plate portion, The first side plate portion connected to the first body plate portion, the first bottom plate portion, and the first top plate portion, and The first left side plate portion connected to the first body plate portion, the first bottom plate portion, and the first top plate portion and facing the first right side plate portion, and It may have a first opening, and The first opening may be surrounded by the first bottom plate portion, the first right side plate portion, the first left side plate portion, and the first top plate portion, and The second case body portion A second body plate portion, and A second bottom plate portion connected to the second body plate portion, and A second top plate portion connected to the second body plate portion and facing the second bottom plate portion, and A second right side plate portion connected to the second body plate portion, the second bottom plate portion, and the second top plate portion, and A second left side plate portion connected to the second body plate portion, the second bottom plate portion, and the second top plate portion and facing the second right side plate portion, and It may have a second opening, and The second opening may be surrounded by the second bottom plate portion, the second right side plate portion, the second left side plate portion, and the second top plate portion, and The first bottom plate portion and the second bottom plate portion may be connected via a hinge, and The first opening and the second opening may be closed by the hinge, with the first top plate portion and the second top plate portion joined, the first right side plate portion and the second right side plate portion joined, and the first left side plate portion and the second left side plate portion joined, and The first image display device, the second image display device, and the recording device may be disposed on the first body plate portion, and The image sharpening device may be disposed on the second body plate portion.

[0012] In the image display system according to the present invention, In order from the first top plate portion, the second image display device and the first image display device may be disposed close to each other on the first body plate portion on the first left side plate portion side, and The recording device may be disposed on the first body plate portion on the first right side plate portion side.

Advantages of the Invention

[0013] According to the present invention, in generating sharpened images (images that are clear and easy to view), further compactness, excellent portability, and excellent mobility can be achieved. The effects described herein are not necessarily limited, and any of the effects described herein may also be present. [Brief explanation of the drawing]

[0014] [Figure 1] Figure 1 is a block diagram showing an example configuration 1 of an image display system according to a first embodiment to which the present invention is applied. [Figure 2] Figure 2 is a perspective view showing an example configuration of an image display system of a second embodiment to which the present invention is applied. [Figure 3] Figure 3 is an enlarged view of the HDMI® (High-Definition Multimedia Interface) cable and power cable included in the configuration example 2 of the image display system of the second embodiment to which the present invention is applied. [Figure 4] Figure 4 is a perspective view showing an example of the configuration of a storage device included in an image display system of a second embodiment to which the present invention is applied. [Figure 5] Figure 5 is a block diagram showing a configuration example 3 of an image display system according to a third embodiment to which the present invention is applied. [Figure 6] Figure 6 is a block diagram showing an example of the electrical configuration of an image enhancement device included in an image display system of a third embodiment to which the present invention is applied. [Figure 7] Figure 7 shows the flow of the image enhancement process in the image enhancement device of the image display system of the first embodiment to which the present invention is applied. [Modes for carrying out the invention]

[0015] The following describes preferred embodiments for carrying out the present invention. The embodiments described below are examples of typical embodiments of the present invention and should not be interpreted as narrowing the scope of the present invention.

[0016] Unless otherwise specified, in drawings, "up" means the upper direction or upper side in the drawing, "down" means the lower direction or lower side in the drawing, "left" means the left direction or left side in the drawing, and "right" means the right direction or right side in the drawing. In addition, in drawings, the same or equivalent elements or components are denoted by the same reference numeral, and redundant explanations may be omitted.

[0017] The explanation will be given in the following order. 1. Outline of the present invention 2. First Embodiment (Example 1 of Image Display System) 3. Second Embodiment (Example 2 of Image Display System) 4. Third Embodiment (Example 3 of Image Display System)

[0018] <1. Overview of the Invention> First, I will explain the outline of the present invention.

[0019] The present invention is an image display system comprising a first image display device, an image sharpening device, a second image display device, and a storage device.

[0020] The first image display device displays the captured image captured by the imaging device, the image enhancement device performs image enhancement processing on the captured image to generate an enhanced image, and the second image display device displays the enhanced image.

[0021] The first image display device, the image enhancement device, and the second image display device are housed in a storage device.

[0022] The storage device comprises a first case body and a second case body.

[0023] The first case body comprises a first body plate, a first bottom plate connected to the first body plate, a first top plate connected to the first body plate and facing the first bottom plate, a first right side plate connected to the first body plate, the first bottom plate, and the first top plate, a first left side plate connected to the first body plate, the first bottom plate, and the first top plate and facing the first right side plate, and a first opening.

[0024] The first opening is surrounded by the first bottom plate, the first right side plate, the first left side plate, and the first top plate.

[0025] The second case body comprises a second body plate, a second bottom plate connected to the second body plate, a second top plate connected to the second body plate and facing the second bottom plate, a second right side plate connected to the second body plate, the second bottom plate, and the second top plate, a second left side plate connected to the second body plate, the second bottom plate, and the second top plate and facing the second right side plate, and a second opening.

[0026] The second opening is surrounded by the second bottom plate, the second right side plate, the second left side plate, and the second top plate.

[0027] In the storage device, the first bottom plate and the second bottom plate are connected via a hinge. The first opening and the second opening are closed by the hinge, with the first top plate and the second top plate joined together, the first right side plate and the second right side plate joined together, and the first left side plate and the second left side plate joined together.

[0028] The first image display device and the second image display device are arranged (installed) on the first body plate, and the image enhancement device is arranged (installed) on the second body plate.

[0029] The image enhancement device is then installed in the second barrel plate section.

[0030] The image display system according to the present invention may further include a recording device. The recording device records the enhanced image and stores it in a storage device.

[0031] If the image display system according to the present invention further includes a recording device, the first image display device, the second image display device, and the recording device may be arranged on the first body plate. For example, the second image display device and the first image display device may be arranged in close proximity on the first body plate on the first left side, starting from the first top plate, and the recording device may be arranged on the first body plate on the first right side.

[0032] The image display system according to the present invention can achieve further compactness, excellent portability, and superior mobility in generating sharpened images (images that are clear and easy to view).

[0033] For example, when using an underwater drone equipped with a camera or a high-sensitivity camera, the image display system according to the present invention offers the advantages of being all-in-one (compact) with excellent mobility and portability. Furthermore, the first image display device and the second image display device allow for easy comparison before and after image enhancement processing, resulting in superior convenience.

[0034] The embodiments of the present invention will be described below in a specific and detailed manner.

[0035] <2. First Embodiment (Example 1 of Image Display System)> An image display system according to the first embodiment of the present invention (Example 1 of an image display system) will be described with reference to Figures 1 and 7.

[0036] Figure 1 is a block diagram showing an example configuration of an image display system of a first embodiment to which the present invention is applied, and more specifically, it shows the configuration of the image display system 100. Figure 7 is a diagram showing the flow of the image sharpening process in the image sharpening device of the image display system of the first embodiment to which the present invention is applied, and more specifically, it shows the flow 600 of the image sharpening process in the image sharpening device 2 of the image display system 100.

[0037] First, let's explain using Figure 1.

[0038] The image display system 100 comprises a first image display device 1, an image sharpening device 2, a recording device 3, a second image display device 4, and a storage device (not shown in Figure 1).

[0039] The first image display device 1 displays the captured image taken by the imaging device 500 (e.g., an underwater drone, a drone, a high-sensitivity camera). The image sharpening device 2 performs image sharpening processing on the captured image to generate a sharpened image. The recording device 3 records the sharpened image. The second image display device 4 displays the sharpened image.

[0040] The first image display device 1, the image sharpening device 2, the recording device 3, and the second image display device 4 are housed in a storage device (not shown in Figure 1).

[0041] In the image display system 100, the first image display device 1 is connected to the imaging device 500 via an HDMI (High-Definition Multimedia Interface) cable, and image signals (video signals), audio signals, and control signals of images captured by the imaging device 500 are output (transmitted) to the first image display device 1.

[0042] Furthermore, in the image display system 100, the image enhancement device 2 is connected to the imaging device 500 via an HDMI (High-Definition Multimedia Interface) cable, and image signals (video signals), audio signals, and control signals of the images captured by the imaging device 500 are output (transmitted) to the image enhancement device 2.

[0043] The image signals (video signals), audio signals, and control signals of the image captured by the imaging device 500 are input to the HDMI splitter 300, and the transmission of these image signals (video signals), audio signals, and control signals to the first image display device 1 and the image enhancement device 2 may be distributed and output.

[0044] The recording device 3 is connected to the image enhancement device 2 via an HDMI (High-Definition Multimedia Interface) cable, and the image signal (video signal), audio signal, and control signal of the enhanced image generated by the image enhancement device 2 are output (transmitted) to the recording device 3.

[0045] The second image display device 4 is connected to the recording device 3 via an HDMI (High-Definition Multimedia Interface) cable, and the image signals (video signals), audio signals, and control signals of the enhanced images recorded by the recording device 3 are output (transmitted) to the second image display device 4.

[0046] Next, we will explain using Figure 7.

[0047] The captured image obtained by the imaging device 500 is input to the image enhancement device 2 for processing (step S701), and image acquisition processing is performed (step S601).

[0048] The captured image, after image acquisition processing, is saved (step S602) and stored (step S702).

[0049] Furthermore, the captured image that has undergone image acquisition processing is subjected to pre-processing for sharpening (step S605). Pre-processing for sharpening involves passing parameters for the image sharpening process, described later, to each mode (modes 1 to 6, steps S607 to S612), and calling one of the sharpening processing modes 1 to 6 determined by the parameters (steps S607 to S612). In addition, in the image sharpening process, there are cases where the process of passing parameters for sharpening is not performed, and mode 0 is called (step S606).

[0050] To perform image sharpening processing, the user performs an operation (step S703), and parameters are processed via the user interface (step S603) (step S604). In parameter processing, it is determined which of the sharpening processing modes 1 to 6 to be used is selected from the modes described in steps S607 to S612. Depending on the state of the image, the sharpening processing mode is selected from among the six modes (modes 1 to 6). Thus, the sharpening processing mode is determined from among the six modes (modes 1 to 6) through the user's operation.

[0051] There are two types of parameters, for example: the contrast threshold (clipLimit) and the histogram equalization grid size (tileGridSize). Modes 3-5 of the sharpening process allow you to change these two parameters.

[0052] The parameter processing (step S604) is then reflected in the image acquisition process (step S601), and as mentioned above, it is also reflected in the image sharpening preprocessing (step S605).

[0053] From modes 0 to 6 of the sharpening process called by the sharpening preprocessing (step S605), processing in one of the modes is executed (steps S606 to S612).

[0054] Mode 0 (Step S606) is a mode that outputs the captured image as is, without any sharpening processing.

[0055] Mode 1 (step S607) is a mode in which the image is decomposed into RGB (R (Red), G (Green), and B (Blue)), the histograms of each are averaged, and the R, G, and B are merged and output.

[0056] Mode 2 (Step S608) is a mode in which HSV (Hue, Saturation, and Value) is extracted from the image, and the value is histogram averaged and output.

[0057] Mode 3 (Step S609) is a mode in which the image is divided into small tiles (blocks), local histogram equalization is performed within each tile, and then RGB equalization is performed before output.

[0058] Mode 4 (Step S610) is a mode in which the image is divided into small tiles (blocks), local histogram equalization is performed within each tile, and only the value of the HSV (Hue, Saturation, and Value) is equalized and output.

[0059] Mode 5 (step S611) is a mode in which Mode 1, Mode 4, and Mode 3 are executed and output in that order. Specifically, in Mode 5, the signal processed in Mode 1 is processed in Mode 4, and then Mode 3 processing is added to that signal before outputting.

[0060] Mode 6 (Step S612) is a mode that changes the contrast and brightness before outputting the image.

[0061] In modes 1 through 6, the OpenCV image processing library is used. Specifically, modes 1 and 2 are executed using the equalizeHist image processing library, while modes 3 and 4 are executed using the createCLAHE image processing library.

[0062] After processing in one of the modes is performed (steps S606 to S612), post-processing for sharpening is performed (step S613), and the sharpened image (or the captured image in mode 0) is output (step S704).

[0063] Here, post-processing for sharpening refers to the process of outputting the sharpened image (or captured image in mode 0) to the recording device 3 (or the second image display device 4).

[0064] The image enhancement process flow 600 has been described above. The steps included in the image enhancement process flow 600 are steps S601 to S613, as shown in Figure 7.

[0065] The contents described above regarding the first embodiment of the present invention (Example 1 of an image display system) can be applied to the second and third embodiments of the present invention described later, unless there are any particular technical inconsistencies.

[0066] <3. Second Embodiment (Example 2 of Image Display System)> A second embodiment of the present invention (Example 2 of the image display system) will be described using Figures 2, 3, and 4.

[0067] Figure 2 is a perspective view showing an example configuration of an image display system of a second embodiment to which the present invention is applied, and more specifically, a perspective view showing the configuration of the image display system 101. Figure 3 is an enlarged view of the HDMI (High-Definition Multimedia Interface) cable and power cable included in the example configuration of an image display system of a second embodiment to which the present invention is applied, and more specifically, an enlarged view of the HDMI (High-Definition Multimedia Interface) cable and power cable included in the image display system 101 in region N shown in Figure 2. Figure 4 is a perspective view showing an example configuration of a storage device included in an image display system of a second embodiment to which the present invention is applied, and more specifically, a perspective view showing the configuration of the storage device 50 included in the image display system 101.

[0068] First, let's explain using Figure 4.

[0069] The storage device 50 comprises a first case body 51 and a second case body 52.

[0070] The first case body 51 includes a first shell plate 51-1, a first bottom plate 51-2 connected to the first shell plate 51-1, a first top plate 51-4 connected to the first shell plate 51-1 and facing the first bottom plate 51-2, a first right side plate 51-3 connected to the first shell plate 51-1, the first bottom plate 51-2 and the first top plate 51-4, a first left side plate 51-5 connected to the first shell plate 51-1, the first bottom plate 51-2 and the first top plate 51-4 and facing the first right side plate 51-3, and a first opening 51-6.

[0071] The first opening 51-6 is surrounded by the first bottom plate portion 51-2, the first right side plate portion 51-3, the first left side plate portion 51-5, and the first top plate portion 51-4.

[0072] The second case body 52 includes a second body plate 52-1, a second bottom plate 52-2 connected to the second body plate 52-1, a second top plate 52-4 connected to the second body plate 52-1 and facing the second bottom plate 52-2, a second right side plate 52-3 connected to the second body plate 52-1, the second bottom plate 52-2, and the second top plate 52-4, a second left side plate 52-5 connected to the second body plate 52-1, the second bottom plate 52-2, and the second top plate 52-4 and facing the second right side plate 52-3, and a second opening 52-6.

[0073] The second opening 52-6 is surrounded by the second bottom plate 52-2, the second right side plate 52-3, the second left side plate 52-5, and the second top plate 52-4.

[0074] In the storage device 50, the first bottom plate portion 51-2 and the second bottom plate portion 52-2 are connected via hinges 53 and 54. The first opening 51-6 and the second opening 52-6 are joined by hinges 53 and 54, bringing together the first top plate portion 51-4 and the second top plate portion 52-4, the first right side plate portion 51-3 and the second right side plate portion 52-3, and the first left side plate portion 51-5 and the second left side plate portion 52-5. The fasteners 55 and 56 (locking mechanisms) provided on the first top plate portion 51-4 are inserted into the fastener insertion portions 57 and 58 (locking mechanisms), respectively, and the storage device 50 is closed and locked.

[0075] The storage device 50, locked by a locking mechanism consisting of fasteners 55 and 56 and fastener insertion parts 57 and 58, is easy to carry anywhere (for example, at sea, at the scene of an incident or accident at night, in areas with bad weather, etc.) by holding the handle part 59 provided on the second top plate part 52-4, thus offering excellent portability.

[0076] Next, we will explain using Figures 2 and 3.

[0077] The image display system 101 includes a first image display device 11, an image sharpening device 12, a recording device 13, a second image display device 14, an operation pad 15, a battery 16, a power switch 18, and a storage device 50.

[0078] The first image display device 11 displays captured images taken by an imaging device (e.g., an underwater drone, a drone, a high-sensitivity camera, etc.) (not shown in Figure 2). The image sharpening device 12 performs image sharpening processing on the captured images to generate sharpened images. The recording device 13 records the sharpened images. The second image display device 14 displays the sharpened images. The first image display device 11, the image sharpening device 12, the recording device 13, the second image display device 14, the operation pad 15, and the battery 16 are housed in the storage device 50.

[0079] In the image display system 101, the first image display device 11 is connected to the imaging device via an HDMI cable 83, and image signals (video signals), audio signals, and control signals of images captured by the imaging device 500 are output (transmitted) to the first image display device 11.

[0080] The image enhancement device 12 is connected to the first image display device 11 via an HDMI cable 84, and image signals (video signals), audio signals, and control signals of the images captured by the imaging device 500 are output from the first image display device 11 and input (transmitted) to the image enhancement device 12.

[0081] The recording device 13 is connected to the image enhancement device 12 via an HDMI cable 86, and the image signal (video signal), audio signal, and control signal of the enhanced image generated by the image enhancement device 12 are output (transmitted) to the recording device 13.

[0082] The second image display device 14 is connected to the recording device 13 via an HDMI cable 87, and the image signal (video signal), audio signal, and control signal of the enhanced image recorded by the recording device 13 are output (transmitted) to the second image display device 14.

[0083] The control pad 15 is connected to the image sharpening device 12 via a cable 90. The control pad 15 (sometimes referred to as a control gamepad) allows various operations related to image sharpening to be performed on the image sharpening device 12. Examples of various operations related to image sharpening include starting the sharpening process, changing the sharpening process mode, and changing the sharpening parameters.

[0084] The battery 16 inserted into the battery insertion section 17-1 is connected to the first image display device 11 via power cable 91, to the image enhancement device 12 via power cable 94, to the recording device 13 via power cable 92, and to the second image display device 14 via power cable 93.

[0085] A second battery (not shown in Figure 2, the same applies hereafter) can be inserted into the battery insertion section 17-2. The second battery is used as a backup when battery 16 becomes unusable. It is also possible to use the second battery simultaneously with battery 16 to extend the operating time.

[0086] When the power switch 18 is turned on, the image display system 101 starts operating, and when the power switch 18 is turned off, the image display system 101 stops operating.

[0087] The storage device 50 includes a first board 61 on a first shell plate section 51-1 and a second board 62 on a second shell plate section 52-1. The first board 61 and the second board 62 may be made of any material, but may include, for example, a carbon plate or an aluminum composite plate.

[0088] HDMI cables 84, 86, and 87, as well as power cables 91, 92, and a portion of power cable 93, are wired between the first shell plate section 51-1 and the first board 61, and between the second shell plate section 52-1 and the second board 62. By wiring HDMI cables 84, 86, and 87, as well as power cables 91, 92, and a portion of power cable 93, between the first shell plate section 51-1 and the first board 61, and between the second shell plate section 52-1 and the second board 62, it becomes possible to further compact the image display system 101.

[0089] The assembly of HDMI cables and power cables indicated by reference numeral 82 consists of HDMI cables 84 and 86, and power cables 91, 92, and 93. By covering and bundling the HDMI cables 84 and 86, and power cables 91, 92, and 93 with cover 82-1, the image display system 101 can be made even more compact.

[0090] As shown in Figures 2 and 4, the second image display device 14 and the first image display device 11 are arranged (installed) vertically close together on the first body plate 51-1 on the first left side plate 51-5 side, starting from the first top plate 51-4, via the first board 61. The recording device 13 is then arranged (installed) vertically close together on the first body plate 51-1 on the first right side plate 51-3 side, via the first board 61. By arranging the second image display device 14 and the first image display device 11 vertically close together on the first body plate 51-1 on the first left side plate 51-5 side, starting from the first top plate 51-4, it becomes possible to easily compare images before and after image sharpening processing.

[0091] The image enhancement device 12 is mounted on the second body plate section 52-1 via the second board 62. The operating pad 15, as well as the battery 16 inserted into the battery insertion section 17-1 and the second battery inserted into the battery insertion section 17-2, are also mounted on the second body plate section 52-1 via the second board 62.

[0092] The contents described above regarding the second embodiment of the present invention (Example 2 of the image display system) can be applied to the first embodiment of the present invention described above and the third embodiment of the present invention described later, unless there are any particular technical inconsistencies.

[0093] <4. Third Embodiment (Example 3 of Image Display System)> A third embodiment of the present invention (Example 3 of the image display system) will be described with reference to Figures 5 and 6.

[0094] Figure 5 is a block diagram showing an example configuration of an image display system of a third embodiment to which the present invention is applied, and more specifically, it is a block diagram showing the configuration of the image display system 102. Figure 6 is a block diagram showing an example of the electrical configuration of an image sharpening device included in the image display system of a third embodiment to which the present invention is applied, and more specifically, it is a block diagram showing the electrical configuration of the image sharpening device 1200 included in the image display system 102.

[0095] As shown in Figure 5, the image display system 102 comprises a first image display device 1300, an image sharpening device 1200, a second image display device 1400, a recording device 1500, and a learning model 1310. Although not shown in Figure 5, the first image display device 1300, the image sharpening device 1200, the second image display device 1400, the recording device 1500, and the learning model 1310 are housed in a storage device. The image display system 102 does not necessarily have to include the recording device 1500. Also, the image display system 102 does not necessarily have to include the learning model 1310.

[0096] The image enhancement device 1200 (image acquisition unit 1210) is connected to the imaging device 1000 via a wired connection (e.g., an HDMI (High-Definition Multimedia Interface) cable) or wireless connection (e.g., a communication network), and the first image display device 1300 is connected to the imaging device 1000 via a wired connection (e.g., an HDMI (High-Definition Multimedia Interface) cable) or wireless connection (e.g., a communication network) to display still images or moving images captured by the imaging device 1000 (first connection pattern).

[0097] Furthermore, the first image display device 1300 is connected to the imaging device 1000 via a wired connection (e.g., an HDMI (High-Definition Multimedia Interface) cable) or wireless connection (e.g., a communication network) to display still or moving images captured by the imaging device 1000, and the image sharpening device 1200 (image acquisition unit 1210) is connected to the first image display device 1300 via a wired connection (e.g., an HDMI (High-Definition Multimedia Interface) cable) or wireless connection (e.g., a communication network) (second connection pattern).

[0098] The image display system 102 may have both the first connection pattern and the second connection pattern described above, or it may have either the first connection pattern or the second connection pattern.

[0099] The imaging device 1000 could be, for example, an underwater drone equipped with a camera, a drone equipped with a camera, or a high-sensitivity camera. As mentioned above, the camera is, for example, an optical device for capturing still images or moving images.

[0100] The operating device 2000 is connected to the image enhancement device 1200 via a wired connection (e.g., an HDMI (High-Definition Multimedia Interface) cable) or wireless connection (e.g., a communication network). Alternatively, the operating device 2000 may be provided in the image display system 102 and connected to the image enhancement device 1200 via a wired connection (e.g., an HDMI (High-Definition Multimedia Interface) cable) or wireless connection (e.g., a communication network).

[0101] Examples of the control device 2000 include a control pad and a control gamepad.

[0102] The image enhancement device 1200 has a functional configuration comprising an image acquisition unit 1210, an image feature detection unit 1220, an image area setting unit 1230, and an image enhancement unit 1240.

[0103] The image acquisition unit 1210 acquires still or moving images captured by the imaging device 1000. The imaging device 1000 is located outside the image display system 102 (storage device).

[0104] The image feature detection unit 1220 identifies, for example, feature points in the image based on the image data acquired by the image acquisition unit 1210.

[0105] The image area setting unit 1230 receives and selects a predetermined area of ​​the image selected through the operating device 2000.

[0106] The image area setting unit 1230 acquires the area of ​​the degraded image manipulated by the operating device 2000 and sets the acquired area as the area to be sharpened (hereinafter referred to as the "sharpening area"). Furthermore, if the sharpening area is adjusted through the operating device 2000, the image area setting unit 1230 sets the adjusted area as the new sharpening area.

[0107] The image sharpening unit 1240 sharpens the sharpening area set by the image area setting unit 1230 and acquires a sharpened image.

[0108] Furthermore, the image sharpening unit 1240 may be composed of an autoencoder to which a convolutional neural network, a type of machine learning model, is applied. The image sharpening unit 1240 may acquire a learning model 1310 provided in the image display system 102 (for example, stored in the memory unit (not shown in Figure 5) of the image display system 102), and use the acquired learning model 1310 to sharpen the sharpening area set by the image region setting unit 1230 to acquire a sharpened image.

[0109] The learning model 1310 is a set of parameters generated when the image sharpening unit 1240 is trained using the captured image (original image) and the sharpened image as training data. The image sharpening unit 1240 to which the learning model 1310 is applied outputs a sharpened image in which the image region of the sharpening area of ​​the captured image (original image) has been sharpened.

[0110] As shown in Figure 5, the recording device 1500 is connected to the image sharpening device 1200 (image sharpening unit 1240) via a wired connection (e.g., an HDMI (High-Definition Multimedia Interface) cable) or wireless connection (e.g., a communication network) to record the sharpened image generated, and the second image display device 1400 is connected to the recording device 1500 via a wired connection (e.g., an HDMI (High-Definition Multimedia Interface) cable) or wireless connection (e.g., a communication network) to display the sharpened still image or moving image recorded by the recording device (third connection pattern).

[0111] Furthermore, as shown in Figure 5, the second image display device 1400 is connected to the image sharpening device 1200 (image sharpening unit 1240) via a wired connection (e.g., an HDMI (High-Definition Multimedia Interface) cable) or wireless connection (e.g., a communication network) to display a still image or moving image sharpened by the image sharpening unit 1240, and the recording device 1500 is connected to the image sharpening device 1200 (image sharpening unit 1240) via a wired connection (e.g., an HDMI (High-Definition Multimedia Interface) cable) or wireless connection (e.g., a communication network) to record the sharpened image generated (fourth connection pattern).

[0112] The image display system 102 may have both the third connection pattern and the fourth connection pattern described above, or it may have either the third connection pattern or the fourth connection pattern.

[0113] As shown in Figure 6, the image enhancement device 1200 is configured as a computer (server) that performs image enhancement processing. The image enhancement device 1200 includes a CPU (Central Processing Unit) 210, which is the main control unit that manages the operation of the entire image enhancement device 1200; a ROM (Read Only Memory) 220 in which various programs and data are pre-stored; a RAM (Random Access Memory) 230 used as a work area when the CPU 210 executes various programs; and an HDD (Hard Disk Drive) 240 and an SSD (Solid State Drive) 241 as storage means for storing various programs and data. The image enhancement device 1200 may also be equipped with either an HDD (Hard Disk Drive) 240 or an SSD (Solid State Drive) as its storage device (storage unit).

[0114] Furthermore, the image enhancement device 1200 includes an input unit 250 consisting of a keyboard and mouse, etc., which accepts input for various operations; a display unit 260, such as a liquid crystal display device, which displays various images; and a communication unit 270 that is connected to the imaging device 1000 and / or the operating device 2000 via a wired connection (e.g., an HDMI (High-Definition Multimedia Interface) cable) or wireless connection (e.g., a communication network) and transmits and receives various data between the imaging device 1000 and / or the operating device 2000. Note that the image enhancement device 1200 does not necessarily have an input unit 250. Also, the image enhancement device 1200 does not necessarily have a display unit 260.

[0115] In the image enhancement device 1200, the CPU 210, ROM 220, RAM 230, HDD 240, SSD 241, input unit 250, display unit 260, and communication unit 270 are electrically connected to each other via the system bus 209. Therefore, in the image enhancement device 1200, the CPU 210 can access the ROM 220, RAM 230, HDD 240, and SSD 241, understand the operation status of the input unit 250, display images on the display unit 260, and send and receive various data with the imaging device 1000 and / or the operating device 2000 via the communication unit 270.

[0116] The image enhancement device 1200 performs predetermined processing by, for example, loading a program stored in the ROM 220, HDD 240, and / or SSD 241 into the RAM 230, and executing the program loaded into the RAM 230 using the CPU 210. Specifically, the image enhancement device 1200 performs image enhancement processing by loading an image enhancement program stored in the ROM 220, HDD 240, and / or SSD 241 into the RAM 230, and executing the image enhancement program loaded into the RAM 230 using the CPU 210, thereby realizing the respective functions of the image acquisition unit 1210, the image feature detection unit 1220, the image area setting unit 1230, and the image enhancement unit 1240.

[0117] The contents described above regarding the third embodiment of the present invention (Example 3 of the image display system) can be applied to the first and second embodiments of the present invention described above, unless there are any particular technical inconsistencies.

[0118] It should be noted that the present invention is not limited to the first to third embodiments described above, and various modifications to each of the first to third embodiments described above, as well as any combination of the first to third embodiments described above, are possible without departing from the spirit of the present invention.

[0119] The present invention can take the following configuration.

[0120] [1] It comprises a first image display device, an image sharpening device, a second image display device, and a storage device. The first image display device displays the captured image captured by the imaging device. The image enhancement device performs image enhancement processing on the captured image to generate an enhanced image. The second image display device displays the enhanced image, An image display system in which the first image display device, the image enhancement device, and the second image display device are housed in the storage device.

[0121] [2] Furthermore, equipped with a recording device, The recording device records the enhanced image, The image display system according to [1], wherein the recording device is housed in the storage device.

[0122] [3] The storage device comprises a first case body and a second case body, The first case body is, The first shell section and, The first bottom plate portion is connected to the first shell plate portion, A first top plate portion is connected to the first body plate portion and faces the first bottom plate portion, The first body plate, the first bottom plate, and the first top plate are connected to the first right side plate, The first body plate, the first bottom plate, and the first top plate are connected to the first left side plate which faces the first right side plate, It has a first opening, The first opening is surrounded by the first bottom plate, the first right side plate, the first left side plate, and the first top plate. The second case body is, The second shell plate section, The second bottom plate portion is connected to the second body plate portion, A second top plate portion is connected to the second body plate portion and faces the second bottom plate portion, The second body plate, the second bottom plate, and the second top plate are connected to the second right side plate, The second body plate, the second bottom plate, and the second top plate are connected to the second left side plate, and the second right side plate is opposite the second right side plate. It has a second opening, The second opening is surrounded by the second bottom plate, the second right side plate, the second left side plate, and the second top plate. The first bottom plate and the second bottom plate are connected via a hinge, The first opening and the second opening are closed by the hinge, with the first top panel and the second top panel joined together, the first right side panel and the second right side panel joined together, and the first left side panel and the second left side panel joined together. The first image display device and the second image display device are arranged on the first shell plate portion. The image display system according to [1], wherein the image enhancement device is disposed on the second body plate.

[0123] [4] The image display system according to [3], wherein the second image display device and the first image display device are arranged in close proximity on the first body plate portion, starting from the first top plate portion.

[0124] [5] The storage device comprises a first case body and a second case body, The first case body is, The first shell section and, The first bottom plate portion is connected to the first shell plate portion, A first top plate portion is connected to the first body plate portion and faces the first bottom plate portion, The first body plate, the first bottom plate, and the first top plate are connected to the first right side plate, The first body plate, the first bottom plate, and the first top plate are connected to the first left side plate which faces the first right side plate, It has a first opening, The first opening is surrounded by the first bottom plate, the first right side plate, the first left side plate, and the first top plate. The second case body is, The second shell plate section, The second bottom plate portion is connected to the second body plate portion, A second top plate portion is connected to the second body plate portion and faces the second bottom plate portion, The second body plate, the second bottom plate, and the second top plate are connected to the second right side plate, The second body plate, the second bottom plate, and the second top plate are connected to the second left side plate, and the second right side plate is opposite the second right side plate. It has a second opening, The second opening is surrounded by the second bottom plate, the second right side plate, the second left side plate, and the second top plate. The first bottom plate and the second bottom plate are connected via a hinge, The first opening and the second opening are closed by the hinge, with the first top panel and the second top panel joined together, the first right side panel and the second right side panel joined together, and the first left side panel and the second left side panel joined together. The first image display device, the second image display device, and the recording device are arranged on the first body plate portion. The image display system according to [2], wherein the image enhancement device is disposed on the second body plate.

[0125] [6] Starting from the first top panel, the second image display device and the first image display device are arranged in close proximity on the first left panel side of the first body panel. The image display system according to [5], wherein the recording device is disposed on the first body plate portion on the first right side plate portion. [Explanation of Symbols]

[0126] 1, 11, 1300... First image display device, 2, 12, 1200... Image enhancement device, 3, 13,1500... Recording device, 4, 14, 1400... Second image display device, 15. Control pad, 16...battery, 17-1, 17-2...Battery insertion section, 18. Power switch, 50...Storage device, 51...First case main body, 51-1...1st body plate section, 51-2...1st bottom plate section, 51-3...1st right side plate section, 51-4...First top panel section, 51-5...1st left side plate section, 52...Second case main body, 52-1...Second body plate section, 52-2...Second bottom plate section, 52-3...Second right side plate section, 52-4...Second top panel section, 52-5...2nd left side plate section, 53, 54...Hinge section, 55, 56... Fasteners (locking mechanisms), 57, 58... Fastener insertion part (locking mechanism), 59...handle part, 61...First board, 62...2nd board, 82...A collection of HDMI cables and power cables. 82-1...cover, 83, 84, 86, 87... HDMI cable, 90... Cable, 91, 92, 93, 94... Power cables, 100, 101, 102... Image display system, 209...System bath, 210...CPU, 220...ROM, 230...RAM, 240...HDD, 241...SSD, 250... Input section, 260...display section, 270... Communications Department, 300...HDMI splitter, 500... Imaging devices (underwater drones, drones or high-sensitivity cameras), 600...Flowchart for image sharpening processing, 1000... Imaging device, 1210...Image acquisition unit, 1220...Image feature detection unit, 1230...Image area setting section, 1240...Image enhancement section, 1310...Learning model, 2000...Operating device.

Claims

1. It comprises a first image display device, an image sharpening device, a second image display device, and a storage device. The first image display device displays the captured image captured by the imaging device. The image enhancement device performs image enhancement processing on the captured image to generate an enhanced image. The second image display device displays the enhanced image. An image display system in which the first image display device, the image enhancement device, and the second image display device are housed in the storage device.

2. Furthermore, equipped with a recording device, The recording device records the enhanced image, The image display system according to claim 1, wherein the recording device is housed in the storage device.

3. The storage device comprises a first case body and a second case body, The first case body is, The first shell plate section, The first bottom plate portion is connected to the first body plate portion, A first top plate portion is connected to the first body plate portion and faces the first bottom plate portion, The first body plate, the first bottom plate, and the first top plate are connected to the first right side plate, The first body plate, the first bottom plate, and the first top plate are connected to the first left side plate which faces the first right side plate, It has a first opening, The first opening is surrounded by the first bottom plate, the first right side plate, the first left side plate, and the first top plate. The second case body is, The second shell plate section, The second bottom plate portion is connected to the second body plate portion, A second top plate portion is connected to the second body plate portion and faces the second bottom plate portion, The second body plate, the second bottom plate, and the second top plate are connected to the second right side plate, The second body plate, the second bottom plate, and the second top plate are connected to the second left side plate which faces the second right side plate, It has a second opening, The second opening is surrounded by the second bottom plate, the second right side plate, the second left side plate, and the second top plate. The first bottom plate and the second bottom plate are connected via a hinge, The first opening and the second opening are closed by the hinge, with the first top plate and the second top plate joined together, the first right side plate and the second right side plate joined together, and the first left side plate and the second left side plate joined together. The first image display device and the second image display device are arranged on the first shell plate portion. The image display system according to claim 1, wherein the image enhancement device is disposed on the second body plate.

4. The image display system according to claim 3, wherein the second image display device and the first image display device are arranged in close proximity on the first body plate portion, starting from the first top plate portion.

5. The storage device comprises a first case body and a second case body, The first case body is, The first shell plate section, The first bottom plate portion is connected to the first body plate portion, A first top plate portion is connected to the first body plate portion and faces the first bottom plate portion, The first body plate, the first bottom plate, and the first top plate are connected to the first right side plate, The first body plate, the first bottom plate, and the first top plate are connected to the first left side plate which faces the first right side plate, It has a first opening, The first opening is surrounded by the first bottom plate, the first right side plate, the first left side plate, and the first top plate. The second case body is, The second shell plate section, The second bottom plate portion is connected to the second body plate portion, A second top plate portion is connected to the second body plate portion and faces the second bottom plate portion, The second body plate, the second bottom plate, and the second top plate are connected to the second right side plate, The second body plate, the second bottom plate, and the second top plate are connected to the second left side plate, and the second right side plate is opposite the second right side plate. It has a second opening, The second opening is surrounded by the second bottom plate, the second right side plate, the second left side plate, and the second top plate. The first bottom plate and the second bottom plate are connected via a hinge, The first opening and the second opening are closed by the hinge, with the first top plate and the second top plate joined together, the first right side plate and the second right side plate joined together, and the first left side plate and the second left side plate joined together. The first image display device, the second image display device, and the recording device are arranged on the first body plate portion. The image display system according to claim 2, wherein the image enhancement device is disposed on the second body plate.

6. Starting from the first top panel, the second image display device and the first image display device are arranged in close proximity on the first left panel side of the first body panel. The image display system according to claim 5, wherein the recording device is disposed on the first body plate portion on the first right side plate portion.

Images