Image Display System

Abstract

To provide an image display system that can achieve further compactness, excellent portability, and excellent mobility in generating a sharpened image (a sharp, easy-to-view image). [Solution] The present invention provides an image display system comprising a first image display device, an image sharpening device, a second image display device, and a storage device, wherein the first image display device displays an image captured by an imaging device, the image sharpening device performs image sharpening processing on the captured image to generate a sharpened image, and the second image display device displays the sharpened image, and the first image display device, the image sharpening device, and the second image display device are stored in the storage device.

Description

[Technical Field]

[0001] The present invention relates to an image display system. [Background technology]

[0002] Conventionally, various techniques for generating sharpened images from blurred images, degraded images, unclear images, images with insufficient light (for example, nighttime images, dark images, underwater images, etc.) have been actively developed and proposed (for example, see Patent Documents 1 and 2). [Prior art documents] [Patent documents]

[0003] [Patent Document 2] Japanese Patent Application Laid-Open No. 2006-025186 [Patent Document 1] Special Publication No. 2013-523047 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technologies proposed in Patent Documents 1 and 2 may result in the devices and systems for generating sharpened images becoming larger, and there is a risk that the devices and systems for generating sharpened images may not be made more compact or may not be made highly portable or mobile.

[0005] The present invention was made in consideration of such circumstances, and its main purpose is to provide an image display system that can achieve further compactness, excellent portability, and excellent mobility in generating sharpened images (images that are clear and easy to see). [Means for solving the problem]

[0006] As a result of intensive research and study to achieve the above-mentioned objectives, the inventor has succeeded in developing an image display system that can generate sharpened images (clear, easy-to-see images) while achieving further compactness, excellent portability, and excellent mobility, and has thus completed the present invention.

[0007] That is, in this invention, The device includes a first image display device, an image sharpening device, a second image display device, and a storage device, the first image display device displays an image captured by an imaging device; the image sharpening device performs an image sharpening process on the captured image to generate a sharpened image; a second image display device displays the sharpened image; The first image display device, the image sharpening device, and the second image display device are stored in the storage device, thereby providing an image display system.

[0008] The image display system according to the present invention may further include a recording device, In the image display system according to the present invention, The recording device may record the sharpened image; The recording device may be stored in the storage device.

[0009] In the image display system according to the present invention, The storage device may include a first case body and a second case body, The first case body portion, A first body portion; a first bottom plate portion connected to the first body plate portion; a first top plate portion connected to the first body plate portion and facing the first bottom plate portion; a first right side plate portion connected to the first body plate portion, the first bottom plate portion, and the first top plate portion; a first left side plate portion connected to the first body plate portion, the first bottom plate portion, and the first top plate portion and facing the first right side plate portion; a first opening; The first opening may be surrounded by the first bottom plate portion, the first right side plate portion, the first left side plate portion, and the first top plate portion, The second case main body portion, A second body portion; a second bottom plate portion connected to the second body plate portion; a second top plate portion connected to the second body plate portion and facing the second bottom plate portion; a second right side plate portion connected to the second body plate portion, the second bottom plate portion, and the second top plate portion; a second left side plate portion connected to the second body plate portion, the second bottom plate portion, and the second top plate portion and facing the second right side plate portion; and a second opening, The second opening may be surrounded by the second bottom plate portion, the second right side plate portion, the second left side plate portion, and the second top plate portion, The first bottom plate portion and the second bottom plate portion may be connected via a hinge, The first opening and the second opening may be closed by the hinges, with the first top plate portion and the second top plate portion being joined together, the first right side plate portion and the second right side plate portion being joined together, and the first left side plate portion and the second left side plate portion being joined together, The first image display device and the second image display device may be disposed on the first body panel portion, The image sharpening device may be disposed on the second trunk portion.

[0010] In the image display system according to the present invention, The second image display device and the first image display device may be disposed adjacent to each other on the first body panel in this order from the first top panel.

[0011] In the image display system according to the present invention, The storage device may include a first case body and a second case body, The first case body portion, A first body portion; a first bottom plate portion connected to the first body plate portion; a first top plate portion connected to the first body plate portion and facing the first bottom plate portion; a first right side plate portion connected to the first body plate portion, the first bottom plate portion, and the first top plate portion; a first left side plate portion connected to the first body plate portion, the first bottom plate portion, and the first top plate portion and facing the first right side plate portion; a first opening; The first opening may be surrounded by the first bottom plate portion, the first right side plate portion, the first left side plate portion, and the first top plate portion, The second case main body portion, A second body portion; a second bottom plate portion connected to the second body plate portion; a second top plate portion connected to the second body plate portion and facing the second bottom plate portion; a second right side plate portion connected to the second body plate portion, the second bottom plate portion, and the second top plate portion; a second left side plate portion connected to the second body plate portion, the second bottom plate portion, and the second top plate portion and facing the second right side plate portion; and a second opening, The second opening may be surrounded by the second bottom plate portion, the second right side plate portion, the second left side plate portion, and the second top plate portion, The first bottom plate portion and the second bottom plate portion may be connected via a hinge, The first opening and the second opening may be closed by the hinges, with the first top plate portion and the second top plate portion being joined together, the first right side plate portion and the second right side plate portion being joined together, and the first left side plate portion and the second left side plate portion being joined together, The first image display device, the second image display device, and the recording device may be disposed on the first body panel, The image sharpening device may be disposed on the second trunk portion.

[0012] In the image display system according to the present invention, The second image display device and the first image display device may be disposed adjacent to each other on the first body plate portion on the first left side plate portion side in this order from the first top plate portion, The recording device may be disposed on the first body plate portion on the first right side plate portion side. [Effects of the Invention]

[0013] According to the present invention, in generating a sharpened image (a clear, easy-to-view image), further compactness, excellent portability, and excellent mobility can be achieved. Note that the effects described here are not necessarily limited to those described herein, and may be any of the effects described in this specification. [Brief explanation of the drawings]

[0014] [Figure 1] FIG. 1 is a block diagram showing a first example of the configuration of an image display system according to a first embodiment of the present invention. [Figure 2] FIG. 2 is a perspective view showing a second configuration example of an image display system according to a second embodiment of the present invention. [Figure 3] FIG. 3 is an enlarged view of an HDMI (registered trademark) (HDMI is a registered trademark; the same applies below) (High-Definition Multimedia Interface) cable and a power cable provided in configuration example 2 of an image display system according to a second embodiment of the present invention. [Figure 4] FIG. 4 is a perspective view showing an example of the configuration of a storage device provided in an image display system according to a second embodiment of the present invention. [Figure 5] FIG. 5 is a block diagram showing a third example of the configuration of an image display system according to the third embodiment of the present invention. [Figure 6] FIG. 6 is a block diagram showing an example of the electrical configuration of an image sharpening device provided in an image display system according to a third embodiment of the present invention. [Figure 7] FIG. 7 is a diagram showing the flow of image sharpening processing in the image sharpening device provided in the image display system of the first embodiment to which the present invention is applied. DETAILED DESCRIPTION OF THE INVENTION

[0015] The following describes a preferred embodiment of the present invention. The embodiment described below is an example of a typical embodiment of the present invention, and should not be construed as narrowing the scope of the present invention.

[0016] Unless otherwise specified, in the drawings, "upper" means the upper direction or upper side in the drawing, "lower" means the lower direction or lower side in the drawing, "left" means the left direction or left side in the drawing, and "right" means the right direction or right side in the drawing. Furthermore, in the drawings, the same or equivalent elements or members are given the same reference numerals, and redundant explanations may be omitted.

[0017] The explanation will be given in the following order. 1. Overview of the device 2. First Embodiment (Example 1 of Image Display System) 3. Second Embodiment (Example 2 of Image Display System) 4. Third Embodiment (Example 3 of Image Display System)

[0018] <1. Overview of this device> First, an overview of the present invention will be explained.

[0019] The present invention is an image display system comprising a first image display device, an image sharpening device, a second image display device, and a storage device.

[0020] The first image display device displays a captured image captured by the imaging device, the image sharpening device performs image sharpening processing on the captured image to generate a sharpened image, and the second image display device displays the sharpened image.

[0021] The first image display device, the image sharpening device, and the second image display device are housed in a housing device.

[0022] The storage device includes a first case body and a second case body.

[0023] The first case main body has a first body plate, a first bottom plate connected to the first body plate, a first top plate connected to the first body plate and facing the first bottom plate, a first right side plate connected to the first body plate, the first bottom plate, and the first top plate, a first left side plate connected to the first body plate, the first bottom plate, and the first top plate and facing the first right side plate, and a first opening.

[0024] The first opening is surrounded by a first bottom plate portion, a first right side plate portion, a first left side plate portion, and a first top plate portion.

[0025] The second case main body has a second body plate, a second bottom plate connected to the second body plate, a second top plate connected to the second body plate and facing the second bottom plate, a second right side plate connected to the second body plate, the second bottom plate, and the second top plate, a second left side plate connected to the second body plate, the second bottom plate, and the second top plate and facing the second right side plate, and a second opening.

[0026] The second opening is surrounded by the second bottom plate portion, the second right side plate portion, the second left side plate portion, and the second top plate portion.

[0027] In the storage device, the first and second bottom plates are connected via a hinge, and the first and second openings are closed by the hinges when the first and second top plates, the first and second right side plates, and the first and second left side plates are joined together.

[0028] The first image display device and the second image display device are disposed (installed) on the first trunk panel, and the image sharpening device is disposed (installed) on the second trunk panel.

[0029] The image sharpening device is disposed on the second body panel portion.

[0030] The image display system according to the present invention may further include a recording device, which records the sharpened image and stores it in the storage device.

[0031] When the image display system according to the present invention further includes a recording device, the first image display device, the second image display device, and the recording device may be disposed on the first body panel. For example, from the first top panel, the second image display device and the first image display device may be disposed adjacent to each other on the first body panel on the first left side panel, and the recording device may be disposed on the first body panel on the first right side panel.

[0032] According to the image display system of the present invention, it is possible to realize further compactness, excellent portability, and excellent mobility in generating a sharpened image (a sharp, easy-to-view image).

[0033] For example, when using an underwater drone equipped with a camera or a high-sensitivity camera, the image display system of the present invention is all-in-one (compact) and offers excellent mobility and portability.In addition, the first image display device and the second image display device make it easy to compare images before and after image sharpening processing, making it highly convenient.

[0034] Hereinafter, the embodiments of the present invention will be described in detail.

[0035] 2. First Embodiment (Example 1 of Image Display System) An image display system according to a first embodiment (first example of an image display system) of the present invention will be described with reference to FIGS.

[0036] Fig. 1 is a block diagram showing a first example of a configuration of an image display system according to a first embodiment to which the present invention is applied, specifically a diagram showing the configuration of image display system 100. Fig. 7 is a diagram showing a flow of image sharpening processing in an image sharpening device included in the image display system according to the first embodiment to which the present invention is applied, specifically a diagram showing a flow 600 of image sharpening processing in image sharpening device 2 included in image display system 100.

[0037] First, explanation will be given using FIG.

[0038] The image display system 100 includes a first image display device 1, an image sharpening device 2, a recording device 3, a second image display device 4, and a storage device (not shown in FIG. 1).

[0039] The first image display device 1 displays a captured image captured by an imaging device 500 (e.g., an underwater drone, a drone, or a high-sensitivity camera). The image sharpening device 2 performs image sharpening processing on the captured image to generate a sharpened image. The recording device 3 records the sharpened image. The second image display device 4 displays the sharpened image.

[0040] The first image display device 1, the image sharpening device 2, the recording device 3 and the second image display device 4 are housed in a housing device (not shown in FIG. 1).

[0041] In the image display system 100, the first image display device 1 is connected to the imaging device 500 via an HDMI (High-Definition Multimedia Interface) cable, and image signals (video signals), audio signals, and control signals of images captured by the imaging device 500 are output (transmitted) to the first image display device 1.

[0042] In addition, in the image display system 100, the image sharpening device 2 is connected to the imaging device 500 via an HDMI (High-Definition Multimedia Interface) cable, and the image signal (video signal), audio signal, and control signal of the image captured by the imaging device 500 are output (transmitted) to the image sharpening device 2.

[0043] The image signal (video signal), audio signal, and control signal of the image captured by the imaging device 500 may be input to the HDMI splitter 300, and the image signal (video signal), audio signal, and control signal may be distributed and output for transmission to the first image display device 1 and the image sharpening device 2.

[0044] The recording device 3 is connected to the image sharpening device 2 via an HDMI (High-Definition Multimedia Interface) cable, and the image signal (video signal), audio signal, and control signal of the sharpened image generated by the image sharpening device 2 are output (transmitted) to the recording device 3.

[0045] The second image display device 4 is connected to the recording device 3 via an HDMI (High-Definition Multimedia Interface) cable, and the image signal (video signal), audio signal, and control signal of the sharpened image recorded by the recording device 3 are output (transmitted) to the second image display device 4.

[0046] Next, a description will be given with reference to FIG.

[0047] An image captured by the imaging device 500 is input to the image sharpening device 2 (step S701), and image capture processing is performed (step S601).

[0048] The captured image that has undergone the image capture process is subjected to image saving process (step S602) and saved (step S702).

[0049] Furthermore, the captured image that has undergone the image capture process is subjected to a sharpening pre-processing (step S605). In the sharpening pre-processing, parameters for the image sharpening process described below are passed to each mode (modes 1 to 6, steps S607 to S612), and one of the sharpening process modes 1 to 6 determined by the parameters is called (steps S607 to S612). Note that in the image sharpening process, there are cases where mode 0 is called without passing parameters for the sharpening process (step S606).

[0050] To execute the image sharpening process, the user performs an operation (step S703), and parameters are processed (step S604) via the user interface processing (step S603). In the parameter processing, a decision is made as to which mode to use from among sharpening modes 1 to 6 in steps S607 to S612, which will be described later. A sharpening mode is selected from six modes (modes 1 to 6) depending on the state of the image. As described above, the sharpening mode is decided from among six modes (modes 1 to 6) by the user's operation.

[0051] There are, for example, two types of parameters: a contrast threshold (clipLimit) and a histogram equalization grid size (tileGridSize). In modes 3 to 5 of the sharpening process, the two types of parameters can be changed.

[0052] The parameter processing (step S604) is reflected in the image capture processing (step S601), and is also reflected in the sharpening pre-processing (step S605) as described above.

[0053] The process of one of modes 0 to 6 of the sharpening process called by the pre-sharpening process (step S605) is executed (steps S606 to S612).

[0054] Mode 0 (step S606) is a mode in which the captured image is output as is without any sharpening process.

[0055] Mode 1 (step S607) is a mode in which the image is decomposed into RGB (R (Red), G (Green), and B (Blue)), each histogram is averaged, and R, G, and B are merged and output.

[0056] Mode 2 (step S608) is a mode in which HSV (hue, saturation, and value) is extracted from the image, and histogram averaging is performed on the value, and the result is output.

[0057] Mode 3 (step S609) is a mode in which the image is divided into small tiles (blocks), local histogram equalization is performed within each tile, and then RGB equalization is performed and output.

[0058] Mode 4 (step S610) is a mode in which the image is divided into small tiles (blocks), local histogram equalization is performed within each tile, and only the lightness of the HSV (hue, saturation, and lightness value) is equalized and output.

[0059] Mode 5 (step S611) is a mode in which mode 1, mode 4, and mode 3 are executed in that order and output. Specifically, in mode 5, a signal that has undergone mode 1 processing is subjected to mode 4 processing, and this signal is then subjected to mode 3 processing and output.

[0060] Mode 6 (step S612) is a mode in which the contrast and brightness are changed before output.

[0061] OpenCV is used as the image processing library in modes 1 to 6. In particular, modes 1 and 2 are executed using equalizeHist from the image processing library, and modes 3 and 4 are executed using createCLAHE from the image processing library.

[0062] After the processing of any mode is performed (steps S606 to S612), post-sharpening processing is performed (step S613), and the sharpened image (captured image in the case of mode 0) is output (step S704).

[0063] Here, the post-sharpening process is a process for outputting the sharpened image (or the captured image in the case of mode 0) to the recording device 3 (or the second image display device 4).

[0064] The image sharpening process flow 600 has been described above. The steps included in the image sharpening process flow 600 are steps S601 to S613, as shown in FIG.

[0065] The above description of the first embodiment of the present invention (Example 1 of image display system) can be applied to the second and third embodiments of the present invention described below, unless there is any particular technical contradiction.

[0066] 3. Second Embodiment (Example 2 of Image Display System) An image display system according to a second embodiment (second example of image display system) of the present invention will be described with reference to FIGS. 2, 3 and 4. FIG.

[0067] Fig. 2 is a perspective view showing a second configuration example of an image display system according to a second embodiment to which the present invention is applied, specifically a perspective view showing the configuration of image display system 101. Fig. 3 is an enlarged view of an HDMI (High-Definition Multimedia Interface) cable and a power cable provided in configuration example 2 of an image display system according to a second embodiment to which the present invention is applied, specifically an enlarged view of an HDMI (High-Definition Multimedia Interface) cable and a power cable provided in image display system 101 in area N shown in Fig. 2. Fig. 4 is a perspective view showing a configuration example of a storage device provided in an image display system according to a second embodiment to which the present invention is applied, specifically a perspective view showing the configuration of storage device 50 provided in image display system 101.

[0068] First, a description will be given with reference to FIG.

[0069] The storage device 50 includes a first case body 51 and a second case body 52.

[0070] The first case main body 51 has a first trunk plate 51-1, a first bottom plate 51-2 connected to the first trunk plate 51-1, a first top plate 51-4 connected to the first trunk plate 51-1 and facing the first bottom plate 51-2, a first right side plate 51-3 connected to the first trunk plate 51-1, the first bottom plate 51-2, and the first top plate 51-4, a first left side plate 51-5 connected to the first trunk plate 51-1, the first bottom plate 51-2, and the first top plate 51-4 and facing the first right side plate 51-3, and a first opening 51-6.

[0071] The first opening 51-6 is surrounded by the first bottom plate portion 51-2, the first right side plate portion 51-3, the first left side plate portion 51-5, and the first top plate portion 51-4.

[0072] The second case main body 52 has a second trunk plate 52-1, a second bottom plate 52-2 connected to the second trunk plate 52-1, a second top plate 52-4 connected to the second trunk plate 52-1 and facing the second bottom plate 52-2, a second right side plate 52-3 connected to the second trunk plate 52-1, the second bottom plate 52-2, and the second top plate 52-4, a second left side plate 52-5 connected to the second trunk plate 52-1, the second bottom plate 52-2, and the second top plate 52-4 and facing the second right side plate 52-3, and a second opening 52-6.

[0073] The second opening 52-6 is surrounded by the second bottom plate portion 52-2, the second right side plate portion 52-3, the second left side plate portion 52-5, and the second top plate portion 52-4.

[0074] In the storage device 50, the first bottom plate portion 51-2 and the second bottom plate portion 52-2 are connected via hinges 53 and 54. The first opening portion 51-6 and the second opening portion 52-6 are formed by the hinges 53 and 54 such that the first top plate portion 51-4 and the second top plate portion 52-4 are joined together, the first right side plate portion 51-3 and the second right side plate portion 52-3 are joined together, and the first left side plate portion 51-5 and the second left side plate portion 52-5 are joined together, and fasteners 55 and 56 (locking mechanisms) disposed (installed) on the first top plate portion 51-4 are inserted into fastener insertion portions 57 and 58 (locking mechanisms), respectively, and the storage device 50 is closed and locked.

[0075] The storage device 50, which is locked by the locking mechanism consisting of the fasteners 55 and 56 and the fastener insertion portions 57 and 58, can be easily carried by holding the handle portion 59 arranged (installed) on the second top panel portion 52-4 wherever it is to be taken (for example, at sea, at the scene of an incident or accident at night, in an area with bad weather, etc.), and is therefore highly portable.

[0076] Next, a description will be given with reference to FIGS.

[0077] The image display system 101 includes a first image display device 11, an image sharpening device 12, a recording device 13, a second image display device 14, an operation pad 15, a battery 16, a power switch 18, and a storage device 50.

[0078] The first image display device 11 displays a captured image captured by an imaging device (e.g., an underwater drone, a drone, a high-sensitivity camera, etc.) (not shown in FIG. 2). The image sharpening device 12 performs image sharpening processing on the captured image to generate a sharpened image. The recording device 13 records the sharpened image. The second image display device 14 displays the sharpened image. The first image display device 11, the image sharpening device 12, the recording device 13, the second image display device 14, the operation pad 15, and the battery 16 are stored in a storage device 50.

[0079] In the image display system 101, the first image display device 11 is connected to the imaging device via an HDMI cable 83, and the image signal (video signal), audio signal, and control signal of the image captured by the imaging device 500 are output (transmitted) to the first image display device 11.

[0080] The image sharpening device 12 is connected to the first image display device 11 via an HDMI cable 84, and image signals (video signals), audio signals, and control signals of the images captured by the imaging device 500 are output from the first image display device 11 and input (transmitted) to the image sharpening device 12.

[0081] The recording device 13 is connected to the image sharpening device 12 via an HDMI cable 86, and the image signal (video signal), audio signal, and control signal of the sharpened image generated by the image sharpening device 12 are output (transmitted) to the recording device 13.

[0082] The second image display device 14 is connected to the recording device 13 via an HDMI cable 87, and the image signal (video signal), audio signal, and control signal of the sharpened image recorded by the recording device 13 are output (transmitted) to the second image display device 14.

[0083] The operation pad 15 is connected to the image sharpening device 12 via a cable 90. The operation pad 15 (sometimes referred to as an operation game pad) enables various operations related to image sharpening to be performed on the image sharpening device 12. Examples of the various operations related to image sharpening include an operation to start sharpening processing, an operation to change the sharpening processing mode, an operation to change sharpening parameters, etc.

[0084] The battery 16 inserted into the battery insertion section 17-1 is connected to the first image display device 11 via a power cable 91, to the image sharpening device 12 via a power cable 94, to the recording device 13 via a power cable 92, and to the second image display device 14 via a power cable 93.

[0085] A second battery (not shown in FIG. 2, same below) can be inserted into battery insertion section 17-2. The second battery is used as a spare in case battery 16 becomes unusable. The second battery can also be used simultaneously with battery 16 to extend the operating time.

[0086] When the power switch 18 is turned on, the image display system 101 starts operating, and when the power switch 18 is turned off, the image display system 101 stops operating.

[0087] The storage device 50 has a first board 61 on the first body panel section 51-1 and a second board 62 on the second body panel section 52-1. The first board 61 and the second board 62 may be plates made of any material, and may include, for example, a carbon plate or an aluminum composite plate.

[0088] HDMI cables 84, 86, and 87, as well as parts of power cables 91, 92, and 93, are wired between the first trunk panel section 51-1 and the first board 61, and between the second trunk panel section 52-1 and the second board 62. Wiring HDMI cables 84, 86, and 87, as well as parts of power cables 91, 92, and 93, between the first trunk panel section 51-1 and the first board 61, and between the second trunk panel section 52-1 and the second board 62 enables the image display system 101 to be made even more compact.

[0089] The assembly of HDMI cables and power cables indicated by reference numeral 82 is made up of HDMI cables 84 and 86, as well as power cables 91, 92 and 93. By bundling HDMI cables 84 and 86, as well as power cables 91, 92 and 93, and covering them with cover 82-1, it becomes possible to make image display system 101 even more compact.

[0090] 2 and 4, starting from the first top panel 51-4, the second image display device 14 and the first image display device 11 are arranged (installed) in close proximity to one another vertically on the first body panel 51-1 on the first left side panel 51-5 side via a first board 61. The recording device 13 is arranged (installed) on the first body panel 51-1 on the first right side panel 51-3 side via the first board 61. Starting from the first top panel 51-4, the second image display device 14 and the first image display device 11 are arranged in close proximity to one another vertically on the first body panel 51-1 on the first left side panel 51-5 side via the first board 61, which makes it possible to easily compare images before and after image sharpening processing.

[0091] The image sharpening device 12 is disposed (installed) on the second trunk panel section 52-1 via a second board 62. In addition, the operation pad 15, the battery 16 inserted into the battery insertion section 17-1, and the second battery inserted into the battery insertion section 17-2 are also disposed (installed) on the second trunk panel section 52-1 via the second board 62.

[0092] The above description of the second embodiment of the present invention (Example 2 of image display system) can be applied to the first embodiment of the present invention described above and the third embodiment of the present invention described below, unless there is any particular technical contradiction.

[0093] 4. Third Embodiment (Example 3 of Image Display System) An image display system according to a third embodiment (third example of image display system) of the present invention will be described with reference to FIGS. 5 and 6. FIG.

[0094] Fig. 5 is a block diagram showing a third example of the configuration of an image display system according to a third embodiment to which the present invention is applied, specifically a block diagram showing the configuration of image display system 102. Fig. 6 is a block diagram showing an example of the electrical configuration of an image sharpening device included in the image display system according to the third embodiment to which the present invention is applied, specifically a block diagram showing the electrical configuration of image sharpening device 1200 included in image display system 102.

[0095] As shown in Fig. 5, the image display system 102 includes a first image display device 1300, an image sharpening device 1200, a second image display device 1400, a recording device 1500, and a learning model 1310. Although not shown in Fig. 5, the first image display device 1300, the image sharpening device 1200, the second image display device 1400, the recording device 1500, and the learning model 1310 are stored in a storage device. The image display system 102 does not necessarily have to include the recording device 1500. Furthermore, the image display system 102 does not necessarily have to include the learning model 1310.

[0096] The image sharpening device 1200 (image acquisition unit 1210) is connected to the imaging device 1000 via a wired connection (e.g., an HDMI (High-Definition Multimedia Interface) cable) or wirelessly (e.g., a communication network), and the first image display device 1300 is connected to the imaging device 1000 via a wired connection (e.g., an HDMI (High-Definition Multimedia Interface) cable) or wirelessly (e.g., a communication network) to display still images or moving images captured by the imaging device 1000 (first connection pattern).

[0097] In addition, the first image display device 1300 is connected to the imaging device 1000 via a wired connection (e.g., an HDMI (High-Definition Multimedia Interface) cable) or wirelessly (e.g., a communication network) to display still images or moving images captured by the imaging device 1000, and the image sharpening device 1200 (image acquisition unit 1210) is connected to the first image display device 1300 via a wired connection (e.g., an HDMI (High-Definition Multimedia Interface) cable) or wirelessly (e.g., a communication network) (second connection pattern).

[0098] The image display system 102 may have both the first and second connection patterns described above, or may have either the first or second connection pattern.

[0099] The imaging device 1000 may be, for example, an underwater drone equipped with a camera, a drone equipped with a camera, a high-sensitivity camera, etc., and as described above, a camera is, for example, an optical device for capturing still images or moving images.

[0100] The operation device 2000 is connected to the image sharpening device 1200 via a wired connection (for example, an HDMI (High-Definition Multimedia Interface) cable) or wirelessly (for example, a communication network). Incidentally, the operation device 2000 may be provided in the image display system 102 and connected to the image sharpening device 1200 via a wired connection (for example, an HDMI (High-Definition Multimedia Interface) cable) or wirelessly (for example, a communication network).

[0101] The operation device 2000 may be, for example, an operation pad or an operation game pad.

[0102] The image sharpening device 1200 includes, as functional components, an image acquisition unit 1210, an image feature detection unit 1220, an image region setting unit 1230, and an image sharpening unit 1240.

[0103] The image acquisition unit 1210 acquires a still image or a moving image captured by the imaging device 1000. The imaging device 1000 is disposed outside the image display system 102 (storage device).

[0104] The image feature detection unit 1220 identifies, for example, feature points in the image based on the image data acquired by the image acquisition unit 1210 .

[0105] The image area setting unit 1230 receives and selects a predetermined area of ​​the image selected through the operation device 2000.

[0106] The image area setting unit 1230 acquires the area of ​​the degraded image operated from the operation device 2000, and sets the acquired area as the area to be sharpened (hereinafter referred to as the "sharpening area"). Furthermore, when the sharpening area is adjusted via the operation device 2000, the image area setting unit 1230 sets the adjusted area as a new sharpening area.

[0107] The image sharpening unit 1240 sharpens the sharpening area set by the image region setting unit 1230 to obtain a sharpened image.

[0108] Furthermore, the image sharpening unit 1240 may be configured by an autoencoder to which a convolutional neural network, which is a type of machine learning model, is applied. The image sharpening unit 1240 may acquire a learning model 1310 provided in the image display system 102 (for example, stored in a storage unit (not shown in FIG. 5) provided in the image display system 102), and may sharpen the sharpening area set by the image region setting unit 1230 using the acquired learning model 1310 to acquire a sharpened image.

[0109] The learning model 1310 is a parameter generated when the image sharpening unit 1240 is trained using the captured image (original image) and the sharpened image as training data. The image sharpening unit 1240 to which the learning model 1310 is applied outputs a sharpened image in which the image region of the sharpening area of ​​the captured image (original image) is sharpened.

[0110] As shown in FIG. 5, the recording device 1500 is connected to the image sharpening device 1200 (image sharpening unit 1240) via a wired connection (e.g., an HDMI (High-Definition Multimedia Interface) cable) or wirelessly (e.g., a communication network) and records the generated sharpened image, and the second image display device 1400 is connected to the recording device 1500 via a wired connection (e.g., an HDMI (High-Definition Multimedia Interface) cable) or wirelessly (e.g., a communication network) and displays the sharpened still image or video recorded by the recording device (third connection pattern).

[0111] Also, as shown in FIG. 5, the second image display device 1400 is connected to the image sharpening device 1200 (image sharpening unit 1240) via a wired connection (e.g., an HDMI (High-Definition Multimedia Interface) cable) or wirelessly (e.g., a communication network) to display still images or moving images sharpened by the image sharpening unit 1240, and the recording device 1500 is connected to the image sharpening device 1200 (image sharpening unit 1240) via a wired connection (e.g., an HDMI (High-Definition Multimedia Interface) cable) or wirelessly (e.g., a communication network) to record the generated sharpened images (fourth connection pattern).

[0112] The image display system 102 may have both the third and fourth connection patterns described above, or may have either the third or fourth connection pattern.

[0113] 6, the image sharpening device 1200 is configured as a computer (server) that executes image sharpening processing, and includes a CPU (Central Processing Unit) 210 that is a main control unit that controls the overall operation of the image sharpening device 1200, a ROM (Read Only Memory) 220 in which various programs and various data are pre-stored, a RAM (Random Access Memory) 230 that is used as a work area when the CPU 210 executes the various programs, and an HDD (Hard Disk Drive) 240 and an SSD (Solid State Drive) 241 that serve as storage means for storing the various programs and various data. Note that the image sharpening device 1200 may include either the HDD (Hard Disk Drive) 240 or the SSD (Solid State Drive) as the storage device (storage unit).

[0114] Furthermore, the image sharpening device 1200 includes an input unit 250 configured with a keyboard, a mouse, etc. and accepting input of various operations, a display unit 260 such as a liquid crystal display device that displays various images, and a communication unit 270 that is connected to the imaging device 1000 and / or the operation device 2000 via a wire (for example, an HDMI (High-Definition Multimedia Interface) cable) or wirelessly (for example, a communication network) and transmits and receives various data to and from the imaging device 1000 and / or the operation device 2000. Note that the image sharpening device 1200 does not necessarily have to include the input unit 250. Also, the image sharpening device 1200 does not necessarily have to include the display unit 260.

[0115] In the image sharpening device 1200, the CPU 210, ROM 220, RAM 230, HDD 240, SSD 241, input unit 250, display unit 260, and communication unit 270 are electrically connected to one another via a system bus 209. Therefore, in the image sharpening device 1200, the CPU 210 can access the ROM 220, RAM 230, HDD 240, and SSD 241, grasp the operation state of the input unit 250, display images on the display unit 260, and transmit and receive various types of data to and from the imaging device 1000 and / or the operation device 2000 via the communication unit 270.

[0116] The image sharpening device 1200 performs predetermined processing by, for example, loading a program stored in the ROM 220, the HDD 240, and / or the SSD 241 into the RAM 230 and executing the program loaded into the RAM 230 with the CPU 210. Specifically, the image sharpening device 1200 loads a program related to image sharpening stored in the ROM 220, the HDD 240, and / or the SSD 241 into the RAM 230 and executes the program related to image sharpening loaded into the RAM 230 with the CPU 210, thereby performing processing related to image sharpening and realizing the respective functions of the image acquisition unit 1210, the image feature detection unit 1220, the image region setting unit 1230, and the image sharpening unit 1240.

[0117] The above description of the third embodiment of the present invention (example 3 of image display system) can be applied to the first and second embodiments of the present invention described above, unless there is any particular technical contradiction.

[0118] The present invention is not limited to the first to third embodiments described above, and various modifications of the first to third embodiments described above and any combination of the first to third embodiments described above are possible within the scope of the gist of the present invention.

[0119] The present invention can be configured as follows:

[0120] [1] The device includes a first image display device, an image sharpening device, a second image display device, and a storage device, the first image display device displays an image captured by an imaging device; the image sharpening device performs an image sharpening process on the captured image to generate a sharpened image; a second image display device displays the sharpened image; The first image display device, the image sharpening device, and the second image display device are housed in the housing device.

[0121] [2] Further comprising a recording device, the recording device records the sharpened image; The image display system according to [1], wherein the recording device is stored in the storage device.

[0122] [3] The storage device includes a first case body and a second case body, The first case body portion, A first body portion; a first bottom plate portion connected to the first body plate portion; a first top plate portion connected to the first body plate portion and facing the first bottom plate portion; a first right side plate portion connected to the first body plate portion, the first bottom plate portion, and the first top plate portion; a first left side plate portion connected to the first body plate portion, the first bottom plate portion, and the first top plate portion and facing the first right side plate portion; a first opening; the first opening is surrounded by the first bottom plate portion, the first right side plate portion, the first left side plate portion, and the first top plate portion; The second case main body portion, A second body portion; a second bottom plate portion connected to the second body plate portion; a second top plate portion connected to the second body plate portion and facing the second bottom plate portion; a second right side plate portion connected to the second body plate portion, the second bottom plate portion, and the second top plate portion; a second left side plate portion connected to the second body plate portion, the second bottom plate portion, and the second top plate portion and facing the second right side plate portion; a second opening, the second opening is surrounded by the second bottom plate portion, the second right side plate portion, the second left side plate portion, and the second top plate portion; The first bottom plate portion and the second bottom plate portion are connected via a hinge, The first opening and the second opening are closed by the hinges, with the first top plate portion and the second top plate portion being joined together, the first right side plate portion and the second right side plate portion being joined together, and the first left side plate portion and the second left side plate portion being joined together. The first image display device and the second image display device are disposed on the first body panel portion, The image display system according to [1], wherein the image sharpening device is disposed in the second body panel portion.

[0123] [4] The image display system according to [3], wherein the second image display device and the first image display device are arranged adjacent to each other on the first body panel, in that order from the first top panel.

[0124] [5] The storage device includes a first case body and a second case body, The first case body portion, A first body portion; a first bottom plate portion connected to the first body plate portion; a first top plate portion connected to the first body plate portion and facing the first bottom plate portion; a first right side plate portion connected to the first body plate portion, the first bottom plate portion, and the first top plate portion; a first left side plate portion connected to the first body plate portion, the first bottom plate portion, and the first top plate portion and facing the first right side plate portion; a first opening; the first opening is surrounded by the first bottom plate portion, the first right side plate portion, the first left side plate portion, and the first top plate portion; The second case main body portion, A second body portion; a second bottom plate portion connected to the second body plate portion; a second top plate portion connected to the second body plate portion and facing the second bottom plate portion; a second right side plate portion connected to the second body plate portion, the second bottom plate portion, and the second top plate portion; a second left side plate portion connected to the second body plate portion, the second bottom plate portion, and the second top plate portion and facing the second right side plate portion; a second opening, the second opening is surrounded by the second bottom plate portion, the second right side plate portion, the second left side plate portion, and the second top plate portion; The first bottom plate portion and the second bottom plate portion are connected via a hinge, The first opening and the second opening are closed by the hinges, with the first top plate portion and the second top plate portion being joined together, the first right side plate portion and the second right side plate portion being joined together, and the first left side plate portion and the second left side plate portion being joined together. The first image display device, the second image display device, and the recording device are disposed on the first body panel, The image display system according to [2], wherein the image sharpening device is disposed in the second body panel portion.

[0125] [6] The second image display device and the first image display device are arranged adjacent to each other on the first body plate portion on the first left side plate portion side in this order from the first top plate portion, The image display system described in [5], wherein the recording device is arranged on the first body panel portion on the side of the first right side panel portion. [Explanation of symbols]

[0126] 1, 11, 1300... First image display device, 2, 12, 1200···Image sharpening device, 3, 13,1500... recording device, 4, 14, 1400... Second image display device, 15. Operation pad, 16···battery, 17-1, 17-2: Battery insertion section, 18···Power switch, 50...storage device, 51... First case body, 51-1...1st body plate section, 51-2...1st bottom plate section, 51-3...1st right side plate section, 51-4···First top plate part, 51-5...1st left side plate section, 52... second case body portion, 52-1...Second body plate section, 52-2...Second bottom plate section, 52-3...Second right side plate section, 52-4... Second top plate section, 52-5...2nd left side plate section, 53, 54: Hinge portion, 55, 56: Fastener (locking mechanism), 57, 58: Fastener insertion portion (locking mechanism), 59...handle part, 61···First board, 62···Second board, 82···HDMI cable and power cable assembly, 82-1···Cover, 83, 84, 86, 87...HDMI cable, 90...cable, 91, 92, 93, 94... Power cable, 100, 101, 102... Image display system, 209···System bus, 210···CPU, 220···ROM, 230···RAM, 240···HDD, 241···SSD, 250···input section, 260...display section, 270···Communications Department, 300···HDMI splitter, 500 ··· Imaging device (underwater drone, drone or high-sensitivity camera), 600···Image sharpening process flow, 1000 Imaging device, 1210... Image acquisition unit, 1220···Image feature detection unit, 1230: Image area setting unit; 1240···Image sharpening unit, 1310···Learning model, 2000...Operating device.

Claims

1. The device includes a first image display device, an image sharpening device, a second image display device, and a storage device, the first image display device displays an image captured by an imaging device; the image sharpening device performs an image sharpening process on the captured image to generate a sharpened image; a second image display device displays the sharpened image; The first image display device, the image sharpening device, and the second image display device are housed in the housing device.

2. Further comprising a recording device, the recording device records the sharpened image; The image display system according to claim 1 , wherein the recording device is housed in the housing device.

3. The storage device includes a first case body and a second case body, The first case body portion, A first body portion; a first bottom plate portion connected to the first body plate portion; a first top plate portion connected to the first body plate portion and facing the first bottom plate portion; a first right side plate portion connected to the first body plate portion, the first bottom plate portion, and the first top plate portion; a first left side plate portion connected to the first body plate portion, the first bottom plate portion, and the first top plate portion and facing the first right side plate portion; a first opening; the first opening is surrounded by the first bottom plate portion, the first right side plate portion, the first left side plate portion, and the first top plate portion; The second case main body portion, A second body portion; a second bottom plate portion connected to the second body plate portion; a second top plate portion connected to the second body plate portion and facing the second bottom plate portion; a second right side plate portion connected to the second body plate portion, the second bottom plate portion, and the second top plate portion; a second left side plate portion connected to the second body plate portion, the second bottom plate portion, and the second top plate portion and facing the second right side plate portion; a second opening, the second opening is surrounded by the second bottom plate portion, the second right side plate portion, the second left side plate portion, and the second top plate portion; The first bottom plate portion and the second bottom plate portion are connected via a hinge, The first opening and the second opening are closed by the hinges, with the first top plate portion and the second top plate portion being joined together, the first right side plate portion and the second right side plate portion being joined together, and the first left side plate portion and the second left side plate portion being joined together. The first image display device and the second image display device are disposed on the first body panel portion, The image display system of claim 1 , wherein the image sharpening device is disposed on the second trunk portion.

4. The image display system according to claim 3 , wherein the second image display device and the first image display device are disposed adjacent to each other on the first body panel in this order from the first top panel.

5. The storage device includes a first case body and a second case body, The first case body portion, A first body portion; a first bottom plate portion connected to the first body plate portion; a first top plate portion connected to the first body plate portion and facing the first bottom plate portion; a first right side plate portion connected to the first body plate portion, the first bottom plate portion, and the first top plate portion; a first left side plate portion connected to the first body plate portion, the first bottom plate portion, and the first top plate portion and facing the first right side plate portion; a first opening; the first opening is surrounded by the first bottom plate portion, the first right side plate portion, the first left side plate portion, and the first top plate portion; The second case main body portion, A second body portion; a second bottom plate portion connected to the second body plate portion; a second top plate portion connected to the second body plate portion and facing the second bottom plate portion; a second right side plate portion connected to the second body plate portion, the second bottom plate portion, and the second top plate portion; a second left side plate portion connected to the second body plate portion, the second bottom plate portion, and the second top plate portion and facing the second right side plate portion; a second opening, the second opening is surrounded by the second bottom plate portion, the second right side plate portion, the second left side plate portion, and the second top plate portion; The first bottom plate portion and the second bottom plate portion are connected via a hinge, The first opening and the second opening are closed by the hinges, with the first top plate portion and the second top plate portion being joined together, the first right side plate portion and the second right side plate portion being joined together, and the first left side plate portion and the second left side plate portion being joined together. the first image display device, the second image display device, and the recording device are disposed on the first body panel, 3. The image display system of claim 2, wherein the image sharpening device is disposed on the second trunk portion.

6. The second image display device and the first image display device are disposed adjacent to each other on the first body plate portion on the first left side plate portion side in this order from the first top plate portion, The image display system according to claim 5 , wherein the recording device is disposed on the first body plate portion on the side of the first right side plate portion.

Images