Display control device, method executed by display control device, and program

Abstract

To provide a display control technique for improving visibility of a thumbnail image.SOLUTION: A display controlling apparatus acquires at least a first image from among one or more images acquired by one or more imaging apparatus (S102) and determines, on the basis of at least one of a size of a display region of a thumb nail image and a size of a second angle of view region smaller than a first angle of view region that is a region of an angle of view of the first image on a display screen, a cutout region from the first image including the second angle of view region (S103). Then, the display control device performs a process of displaying an image cut out from the first image in the determined cutout region as the thumbnail image on the display screen (S104).SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present disclosure relates to a technique for controlling the display of an image captured by an imaging device. [Background technology]

[0002] In recent years, network cameras that allow remote control of imaging devices have become popular. With this method, users can remotely configure imaging settings such as the imaging direction of the imaging device and camera platform by operating a control controller or the like via a network.

[0003] Some network cameras have a preset function that allows users to pre-register the camera's pan, tilt, and zoom angle settings. By executing a registered preset, the network camera allows users to change the angle of view without manually operating the PTZ (pan, tilt, and zoom) controls. If the camera has a function that generates thumbnail images from the video image when the preset is registered, the user can visually check the angle of view that will be obtained by executing the preset from the generated thumbnail images. In addition, by displaying a list of thumbnail images obtained by such presets on a display device, the user can check the angles of view of multiple presets side by side.

[0004] On the other hand, some network cameras are equipped with a crop function that allows them to output a cropped image of a portion of the frame rather than the entire captured image (entire frame). The position and size of the cropped area can be controlled by the user during recording, similar to PTZ operation. Network cameras with a crop function include those equipped with multiple output channels. When multiple crop areas are set, such a camera can output crop area 1 on output channel 1 while simultaneously outputting crop area 2 on output channel 2.

[0005] If a thumbnail image created from the entire image is registered on a camera with a crop function, and a preset is executed with the crop function turned on (with a crop area set), the entire frame image will not be output. In this case, the camera will output an image cropped to the set crop area as a single screen, rather than outputting the entire frame image.

[0006] Here, in order for the user to check the composition after executing the preset from the thumbnail image with the crop function turned on, one possible method is to display a frame around the cropped area of ​​the thumbnail image. Patent Document 1 discloses a technique in which a small thumbnail image of the entire fisheye image is superimposed on a thumbnail image showing a portion of the fisheye image, and further, a frame line indicating the boundary position of the area where the portion of the fisheye image has been cropped is drawn within the thumbnail image of the entire fisheye image. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] Japanese Patent Application Publication No. 2019-57891 Summary of the Invention [Problem to be solved by the invention]

[0008] However, preset thumbnail images are often reduced in size when displayed. For example, in the method described in Patent Document 1, the cropped area becomes too small, reducing visibility.

[0009] The present disclosure provides a display control technique that improves the visibility of thumbnail images. [Means for solving the problem]

[0010] A display control device according to one embodiment of the present disclosure includes an acquisition means for acquiring at least a first image from one or more images acquired by one or more imaging devices; a determination means for determining a cut-out area from the first image including a second angle of view area based on at least one of the size of a display area of ​​a thumbnail image on a display screen and the size of a second angle of view area that is smaller than a first angle of view area of ​​the first image; and a display processing means for processing the image cut out from the first image in the determined cut-out area to be displayed on the display screen as the thumbnail image. [Effects of the Invention]

[0011] According to the present disclosure, it is possible to improve the visibility of thumbnail images. [Brief explanation of the drawings]

[0012] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of a control system according to an embodiment. [Figure 2] FIG. 2 is a block diagram illustrating an example of the internal configuration of a controller according to an embodiment. [Figure 3] 10A to 10C are diagrams showing examples of display patterns for a list of preset thumbnails. [Figure 4] 10 is a flowchart showing thumbnail display processing in the first embodiment. [Figure 5] FIG. 4 is a diagram illustrating a method for calculating a clipping region in the first embodiment. [Figure 6] 10(A) to 10(C) are diagrams showing examples of display patterns of a preset thumbnail list in the first embodiment. [Figure 7] 10 is a flowchart showing thumbnail display processing in the second embodiment. [Figure 8] 10(A) to 10(C) are diagrams showing examples of display patterns of a preset thumbnail list in the second embodiment. [Figure 9] 10A to 10I are diagrams showing examples of display patterns of a preset thumbnail list in the third embodiment. [Figure 10] FIG. 13 is a diagram illustrating a method for calculating a region to be cut out for a thumbnail in the fourth embodiment. [Figure 11] 10A and 10B are diagrams showing the difference in display form between when a thumbnail is cropped and when it is not, in the fifth embodiment. [Figure 12] 13 is a flowchart showing thumbnail display processing in the sixth embodiment. [Figure 13] FIG. 20 is a diagram illustrating a method for calculating a clipping region in the sixth embodiment. [Figure 14] 13(A) to 13(C) are diagrams showing examples of display patterns of a preset thumbnail list in the sixth embodiment. [Figure 15] FIG. 13 is a diagram illustrating an example of the configuration of a control system according to a seventh embodiment. [Figure 16] 13 is a flowchart showing thumbnail display processing in the seventh embodiment. [Figure 17] 23 is a flowchart showing thumbnail display processing in the eleventh embodiment. [Figure 18] FIG. 23 is a diagram showing an example of a display pattern of a list of preset thumbnails in the eleventh embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Not all of the features in the embodiments of the present disclosure are essential, and multiple features may be combined as desired. Furthermore, the configurations shown in the following embodiments are merely examples, and the present disclosure is not limited to the illustrated configurations. In the drawings, the same reference symbols are used to designate the same or similar configurations, and redundant explanations will be omitted.

[0014] (First embodiment) 1 is a diagram showing an example of the configuration of a control system in this embodiment. The control system in this embodiment includes a controller 100 and a camera 10. The controller 100 and the camera 10 are connected via a network 200. The camera 10 is an example of an imaging device. The controller 100 is an example of a display control device that controls the display of a captured image acquired by the imaging device.

[0015] The control system is not limited to this configuration. For example, the controller 100 and the camera 10 may be connected via SDI (Serial Digital Interface) or HDMI (High-Definition Multimedia Interface) (registered trademark). In this embodiment, one camera 10 is connected, but the number and type of cameras are not particularly limited.

[0016] Camera 10 has one or more video output interfaces, and can output captured images to an external device (not shown) via the video output interfaces at a viewing angle controlled by a user via controller 100. The video output interfaces may be connected to network 200.

[0017] The controller 100 controls the camera 10 based on a camera control communication protocol and can acquire information about the camera 10. The controller 100 is typically a dedicated controller compatible with one or more specific camera models, including the camera 10. However, the controller 100 is not limited to this and may be, for example, a PC, a smartphone, or a tablet computer.

[0018] The network 200 may be configured by any one or a combination of two or more of the following: a LAN, a WAN, a telephone line, a dedicated digital line, an ATM, a frame relay line, a cable television line, and a wireless line for data broadcasting. For example, Ethernet (registered trademark) may be used as a LAN. For example, the Internet may be used as a WAN.

[0019] 2 is a block diagram showing an example of the internal configuration of the controller 100 according to this embodiment. The controller 100 includes a communication unit 101, a non-volatile memory 102, a display unit 103, an operation interface 104, a control unit 105, and an internal bus 106 that enables intercommunication between these blocks.

[0020] The communication unit 101 is a network interface that communicates with an external device (here, the camera 10) via the network 200. Here, communication includes sending control commands to the camera 10, receiving signals from the camera 10, and receiving captured images. When the controller 100 communicates with the camera 10 based on instructions from the control unit 105, the controller 100 communicates via the communication unit 101.

[0021] The nonvolatile memory 102 is a nonvolatile storage device such as a flash memory, HDD, SSD, or SD card. The nonvolatile memory 102 is used as a permanent storage area for storing the OS, various programs, various data, and other programs used by the control unit 105 to control the controller 100, and is also used as a short-term storage area for various data. In this embodiment, the nonvolatile memory 102 is configured as an SSD, but is not limited to this.

[0022] The display unit 103 is composed of, for example, a liquid crystal panel and a backlight, and displays captured images acquired from the camera and a setting screen. In this embodiment, the display unit 103 displays images captured by the camera 10 and the settings of the camera 10. That is, the display unit 103 provides a display screen, and in particular displays thumbnail images as described below. Note that, although an example is shown in which the controller 100 has the display unit 103 in this embodiment, the controller 100 and the display device (external monitor) may be configured as separate entities. In this case, the controller 100 has an interface that outputs the video acquired by the camera 10 to the external monitor.

[0023] The operation interface 104 is an interface for receiving operations from the user on the controller 100. The operation interface 104 is, for example, a plurality of operation members such as physical buttons and a joystick provided on the housing of the controller 100, and / or a GUI (Graphical User Interface) displayed on the display unit 103. The GUI displayed on the display unit 103 may be a touch panel that allows the user to perform touch operations. The user inputs operation information to the control unit 105 by operating the operation members and / or the GUI. This allows the user to configure the controller 100 itself and control a camera connected to the controller 100. This will be described in detail later.

[0024] The control unit 105 outputs to the communication unit 101 the IP address of the target to be controlled and a packet to be sent to that IP address. This packet contains the type of target function, such as pan or tilt, and a command indicating what control to perform on that function. When the camera 10 receives this command, it performs an operation that is predetermined on the camera 10 side. When the communication unit 101 receives a response packet sent from the camera 10, it outputs that information to the control unit 105, and based on that information, the control unit 105 obtains the status of the camera 10 and determines whether communication was successful.

[0025] The control unit 105 includes a processor and volatile memory (not shown). The processor of the control unit 105 loads a program stored in the nonvolatile memory 102 into the volatile memory, and executes the loaded program to control each block of the controller 100. The volatile memory (not shown) is a storage device such as a DRAM, and temporarily stores the computer program executed by the processor of the control unit 105. The OS, various programs, and various data are loaded into the volatile memory, and the volatile memory provides a work area for the control unit 105 to execute the OS and various programs.

[0026] The control unit 105 displays a menu screen (not shown) on the display unit 103. When the control unit 105 receives an operation from the user in accordance with this menu screen via the operation interface 104, it controls the settings of the controller 100 and the camera 10. For example, when the control unit 105 displays a list of preset thumbnail images on the screen, it performs processing to send an instruction to the camera 10 to acquire the preset thumbnail images.

[0027] A preset thumbnail image is a thumbnail image generated from video captured at an angle of view corresponding to the pan, tilt, and zoom preset by the preset function. As described above, the preset function is a function that allows the user to pre-register angle of view settings such as pan, tilt, and zoom of the camera 10. In the following description, "thumbnail image" and "preset thumbnail image" may be simply referred to as "thumbnail" and "preset thumbnail." Executing a preset refers to the camera 10 capturing images at the registered PTZ angle of view after the user inputs an operation to the controller 100 after registering a preset.

[0028] The displayed preset thumbnail list includes not only the entire thumbnail generated with the angle of view at the time of preset registration (image "1" in FIG. 3(A) described below), but also thumbnail images scaled from the entire thumbnail (cut out and enlarged for display). Images cut out from the entire thumbnail and enlarged for display are shown, for example, in "2" to "4" in FIG. 3(A). Display examples of the preset thumbnail list will be described below.

[0029] 3A to 3C show examples of display patterns of the preset thumbnail list when the crop function is not used. The crop function will be described in detail later.

[0030] 3(A) to 3(C), the number of thumbnails (number of displayed thumbnails) is four. The number of displayed thumbnails corresponds to the number of presets registered by the user. When one preset is registered, the control unit 105 generates one thumbnail from a video captured at the angle of view corresponding to the registered preset and displays it on the display unit 103.

[0031] There are several matrix formats for displaying preset thumbnails registered in the camera 10. For example, the preset thumbnails are displayed in a 2x2 matrix in FIG. 3(A), a 3x3 matrix in FIG. 3(B), and a 4x4 matrix in FIG. 3(C). Each thumbnail is scaled and displayed according to the display pattern. For example, the greater the number of rows and columns, the smaller the thumbnails displayed. The user can select any one of the display patterns. In any of the display patterns, the user can check the composition after the preset is executed from the displayed preset thumbnail. The user can select and specify any thumbnail from the displayed list of preset thumbnails to execute the preset corresponding to that thumbnail.

[0032] The display pattern of the preset thumbnails is not limited to a matrix format, but may be a vertically arranged format (format of only one column). Even in a vertically arranged format, the larger the number of thumbnails, the smaller the displayed thumbnail size may be. Note that the controller 100 may have a program for specifying and changing the display pattern according to user settings. Alternatively, the controller 100 may determine the display pattern according to the number of presets.

[0033] Fig. 4 is a flowchart showing an example of a preset thumbnail display process including a crop area. This process is realized by the processor of the control unit 105 reading a program stored in the non-volatile memory 102 according to the processing content, loading it into the volatile memory, and executing it. The preset thumbnail display process in the control unit 105 and display unit 103 will be explained below using the flowchart in Fig. 4. In the explanation of the thumbnail display process shown in Fig. 4 and subsequent figures, an example will be explained in which the crop function is used and a crop frame is superimposed on the generated thumbnail.

[0034] As described above, the crop function is a function that allows the camera 10 to output a cropped image of a portion of a frame, rather than the entire captured image (entire frame), in response to a user's operation input to the controller 100. The user can use the crop function to crop a portion of the frame at any position, size, and shape within the frame. The shape of the crop area is typically rectangular. When the crop area is rectangular, the aspect ratio of the crop area is basically a fixed value, but the aspect ratio may also be set by the user.

[0035] In S101, the control unit 105 sets the number of thumbnails (number of thumbnails to be displayed), their positions (display positions), and their sizes (display size, size of the display area). The number of thumbnails to be displayed, their positions, and their sizes are determined for each of the above-mentioned display patterns (e.g., FIGS. 3A to 3C). For example, if the resolution of the display unit 103 is 1920×1080, the display size of the thumbnails is set as follows: For example, if the display is in a "2×2" pattern, the display size of the thumbnails is set to "large" (e.g., 960×540), similarly for "3×3" it is set to "medium" (e.g., 640×360), and for "4×4" it is set to "small" (e.g., 480×270).

[0036] In S102, the control unit 105 acquires a preset thumbnail and information on the position and size of the cropping area from the camera 10. Then, based on the acquired information, the control unit 105 draws a frame in the cropping area of ​​the thumbnail. This frame surrounds the cropping area and is an example of information indicating the cropping area. Hereinafter, this frame will be referred to as a "cropping frame." For example, if the cropping frame is rectangular, the coordinates (x, y) of the upper left corner of the frame and the width and height (w, h) of the frame will be expressed as (x, y, w, h).

[0037] Mainly, the control unit 105 is an example of an acquisition unit that cooperates with a predetermined program to acquire at least a first image among one or more images acquired by one or more imaging devices.

[0038] Here, assume that the resolution of the video captured by camera 10 is 1920 x 1080 and the crop area is (0, 0, 960, 540). In this case, if the display size of the thumbnail set in S101 is 1280 x 720, the area of ​​(0, 0, 640, 360) in the thumbnail can be drawn as the crop frame. Note that the crop frame may be drawn on the thumbnail in advance when camera 10 generates the thumbnail from the video. The crop frame may be a solid line or a dashed line. Alternatively, the information indicating the crop area may be an image with a translucent color (for example, a rectangular image with a translucent color).

[0039] In S103, the control unit 105 calculates a cutout area for the thumbnail based on the display size set in S101. In this embodiment, calculation of the cutout area mainly means calculation of the enlargement ratio of the cutout area (enlargement ratio of the thumbnail image). As will be described later, it should be noted that the cutout area and the crop area have different meanings.

[0040] The smaller the display size of a thumbnail, the harder it is for the user to see the thumbnail. Therefore, in order to generate and display thumbnails of an appropriate size according to the display size of the thumbnail list, the control unit 105 performs processing to crop an appropriate size from a frame acquired from the video when registering a preset and enlarge the cropped area. Here, if a crop area is set, the control unit 105 crops an area including the crop area to generate a thumbnail. This will be explained below.

[0041] FIG. 5 is an explanatory diagram showing a method for calculating a crop area 503 for a thumbnail. In FIG. 5, a crop area 505 is indicated by a thick frame and a crop area 503 is indicated by a dashed line for a thumbnail (entire thumbnail 501). The crop area 503 is an area that is displayed on the display unit 103 as a new thumbnail, and the rest of the area is not displayed. The magnification ratio can be calculated by dividing the area of ​​the entire thumbnail 501 by the area of ​​the crop area 503. In this embodiment, the smaller the display size of the thumbnail, the smaller the size of the crop area, i.e., the larger the magnification ratio of the crop area. For example, if the display size of the thumbnail is "large" (960×540), the magnification ratio is set to 100%, if it is "medium" (640×360), the magnification ratio is set to 200%, and if it is "small" (480×270), the magnification ratio is set to 500%.

[0042] The position of the crop area 503 (thumbnail position) and the upper limit of the magnification ratio are set so that the crop area 505 is included in the crop area 503. For example, the crop area is determined so that the center of the crop area is positioned as close to the center of the crop area as possible. Alternatively, the crop area is determined so that the crop area is positioned in a position that follows another predetermined algorithm.

[0043] In S103, the control unit 105 is an example of a determining unit that cooperates with a predetermined program to determine a crop area from the first image. The preset thumbnail is an example of a first image. The field of view of the preset thumbnail is an example of a first field of view area. The crop area is an example of a second field of view area. Note that in the sixth and subsequent embodiments, the preset thumbnail is an example of a second image.

[0044] In S104, control unit 105 displays the cropped area enlarged by the magnification calculated in S103 as a thumbnail on display unit 103. At this time, control unit 105 also displays cropping frame 505a superimposed on the thumbnail. Figures 6(A) to 6(C) are diagrams showing display examples of thumbnails including cropping frame 505a.

[0045] In FIG. 6A, the display size of the thumbnail is "large" and the magnification of the cutout area is 100%, meaning that the entire original thumbnail image is displayed as is as the thumbnail.

[0046] In FIG. 6B, the display size of the thumbnail is "medium" and the enlargement rate of the cutout area is set to 200%, for example.

[0047] In FIG. 6C, the thumbnail display size is "small," and the magnification of the cropped area is set to, for example, 500%. In FIG. 6C, for example, only the cropped area is cropped and displayed as a thumbnail. Here, an example is shown in which the cropped area and the cropped area are the same. When the cropped area and the cropped area 505 are the same in this way, the cropping frame does not need to be displayed. Alternatively, the cropping frame may be displayed along the outline of the entire cropped area.

[0048] An upper limit on the magnification ratio (a lower limit on the size of the crop area) may be set. For example, if the crop area is too small, setting the magnification ratio so that the crop area is the same as the crop area will result in the resolution of the displayed thumbnail being too small and difficult to see. To prevent this, an upper limit on the magnification ratio can be set.

[0049] On the other hand, the lower limit of the magnification rate may be set to a value greater than 100%, so that thumbnails are enlarged and displayed even when the thumbnail display size set by the user is "large."

[0050] In S104, the control unit 105 is an example of a display processing means that works in cooperation with a predetermined program to perform processing to display the image cut out from the first image in the determined cut-out area on the display screen as the thumbnail image.

[0051] As described above, according to this embodiment, the controller 100 acquires a preset thumbnail and a crop area from a camera 10 that has a crop function, and sets a larger magnification ratio for the crop area as the thumbnail display size becomes smaller. This allows the user to see not only the crop area but also the area outside the crop area in the preset thumbnail when the thumbnail display size is "large" or "medium," making it easier to see the composition after cropping. On the other hand, when the thumbnail is relatively small, for example, smaller than "medium," the user can see the enlarged crop area. In other words, this improves visibility when the user checks a thumbnail image that includes a crop area.

[0052] In this embodiment, the display size of the thumbnails is set to three levels: "large," "medium," and "small," but it may also be set to two levels, or four or more levels.

[0053] (Second embodiment) In the second embodiment, an example will be described in which the magnification ratio of a thumbnail is calculated based on the size of a crop area. The configuration of the controller according to this embodiment is the same as that of the first embodiment, so a description thereof will be omitted. Below, differences from the first embodiment will be described.

[0054] 7 is a flowchart showing an example of thumbnail display processing including a cropping frame in the second embodiment. Since only S203 is a process that differs from the first embodiment, only S203 will be described below.

[0055] In S203, the control unit 105 calculates the magnification ratio of the crop area from the size (hereinafter referred to as crop size) of the crop area (cropping frame 505a). FIGS. 8A to 8C are diagrams showing thumbnail displays for different crop sizes. In FIG. 8A, the crop size is "large," and the magnification ratio of the crop area is set to 100%. In FIG. 8B, the crop size is "medium," and the magnification ratio of the crop area is set to 200%, which is larger than the magnification ratio for "large." In FIG. 8C, the crop size is "small," and the magnification ratio of the crop area is set to 500%, which is larger than the magnification ratio for "medium."

[0056] As described above, according to this embodiment, the controller 100 acquires a preset thumbnail and a crop area from a camera 10 that has a crop function, and sets a larger magnification ratio for the crop area as the crop size becomes smaller. This allows the user to see not only the crop area but also the area outside the crop area in the preset thumbnail when the crop size is "large" or "medium," making it easier to see the composition after cropping. On the other hand, when the crop size is relatively small, for example, smaller than "medium," the user can see the enlarged crop area. In other words, this improves visibility when the user checks a thumbnail image that includes a crop area.

[0057] (Third embodiment) In the third embodiment, an example will be described in which a cutout area is calculated according to the display size of a thumbnail and the size of a crop area by combining the first and second embodiments. In this embodiment, the smaller the display size of the thumbnail and the smaller the crop area, the smaller the size of the cutout area, i.e., the larger the magnification ratio of the cutout area.

[0058] 9A to 9I are diagrams showing an example of thumbnail display processing including a cropping frame 505a in the third embodiment. In this embodiment, to prevent the thumbnail resolution from becoming too small and difficult to view, the upper limit of the magnification is set to, for example, 500%.

[0059] 9(A) to 9(C) show display examples in which the thumbnail display size is "large." In FIG. 9(A), the crop size is "large" and the magnification is set to, for example, 100%. In FIG. 9(B), the crop size is "medium" and the magnification is set to, for example, 110% so as to be larger than FIG. 9(A). In FIG. 9(C), the crop size is "small" and the magnification is set to, for example, 200% so as to be larger than FIG. 9(B).

[0060] 9(D) to 9(F) show display examples in which the thumbnail display size is "medium." In FIG. 9(D), the crop size is "large," and the magnification is set to, for example, 105% so as to be larger than that of FIG. 9(A). In FIG. 9(E), the crop size is "medium," and the magnification is set to, for example, 200% so as to be larger than that of FIGS. 9(B) and (D). In FIG. 9(F), the crop size is "small," and the magnification is set to, for example, 480% so as to be larger than that of FIGS. 9(C) and (E).

[0061] 9(G) to 9(I) show display examples in which the thumbnail display size is "small." In FIG. 9(G), the crop size is "large," and the magnification is set to, for example, 110% so as to be equal to or larger than FIG. 9(D). In FIG. 9(H), the crop size is "medium," and the magnification is set to, for example, 500% so as to be equal to or larger than FIG. 9(E) and (G). In FIG. 9(I), the crop size is "small," and the magnification is set to, for example, 500% so as to be equal to or larger than FIG. 9(F) and (H), satisfying the upper limit of the magnification.

[0062] As described above, according to this embodiment, the smaller the thumbnail display size and the crop area size, the larger the magnification rate of the cut-out area is set. This makes it easier to see the inside and outside of the crop area depending on the thumbnail display size and the crop area size, and allows the post-cropping composition to be properly expressed.

[0063] (Fourth embodiment) In the first to third embodiments, a preset thumbnail includes one crop area (cropping frame), but in the fourth embodiment, a preset thumbnail includes multiple crop areas. Fig. 10 is a diagram showing an example of calculation of cutout area 503 for a thumbnail having two crop areas 1001 and 1002 in the fourth embodiment.

[0064] Cutout region 503 (or inclusion region 1005) is a rectangular region that encompasses crop regions 1001 and 1002 and is set to the same aspect ratio as crop regions 1001 and 1002. Control unit 105 of this embodiment calculates cutout region 503 based on the size of inclusion region 1005 of crop regions 1001 and 1002, instead of the size of the crop regions in the second embodiment. The smaller the size of inclusion region 1005 of the crop region, the smaller the size of cutout region 503, i.e., the larger the magnification ratio of cutout region 503 is set.

[0065] If the aspect ratio of the crop region is not fixed and two or more crop regions have different aspect ratios, the size of the cutout region may be set to an aspect ratio calculated based on those aspect ratios using a predetermined formula, such as a formula for calculating the average or median of the two or more aspect ratios.

[0066] (Fifth embodiment) In the fifth embodiment, the control unit 105 changes the display mode of the thumbnail when the thumbnail is cropped and displayed in a crop area, as opposed to when the entire thumbnail image is displayed as is (when the crop area magnification is 100%). The case where the thumbnail is cropped and displayed means that the crop area magnification exceeds 100%. This makes it clear that the thumbnail is cropped and displayed.

[0067] Fig. 11(A) shows an example in which the entire thumbnail acquired by the control unit 105 is displayed as is. On the other hand, as shown in Fig. 11(B), when the control unit 105 cuts out a thumbnail in a cutout region, the control unit 105 can make the user aware that the thumbnail has been cut out by superimposing an image such as a dashed line 1101 along the outline of the thumbnail. In this embodiment, the image indicating that the thumbnail has been cut out in the cutout region is not limited to a dashed line, and examples include a thick line, a colored line, a flashing image, or a combination of these.

[0068] (Sixth embodiment) In the sixth embodiment, an example will be described in which thumbnails are displayed using images captured by the camera 10 at a wide angle. Differences from the first embodiment will be described below. The sixth embodiment differs from the first embodiment mainly in that the camera 10 of the sixth embodiment has a function for capturing images at a wide angle and does not have a crop function. The controller 100 of the sixth embodiment performs thumbnail display processing using an image captured by executing a preset (an image in the actual angle of view area) and an image obtained by wide-angle capturing (an overhead image). Controlling the capturing angle of view to a wide angle can be achieved by using a wide-angle lens or by capturing an image by changing the zoom position to a wider angle than the actual angle of view area. The actual angle of view area 1305 will be described later with reference to FIG. 13.

[0069] The angle of view of the overhead image does not necessarily have to be wide, but in the following description, the overhead image will be described as an image captured at a wide angle.

[0070] Fig. 12 is a flowchart showing an example of thumbnail display processing in this embodiment. This processing is realized by the processor of the control unit 105 reading out a program corresponding to the processing content stored in the non-volatile memory 102, loading the program into the volatile memory, and executing the program. Below, the thumbnail display processing in the control unit 105 and the display unit 103 will be described using the flowchart of Fig. 12. In the description of the thumbnail display processing shown in Fig. 12 and subsequent figures, an example will be described in which information indicating the actual angle of view area is superimposed on the generated thumbnail.

[0071] The processing of S101 is the same as that of the first embodiment (FIG. 4). In S1201, the control unit 105 acquires a preset thumbnail and an overhead image from the camera 10. The preset thumbnail and the overhead image are captured when the preset is registered and stored by the camera 10. The overhead image may also be captured when the camera 10 is installed and stored by the camera 10.

[0072] As described above, a preset thumbnail is a thumbnail corresponding to an image captured after a preset is performed on the camera 10, i.e., an image in the actual field of view. On the other hand, a bird's-eye view image is an image captured by changing the zoom position to the wide-angle side. Typically, a preset thumbnail and a bird's-eye view image are captured when a preset is registered, so the field of view of the preset thumbnail is included within the field of view of the bird's-eye view image. However, it is also possible that the field of view of the preset thumbnail is not included within the field of view of the bird's-eye view image. For example, even if a preset thumbnail is generated, it is also possible that the preset thumbnail is generated by presetting it at a position outside the field of view of the bird's-eye view image. In this case, the field of view of the bird's-eye view image does not include the entire field of view of the preset thumbnail. Here, the field of view of the bird's-eye view image includes another field of view, but does not mean that it includes the entire field of view of that other field of view, not just a portion of it.

[0073] In S1201, the control unit 105 may acquire an overhead image whose size has been reduced (for example, thumbnailed) on the camera 10 side.

[0074] In S1202 and S1203, the control unit 105 performs a detection process to determine whether the angle of view of the preset thumbnail, i.e., the actual angle of view, exists within the angle of view of the overhead image. Specifically, first, in S1202, the control unit 105 detects an area where the similarity between the preset thumbnail and the overhead image is greatest and equal to or greater than a predetermined value. Detecting an area where the similarity is greatest and equal to or greater than the predetermined value means that the angle of view of the overhead image includes the angle of view of the preset thumbnail (the entire angle of view). Hereinafter, for convenience of explanation, the detected area where the similarity is greatest and equal to or greater than the predetermined value will be referred to as the "target area." The control unit 105 is an example of a detection unit that detects the second angle of view from within the first image in cooperation with a predetermined program.

[0075] The similarity can be calculated, for example, as follows: The preset thumbnail and the overhead image, which are candidates for detection processing, are converted into low-resolution images of 8 pixels vertically and 8 pixels horizontally, and the difference in gradation values ​​for the 64 pixels of each converted image is then calculated.The reciprocal of the sum of the differences is then calculated, and this reciprocal is used as the similarity.

[0076] In S1203, if the control unit 105 detects the target area, in S1204, it selects the overhead image as the image to be used for thumbnail display.

[0077] In S1205, the control unit 105 draws a frame surrounding the target area detected in S1202 in the selected overhead image. This frame is a frame surrounding the actual angle of view area and is an example of information indicating the second angle of view area. Hereinafter, this frame will be referred to as the "actual angle of view frame."

[0078] In S103, the control unit 105 calculates a cutout area for a thumbnail from the overhead image based on the display size set in S101. In this embodiment, the calculation of the cutout area mainly means the calculation of the enlargement ratio of the cutout area (the enlargement ratio of the overhead image displayed as a thumbnail).

[0079] The smaller the display size of the thumbnail, the more difficult it is for the user to view the thumbnail. Therefore, in order to generate and display thumbnails of an appropriate size according to the display size of the thumbnail list, the control unit 105 performs processing to crop an appropriate size from the overhead image and enlarge the cropped area. The control unit 105 generates thumbnails by cropping an area including the actual angle of view area. This will be described below.

[0080] 13 is an explanatory diagram showing a method for calculating a clipping area 1303 of a thumbnail. Here, a case will be described in which the angle of view area of ​​the overhead image includes the actual angle of view area. The actual angle of view area is an example of the second angle of view area.

[0081] In FIG. 13, for a thumbnail of the entire overhead image (entire thumbnail 1301), an actual angle of view area 1305 is indicated by a thick frame, and a clipped area 1303 is indicated by a dashed line. The clipped area 1303 is an area that is displayed on the display unit 103 as a new thumbnail, and no other range is displayed. The magnification ratio can be calculated by dividing the area of ​​the entire thumbnail 1301 by the area of ​​the clipped area 1303. In this embodiment, as with FIG. 5 described in the first embodiment, the smaller the display size of the thumbnail, the smaller the size of the clipped area, i.e., the larger the magnification ratio of the clipped area. For example, if the display size of the thumbnail is "large" (960×540), the magnification ratio is set to 100%, if it is "medium" (640×360), the magnification ratio is set to 200%, and if it is "small" (480×270), the magnification ratio is set to 500%.

[0082] The position (thumbnail position) and the upper limit of the magnification ratio of the clipping area 1303 are set so that the actual angle of view area 1305 is included in the clipping area 1303. For example, the clipping area is determined so that the center of the actual angle of view area 1305 is positioned as close to the center of the clipping area as possible. Alternatively, the clipping area 1303 is determined so that the actual angle of view area 1305 is positioned in accordance with another predetermined algorithm.

[0083] In S104, the control unit 105 displays the cropped area enlarged by the magnification calculated in S103 as a thumbnail on the display unit 103. At this time, the control unit 105 also displays an actual field of view frame 1305a indicating the actual field of view area 1305 superimposed on the thumbnail. Figures 14(A) to 14(C) are diagrams each showing a display example of a thumbnail including the actual field of view frame 1305a.

[0084] If the control unit 105 does not detect the target area in S1203, the control unit 105 selects a preset thumbnail as an image to be used for thumbnail display in S1206.

[0085] In S1207, the control unit 105 displays the preset thumbnail selected in S1206 on the display unit 103 as a thumbnail.

[0086] In FIG. 14A, the display size of the thumbnail is "large" and the magnification of the cutout area is 100%, meaning that the entire original thumbnail 1301 is displayed as is as a thumbnail.

[0087] In FIG. 14(B), the display size of the thumbnail is "medium" and the enlargement rate of the cutout area is set to 200%, for example.

[0088] In FIG. 14(C), the display size of the thumbnail is "small," and the magnification ratio of the cropped area is set to, for example, 500%. In FIG. 14(C), for example, only the actual field of view area 1305 is cropped and displayed as a thumbnail. Here, an example is shown in which the cropped area 1303 and the actual field of view area 1305 are the same. When the cropped area and the actual field of view area 1305 are the same in this way, the actual field of view frame 1305a does not need to be displayed. Alternatively, the actual field of view frame may be displayed along the outline of the entire cropped area. Furthermore, since the actual field of view frame is not displayed in FIG. 14(C), a preset thumbnail may be displayed as a thumbnail instead of a bird's-eye view image.

[0089] An upper limit may be set for the enlargement ratio (a lower limit for the size of the cropped region). The reason for setting an upper limit for the enlargement ratio is the same as in the first embodiment.

[0090] On the other hand, the lower limit of the magnification rate may be set to a value greater than 100%, so that thumbnails are enlarged and displayed even when the thumbnail display size set by the user is "large."

[0091] As described above, according to this embodiment, the controller 100 acquires preset thumbnails and overhead images from the camera 10, detects the actual angle of view area, and sets a larger magnification ratio for the cropped area as the thumbnail display size becomes smaller. This allows the user to see not only the actual angle of view area but also the area outside of it in the thumbnail display when the thumbnail display size is "large" or "medium," making the composition easier to see. On the other hand, when the thumbnail is relatively small, for example, smaller than "medium," the user can check the actual angle of view area displayed in an enlarged manner. In other words, the visibility can be improved when the user checks the thumbnail display including the actual angle of view area.

[0092] Seventh embodiment In the seventh embodiment, an example will be described in which thumbnail displays are generated using images captured at a wide angle by one or more cameras other than the camera 10. Below, differences from the sixth embodiment will be described.

[0093] 15 is a diagram showing an example of the configuration of a control system in this embodiment. The control system in this embodiment includes a controller 100, a camera 10, an overhead camera 11, and an overhead camera 12. The controller 100, the camera 10, the overhead camera 11, and the overhead camera 12 are connected via a network 200.

[0094] The overhead cameras 11 and 12 basically have the same configuration as the camera 10, and further have a function for taking wide-angle images. It does not matter whether the camera 10 has the function for taking wide-angle images.

[0095] 16 is a flowchart showing an example of thumbnail display processing in this embodiment. In this processing, the processes of S101, S1202, S1204 to S1207, S103, and S104 are the same as those in FIG.

[0096] After S101, in S1601, the control unit 105 acquires preset thumbnails from the camera 10. The control unit 105 acquires one overhead image each from the overhead camera 11 and the overhead camera 12. It is also possible to implement this embodiment using three or more overhead cameras, in which case in S1601 the control unit 105 acquires one overhead image each from all the overhead cameras.

[0097] In S1602, control unit 105 sequentially selects overhead images. Here, first, control unit 105 selects one overhead image acquired from one overhead camera. Because control unit 105 uses overhead cameras 11 and 12, when S1602 is executed for the first time, control unit 105 selects the overhead image acquired from overhead camera 11. Then, when S1602 is executed for the second time (processing after a Yes determination in S1604, described below), control unit 105 selects the overhead image acquired from overhead camera 12.

[0098] In S1603, if the control unit 105 detects the target area, the process proceeds to S1204, where the control unit 105 selects one overhead image that includes the target area. If the control unit 105 does not detect the target area, the process proceeds to S1604.

[0099] In S1604, if there is another overhead image, the control unit 105 returns to S1602, and if there is no other overhead image, the control unit 105 proceeds to S1606.

[0100] In S104, as described in the sixth embodiment, the display unit 103 displays thumbnails in the display modes shown in Fig. 14(A) to (C). Note that in this embodiment, multiple overhead images are acquired, so in S104, if multiple overhead images are selected in S1204, multiple thumbnails corresponding to those images may be displayed. Alternatively, in S104, one thumbnail that is finally selected from the multiple thumbnails using a predetermined method may be displayed.

[0101] As described above, according to this embodiment, controller 100 acquires thumbnail images from camera 10, acquires overhead images from overhead cameras 11 and 12, and then detects the actual angle of view area from these overhead images. Then, by setting the magnification rate of the cropped area to be larger as the display size of the thumbnail becomes smaller, it is possible to obtain the same effect as in the sixth embodiment.

[0102] Furthermore, according to this embodiment, even when multiple overhead images are captured, the controller 100 can display a thumbnail including the actual field of view frame 1305a by selecting one overhead image including the actual field of view area.

[0103] (Eighth embodiment) In the eighth embodiment, an example will be described in which the control system of the present disclosure is applied to CG (Computer Graphics). In CG, a virtual subject, a virtual light source, and a virtual camera are defined, and a computer performs calculations to generate an image of the virtual subject illuminated by the virtual light source as observed from the viewpoint of the virtual camera. The computer generates at least one of a preset thumbnail and an overhead image by changing the angle of view of the virtual camera. A controller acquires the preset thumbnail and the overhead image, and displays the actual angle of view area and the area outside it as thumbnails, as in the sixth embodiment.

[0104] In the configuration of the control system in this embodiment, for example, the computer and the controller may be connected via a network 200 (FIG. 1), or may be connected without the network 200. This eighth embodiment is also applicable to the above-mentioned first to fifth embodiments that handle the crop function.

[0105] (Ninth embodiment) In the ninth embodiment, an example will be described in which display processing is performed using an overhead image captured at a wide angle by the camera 10. The ninth embodiment combines the essence of the second embodiment with the sixth embodiment, and therefore will describe the differences from the second and sixth embodiments. In this embodiment, just as in the second embodiment the magnification ratio of the thumbnail is calculated based on the size of the crop area, in this embodiment the magnification ratio of the thumbnail, i.e. the area to be cut out from the overhead image, is calculated based on the size of the actual angle of view area.

[0106] In this embodiment, when the size of the actual angle of view area is "large," the magnification ratio of the cut-out area of ​​the thumbnail from the overhead image is set to 100%. When the size of the actual angle of view area is "medium," the magnification ratio of the cut-out area is set to 200%, which is larger than the magnification ratio when "large." When the size of the actual angle of view area is "small," the magnification ratio of the cut-out area is set to 500%, which is larger than the magnification ratio when "medium."

[0107] As described above, according to this embodiment, the controller 100 acquires thumbnail images and bird's-eye images from the camera 10, detects the actual angle of view area, and sets a larger magnification ratio for the cropped area as the size of the actual angle of view area decreases. This allows the user to see not only the actual angle of view area but also the area outside the actual angle of view area in the thumbnail display when the size of the actual angle of view area is "large" or "medium," making the composition easier to see. On the other hand, when the size of the actual angle of view area is relatively small, for example, smaller than "medium," the user can check the actual angle of view area displayed in an enlarged manner. In other words, the visibility can be improved when the user checks the thumbnail display including the actual angle of view area.

[0108] In this embodiment, as explained in the seventh embodiment, an overhead image captured at a wide angle by one or more cameras other than camera 10 may be used to calculate the magnification ratio of the thumbnail based on the size of the actual angle of view area.

[0109] Alternatively, as explained in the eighth embodiment, an overhead image taken at a wide angle by a virtual camera on CG may be used, and the enlargement ratio of the thumbnail may be calculated based on the size of the actual angle of view area.

[0110] (Tenth embodiment) In the tenth embodiment, an example will be described in which thumbnail display processing is performed using an overhead image captured at a wide angle by the camera 10. This embodiment basically performs the same processing as the sixth embodiment, so differences from the sixth embodiment will be described. Just as in the third embodiment, in which the crop area was calculated according to the display size of the thumbnail and the size of the crop area, in this embodiment, the crop area is calculated according to the display size of the thumbnail and the size of the actual angle of view area.

[0111] In this embodiment, the smaller the thumbnail display size and the smaller the actual angle of view area, the smaller the size of the crop area, i.e., the larger the magnification ratio of the crop area is set, which makes it easier to see the inside and outside of the crop area according to the thumbnail display size and the size of the actual angle of view area, and allows the composition to be expressed appropriately.

[0112] In this embodiment, as described in the seventh embodiment, an overhead image captured at a wide angle by one or more cameras other than camera 10 may be used to calculate the magnification ratio of the thumbnail based on the display size of the thumbnail and the size of the actual angle of view area.

[0113] Alternatively, as explained in the eighth embodiment, an overhead image taken at a wide angle by a virtual camera on CG may be used, and the magnification ratio of the thumbnail may be calculated based on the display size of the thumbnail and the size of the actual angle of view area.

[0114] (Eleventh embodiment) In the eleventh embodiment, an example of thumbnail display processing will be described using an overhead image captured at a wide angle by the camera 10. This embodiment basically performs the same processing as the sixth embodiment, so differences from the sixth embodiment will be described. In this embodiment, the display size of thumbnails is controlled according to the size of the actual angle of view area for the thumbnails. In the first to tenth embodiments, the display size of thumbnails was determined in advance according to the number of rows and columns (the number of thumbnails), such as "2x2," "3x3," or "4x4," as shown in FIGS. 3(A) to 3(C). In contrast, this embodiment differs from the first to ninth embodiments in that the display size of thumbnails is determined according to the size of the actual angle of view area.

[0115] 17 is a flowchart showing an example of thumbnail display processing in this embodiment. In this processing, the processing in steps S1201 to S1206 is the same as in FIG.

[0116] After S1205, in S1701, the control unit 105 determines the display size of the thumbnail based on the size of the actual angle of view area. The smaller the display size of the actual angle of view area of ​​the thumbnail, the more difficult it is for the user to view the actual angle of view area. If the size ratio of the actual angle of view area to the size of the overhead image is equal to or less than a predetermined value, the control unit 105 determines the display size of the thumbnail to be "large." Otherwise, the control unit 105 determines the display size of the thumbnail to be "small." The predetermined value is, for example, 1 / 2, but is not limited to this. Furthermore, the display size of the thumbnail may be determined from three sizes: "large," "medium," and "small," or from four or more thumbnail display sizes.

[0117] After S1206, in S1702, the control unit 105 determines the display size of the thumbnail to be "small." This is because there is no actual angle of view area in the overhead image, and therefore reducing the display size of the thumbnail has little effect on the user.

[0118] In S1703, the control unit 105 displays the thumbnails in accordance with the determined thumbnail display size.

[0119] 18 shows examples of thumbnails each including an actual field of view frame. In thumbnail 1801, the size ratio of the actual field of view frame 1802 to the overhead image is equal to or smaller than a predetermined value, so the display size of the thumbnail is "large."

[0120] In the case of the thumbnail 1803, the size ratio of the actual field of view frame 1804 to the overhead image exceeds a predetermined value, so the display size of the thumbnail is "small."

[0121] In the case of the thumbnail 1805, the size ratio of the actual field of view frame 1806 to the overhead image exceeds a predetermined value, so the display size of the thumbnail is "small."

[0122] As described above, according to this embodiment, the controller 100 acquires preset thumbnails and overhead images from the camera 10, detects the actual angle of view area, and sets a larger thumbnail display size as the size ratio of the actual angle of view area to the overhead image decreases. This improves the visibility of the area outside the actual angle of view area when the size of the actual angle of view area relative to the thumbnail is small. In other words, it improves the visibility when the user checks thumbnail display including the actual angle of view area.

[0123] In this embodiment, as described in the seventh embodiment, an overhead image captured at a wide angle by one or more cameras other than camera 10 may be used, and the display size of the thumbnail may be controlled according to the size of the actual angle of view area for the thumbnail.

[0124] Alternatively, as explained in the eighth embodiment, a bird's-eye view image taken at a wide angle by a virtual camera on CG may be used, and the display size of the thumbnail may be controlled in accordance with the size of the actual angle of view area for the thumbnail.

[0125] (Twelfth embodiment) In the twelfth embodiment, an example will be described in which thumbnail display processing is performed using an overhead image captured with a wide angle by the camera 10. The twelfth embodiment combines the essence of the fourth embodiment with the sixth embodiment, and therefore only the differences from the fourth and sixth embodiments will be described. Just as the preset thumbnail includes multiple crop areas in the fourth embodiment, the preset thumbnail in this embodiment includes multiple actual angle of view areas. The actual angle of view areas correspond to the composition when a preset is executed on the camera 10, so an operation of selecting one from the multiple actual angle of view areas enables an operation of executing one preset from the preset thumbnail.

[0126] In this embodiment, the control unit 105 detects two actual image areas after acquiring an overhead image and two thumbnail images from the camera 10. The control unit 105 calculates a cutout area based on the size of an area that includes the two actual image areas, instead of the size of the actual image areas in the ninth embodiment. That is, the smaller the size of the area that includes the two actual image areas, the smaller the size of the cutout area, i.e., the larger the magnification ratio of the cutout area is set.

[0127] In this embodiment, as described in the seventh embodiment, an overhead image taken at a wide angle by one or more cameras other than camera 10 may be used, and the magnification ratio of the thumbnail may be calculated based on the size of the area that contains the two actual image areas.

[0128] Alternatively, as explained in the eighth embodiment, an overhead image captured at a wide angle by a virtual camera on CG may be used, and the enlargement ratio of the thumbnail may be calculated based on the size of an area that includes two actual image areas.

[0129] (Thirteenth embodiment) In the thirteenth embodiment, an example of thumbnail display processing will be described using an overhead image captured at a wide angle by the camera 10. The thirteenth embodiment combines the essence of the fifth embodiment with the sixth embodiment, and therefore only the differences from the fifth and sixth embodiments will be described. In this embodiment, the display form of the thumbnail is changed when a thumbnail is cut out from an overhead image in a cutout region and displayed, just like in the fifth embodiment, in which the display form of the thumbnail is changed when the entire thumbnail image is displayed as is.

[0130] When cutting out a thumbnail from an overhead image in a cutout area, the control unit 105 can make the user aware that the thumbnail has been cut out by, for example, superimposing an image such as a dashed line along the outline of the thumbnail.

[0131] In this embodiment, as described in the seventh embodiment, when an overhead image captured at a wide angle by one or more cameras other than camera 10 is used and thumbnails are cut out in a cutout area and displayed, the display format of the thumbnails may be changed.

[0132] Alternatively, as described in the eighth embodiment, when using a bird's-eye view image taken at a wide angle by a virtual camera on CG and displaying thumbnails by cutting them out in a cutout area, the display format of the thumbnails may be changed.

[0133] (Other embodiments) Although the controller 100 according to each of the above embodiments displays information indicating the crop area (for example, a crop frame) within the thumbnail image, this does not necessarily have to be the case. Alternatively, the user may be able to selectively display or hide the information indicating the crop area.

[0134] The present disclosure can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that realizes one or more functions. Alternatively, a PLD (Programmable Logic Device) such as an FPGA (Field Programmable Gate Array) may be used. Alternatively, a DSP (Digital Signal Processor) may be used.

[0135] In the eleventh embodiment, the display size of the thumbnail is determined according to the size of the actual angle of view area. Here, the "actual angle of view area" may be replaced with the crop area. That is, in the same spirit as the eleventh embodiment, the display size of the thumbnail may be determined according to the size of the crop area.

[0136] At least two of the first to thirteenth embodiments may be combined.

[0137] The disclosure of this embodiment includes the following configuration, method, and program. (Configuration 1) an acquisition means for acquiring at least a first image from one or more images acquired by one or more imaging devices; a determination means for determining a region to be cut out from the first image, the region including the second angle of view region, based on at least one of a size of a display region of the thumbnail image on a display screen and a size of a second angle of view region that is smaller than a first angle of view region of the first image; a display processing means for performing processing to display the image cut out from the first image in the determined cut-out area on the display screen as the thumbnail image; A display control device comprising: (Configuration 2) The determining means determines the cropping area by calculating an enlargement ratio of the thumbnail image based on at least one of the size of the display area of ​​the thumbnail image and the size of the second angle of view area. 2. The display control device according to configuration 1, (Configuration 3) The determining means sets the size of the cutout area to be smaller as the size of the display area of ​​the thumbnail image is smaller. 3. The display control device according to configuration 1 or 2. (Configuration 4) The determining means sets a size of the cutout region to be smaller as the size of the second angle of view region is smaller. 4. The display control device according to any one of configurations 1 to 3. (Configuration 5) The determining means sets at least one of an upper limit and a lower limit for the size of the cutout region. 5. The display control device according to any one of configurations 1 to 4. (Configuration 6) The display processing means displays an image indicating that the first image has been cut out in the cutout area, superimposed on the thumbnail image. 6. The display control device according to any one of configurations 1 to 5. (Configuration 7) At least one of the first image and the second image, which is an image of the second field of view, is an image created by computer graphics. 7. The display control device according to any one of configurations 1 to 6, wherein: (Configuration 8) When the imaging device has a function of outputting an image of a cropped area obtained by cropping a part of a captured image, the first image is a preset thumbnail image captured by the imaging device based on a field of view registered in the imaging device and generated, and the second field of view area is a cropped area obtained by cropping a part of the preset thumbnail image. 2. The display control device according to configuration 1, (Configuration 9) the acquisition means acquires information about the crop region from the imaging device; The display processing means generates information indicating the crop area based on the information regarding the crop area and superimposes the information on the thumbnail image. 9. The display control device according to configuration 8, (Configuration 10) The determining unit determines a cutout area including a plurality of crop areas when the imaging device has a function of outputting images of the plurality of crop areas. 10. The display control device according to configuration 8 or 9. (Configuration 11) The determining means sets the size of the cut-out region to be smaller as the size of the inclusion region of the plurality of crop regions is smaller. 11. The display control device according to configuration 10. (Configuration 12) further comprising a detection means for detecting the second field of view area from within the first image; The determining means determines the cropping area based on at least one of the size of a display area of ​​the thumbnail image on the display screen and the size of the detected second angle of view area. 2. The display control device according to configuration 1, (Configuration 13) The first image is an image captured by the imaging device at a wide angle. 13. The display control device according to configuration 12. (Configuration 14) The second image, which is an image of the second angle of view region, is a preset thumbnail image that is captured and generated by the imaging device based on the angle of view registered in the imaging device. 14. The display control device according to configuration 12 or 13. (Configuration 15) The detecting means detects the second field of view area by calculating a similarity between the first image and the preset thumbnail image. 15. A display control device according to configuration 14. (Configuration 16) The display processing means generates information indicating the detected second angle of view area and superimposes the information on the thumbnail image. 16. The display control device according to any one of configurations 12 to 15. (Configuration 17) the acquisition means acquires the first image acquired by one or more first imaging devices among the one or more imaging devices, and acquires a second image that is an image of the second angle of view region acquired by a second imaging device, The detection means sequentially performs the detection process of the second angle of view area for each of the first images acquired by the plurality of first imaging devices. 17. The display control device according to any one of configurations 12 to 16, (Configuration 18) The determining means further determines a size of the display area of ​​the thumbnail image based on the size of the second angle of view area, and sets the size of the display area of ​​the thumbnail image to be larger as the size of the second angle of view area is smaller. 13. The display control device according to configuration 12. (Configuration 19) When a plurality of second angle-of-view regions are detected, the determining means determines a cropping region including the plurality of second angle-of-view regions. 13. The display control device according to configuration 12. (Configuration 20) The determining means sets a size of the cutout region to be smaller as the size of the inclusion region of the plurality of second angle-of-view regions is smaller. 20. A display control device according to configuration 19, characterized in that: (method) an acquisition step of acquiring at least a first image from one or more images acquired by one or more imaging devices; a determining step of determining a region to be cut out from the first image, the region including the second angle of view region, based on at least one of a size of a display region of the thumbnail image on a display screen and a size of a second angle of view region smaller than the first angle of view region of the first image; a display processing step of performing processing to display the image cut out from the first image in the determined cut-out area on the display screen as the thumbnail image. A method executed by a display control device. (program) A program that causes a computer to execute the above method.

[0138] The present disclosure has been described in detail above based on preferred embodiments thereof, but the present disclosure is not limited to the above embodiments, and various modifications are possible based on the gist of the present disclosure, and these modifications are not excluded from the scope of the present disclosure. [Explanation of symbols]

[0139] 10: Camera 11, 12: Bird's-eye view camera 100: Controller 102: Non-volatile memory 103: Display section 105: Control unit 503, 1303: Cutout area 505, 1001, 1002: Crop area 1305: Actual angle of view area 1005: Inclusion area

Claims

1. an acquisition means for acquiring at least a first image from one or more images acquired by one or more imaging devices; a determination means for determining a region to be cut out from the first image, the region including the second angle of view region, based on at least one of a size of a display region of the thumbnail image on a display screen and a size of a second angle of view region smaller than a first angle of view region of the first image; a display processing means for performing processing to display the image cut out from the first image in the determined cut-out area on the display screen as the thumbnail image; A display control device comprising:

2. The determining means determines the cropping area by calculating an enlargement ratio of the thumbnail image based on at least one of the size of the display area of ​​the thumbnail image and the size of the second angle of view area.

2. The display control device according to claim 1.

3. The determining means sets the size of the cutout area to be smaller as the size of the display area of ​​the thumbnail image is smaller.

2. The display control device according to claim 1.

4. The determining means sets the size of the cutout region to be smaller as the size of the second angle of view region is smaller.

2. The display control device according to claim 1.

5. The determining means sets at least one of an upper limit and a lower limit for the size of the cutout region.

2. The display control device according to claim 1.

6. The display processing means displays an image indicating that the first image has been cut out in the cutout area, superimposed on the thumbnail image.

2. The display control device according to claim 1.

7. At least one of the first image and the second image, which is an image of the second field of view area, is an image generated by computer graphics.

2. The display control device according to claim 1.

8. When the imaging device has a function of outputting an image of a cropped region obtained by cropping a part of a captured image, the first image is a preset thumbnail image captured by the imaging device based on a field of view registered in the imaging device and generated, and the second field of view region is a cropped region obtained by cropping a part of the preset thumbnail image.

2. The display control device according to claim 1.

9. the acquisition means acquires information about the crop region from the imaging device; The display processing means generates information indicating the crop area based on the information regarding the crop area and superimposes the information on the thumbnail image.

9. The display control device according to claim 8.

10. The determining unit determines a cutout area including a plurality of crop areas when the imaging device has a function of outputting images of the plurality of crop areas.

9. The display control device according to claim 8.

11. The determining means sets the size of the cut-out region to be smaller as the size of the inclusion region of the plurality of crop regions is smaller. The display control device according to claim 10 .

12. a detection unit for detecting the second field of view area from within the first image; The determining means determines the cropping area based on at least one of the size of a display area of ​​the thumbnail image on the display screen and the size of the detected second angle of view area.

2. The display control device according to claim 1.

13. The first image is an image captured by the imaging device at a wide angle.

13. The display control device according to claim 12.

14. The second image, which is an image of the second angle of view region, is a preset thumbnail image that is captured and generated by the imaging device based on the angle of view registered in the imaging device.

13. The display control device according to claim 12.

15. The detecting means detects the second field of view area by calculating a similarity between the first image and the preset thumbnail image.

15. The display control device according to claim 14.

16. The display processing means generates information indicating the detected second angle of view area and superimposes the information on the thumbnail image.

13. The display control device according to claim 12.

17. the acquisition means acquires the first image acquired by one or more first imaging devices among the one or more imaging devices, and acquires a second image that is an image of the second angle of view region acquired by a second imaging device; The detection means sequentially performs the detection process of the second angle of view area for each of the first images acquired by the plurality of first imaging devices.

13. The display control device according to claim 12.

18. The determining means further determines a size of the display area of ​​the thumbnail image based on the size of the second angle of view area, and sets the size of the display area of ​​the thumbnail image to be larger as the size of the second angle of view area is smaller.

13. The display control device according to claim 12.

19. When a plurality of second angle-of-view regions are detected, the determining means determines a cropping region including the plurality of second angle-of-view regions.

13. The display control device according to claim 12.

20. The determining means sets a size of the cropping region to be smaller as the size of an inclusion region of the plurality of second angle-of-view regions is smaller.

20. The display control device according to claim 19.

21. an acquisition step of acquiring at least a first image from one or more images acquired by one or more imaging devices; a determining step of determining a region to be cut out from the first image, the region including the second angle of view region, based on at least one of a size of a display region of the thumbnail image on a display screen and a size of a second angle of view region smaller than a first angle of view region of the first image; a display processing step of performing processing to display the image cut out from the first image in the determined cut-out area on the display screen as the thumbnail image. A method executed by a display control device.

22. A program causing a computer to carry out the method of claim 21.

Images