Controller, information processing apparatus, method for controlling controller, method for controlling information processing apparatus, and program

Abstract

To provide a controller that, when changing an imaging direction of an imaging apparatus to be a predetermined imaging direction, can check that the imaging apparatus is moving to the predetermined direction from a displayed video.SOLUTION: A controller has: registration means that registers one or more pieces of information indicating an imaging direction in an imaging apparatus; switching means that, when changing the imaging direction of the imaging apparatus to be a predetermined imaging direction recorded in the registration means, switches a video from a first video picked up by the imaging apparatus to a second video different from the first video; and superimposition means that, during the switching to the second video, superimposes related information related to the predetermined imaging direction on the second video.SELECTED DRAWING: Figure 6

Description

[Technical Field]

[0001] The present invention relates to a control device, an information processing device, a control method for a control device, a control method for an information processing device, and a program. [Background technology]

[0002] In recent years, with the expansion of the video distribution market, there has been an increase in the number of camera systems used to film weddings and lectures, using cameras that can be remotely controlled and recorded over a network. Such cameras pre-program and store (register) combinations of pan-tilt-zoom (PTZ) positions corresponding to specific shooting areas. Some cameras also have a preset function that allows the PTZ position information of these registered patterns to be recalled and set using a specific operation. When using the preset function to move the PTZ to a preset angle of view registered in the camera, the moving image is captured. However, depending on the application, such as when the PTZ movement speed is high, it may be desirable to not capture the moving image.

[0003] Patent Document 1 discloses a technique for transmitting a still image immediately before a pan / tilt operation during the operation. Patent Document 2 discloses a technique in which an information processing device that switches between multiple PTZ cameras for shooting images switches the captured image to an image different from the shot image, such as a mask image, during the preset operation when a preset operation is performed on one of the cameras. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-188975 [Patent Document 2] Japanese Patent Publication No. 2023-142060 Summary of the Invention [Problem to be solved by the invention]

[0005] In the conventional methods disclosed in Patent Documents 1 and 2, a still image or a masked image is displayed during PTZ movement to a preset angle of view, i.e., while the imaging direction of the imaging device is being changed to a predetermined imaging direction, which poses a problem in that it is difficult to determine from the displayed image whether PTZ movement is being performed to a specified preset angle of view.

[0006] According to the present invention, an object is to provide a control device that, when changing the imaging direction of an imaging device to a predetermined imaging direction, makes it possible to confirm from the displayed image that the imaging device is moving to the predetermined imaging direction. [Means for solving the problem]

[0007] In order to achieve the above object, a control device as one aspect of the present invention is characterized by having: a registration means for registering one or more pieces of information indicating an imaging direction of an imaging device; a switching means for switching an image from a first image captured by the imaging device to a second image different from the first image when the imaging direction of the imaging device is changed to a predetermined imaging direction recorded in the registration means; and a superimposition means for superimposing related information relating to the predetermined imaging direction on the second image when switching to the second image. [Effects of the Invention]

[0008] According to the present invention, when the imaging direction of the imaging device is changed to a predetermined imaging direction, it is possible to confirm from the displayed image that the imaging device is moving to the predetermined imaging direction. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a configuration diagram showing an example of the appearance of an imaging device according to a first embodiment. [Figure 2] FIG. 1 is a configuration diagram showing an example of an imaging system according to a first embodiment. [Figure 3] 1 is a configuration diagram showing an example of the configuration of an imaging device according to a first embodiment. [Figure 4] FIG. 2 is a diagram illustrating the hardware configuration of each device according to the first embodiment. [Figure 5] FIG. 2 is a block diagram illustrating the configuration of a moving image / still image switching unit according to the first embodiment. [Figure 6] FIG. 2 is a diagram showing an example of a still image output according to the first embodiment. [Figure 7] 5 is a flowchart showing the processing procedure of a moving image / still image switching unit according to the first embodiment. [Figure 8] FIG. 10 is a block diagram of a moving image / still image switching unit according to a second embodiment. [Figure 9] FIG. 10 is a block diagram illustrating the configuration of a display image generating unit according to a second embodiment. [Figure 10] FIG. 10 is a diagram showing an example of a still image output according to the second embodiment. [Figure 11] 10 is a flowchart showing the processing procedure of a moving image / still image switching unit according to the second embodiment. [Figure 12] 10 is a flowchart showing a processing procedure of a display video generating unit according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0011] <Embodiment 1> FIG. 1 is a diagram illustrating an image capturing apparatus (control device) 1000 according to the first embodiment. The image capturing apparatus 1000 according to this embodiment has a pan drive mechanism 1001, a tilt drive mechanism 1002, and a zoom mechanism 1003. The pan drive mechanism 1001 is a mechanism that can change the imaging area of ​​the image capturing apparatus 1000 in the pan direction (horizontal direction). The tilt drive mechanism 1002 is a mechanism that can change the imaging area of ​​the image capturing apparatus 1000 in the tilt direction (vertical direction). The zoom mechanism 1003 is a mechanism that changes the angle of view of the image capturing apparatus 1000. Note that, although an example will be described in which the function of the control device that superimposes information related to a predetermined imaging direction on an image is provided within the image capturing apparatus 1000, this function as the control device may also be provided outside the image capturing apparatus.

[0012] FIG. 2 is a diagram illustrating an example of an imaging system configuration including an imaging device 1000 according to the first embodiment. FIG. 2(A) is a diagram illustrating an imaging system including the imaging device 1000, a client device (information processing device) 2000, and a network (communications network) 3000. As shown in FIG. 2(A), the imaging device 1000 and the client device 2000 are connected via the network 3000 so as to be able to communicate with each other. The client device 2000 controls the imaging device 1000, such as controlling the angle of view and image quality. That is, commands (control signals) for controlling the operation of the imaging device 1000 are transmitted from the client device 2000. Upon receiving these commands, the imaging device 1000 transmits responses to these commands to the client device 2000. Note that an imaging system may be configured without using the network 3000. An example will be described below with reference to FIG. 2(B).

[0013] 2 shows an example in which the imaging system is configured to be able to communicate with one client device, but the present invention is not limited to this, and the imaging system may be configured by connecting to multiple client devices. That is, the imaging system of this embodiment can be configured by the imaging device 1000 and at least one information processing device.

[0014] FIG. 2(B) illustrates an imaging system different from that shown in FIG. 2(A), which is configured with an imaging device 1000, a control device 4000, and a display device 5000. In FIG. 2(B), the control device 4000 and the display device 5000 are connected to the imaging device 1000 without a network. In this case, the control device 4000 may be configured to control the imaging device 1000 via serial communication such as RS-422. The display device 5000 and the imaging device 1000 may also be configured to communicate via a video signal line such as HDMI (registered trademark) or SDI. In this way, the imaging system of this embodiment may be configured such that video transmission and camera control are independent. Note that the following description will be given taking the system configuration of FIG. 2(A) as an example.

[0015] 3, the configuration of each part of the imaging device 1000, the configuration and function of each part of the network 3000, and the client device 2000 will be described. Fig. 3 is a configuration diagram showing an example of the configuration of the imaging device 1000. The imaging device 1000 has an imaging unit 1011, an image processing unit 1012, a lens driving unit 1013, a zoom control unit 1014, a pan driving unit 1015, a tilt driving unit 1016, a pan / tilt control unit 1017, a storage unit 1018, a system control unit 1019, and a communication unit 1020.

[0016] The imaging unit 1011 functions as an imaging means for capturing (photographing) an object to generate a captured image. The imaging unit 1011 has optical elements such as lenses and an imaging element (not shown). The imaging element is, for example, a Charge Coupled Device (CCD) sensor or a Complementary Metal Oxide Semiconductor (CMOS) sensor. The imaging unit 1011 generates an electrical signal by photoelectrically converting the object image formed through the lens.

[0017] The image processing unit 1012 performs predetermined image processing and compression encoding on the signals captured and photoelectrically converted by the imaging unit 1011 to generate image data. Note that the image data generated is not limited to one, and multiple image data sets with different resolutions and video qualities may be generated simultaneously. The generated image data is also transmitted to the system control unit 1019.

[0018] The lens driving unit 1013 changes the focal length of the lens of the imaging device 1000 based on instructions sent from the zoom control unit 1014. The lens driving unit 1013 is composed of a drive system for the focus lens and the zoom lens. The operation of the lens driving unit 1013 is controlled by the zoom control unit 1014.

[0019] The zoom control unit 1014 controls the lens driving unit 1013 based on instructions transmitted from the system control unit 1019. Therefore, the zoom control unit 1014 in this embodiment can control imaging conditions related to the zoom of the imaging device 1000. For example, it can control the zoom value (angle of view) or focus of the imaging device 1000. In addition, it transmits focus movement information and zoom movement information to the system control unit 1019.

[0020] The pan driving unit 1015 has a mechanical driving system and a driving source such as a motor for performing a pan operation that rotates the imaging direction of the imaging device 1000 in a pan direction (horizontal direction). The pan driving unit 1015 is controlled by a pan / tilt control unit 1017.

[0021] The tilt driving unit 1016 has a driving source such as a motor and a mechanical driving system that performs a tilt operation to rotate the imaging direction of the imaging device 1000 in a tilt direction (vertical direction). The tilt driving unit 1016 is controlled by a pan / tilt control unit 1017.

[0022] The pan / tilt control unit 1017 controls the pan driving unit 1015 and the tilt driving unit 1016 based on instructions transmitted from the system control unit 1019. Therefore, the pan / tilt control unit 1017 in this embodiment can control imaging conditions related to pan and tilt of the imaging device 1000. For example, it can control the imaging direction of the imaging device 1000.

[0023] In this embodiment, the imaging direction of the imaging device 1000 is determined by at least one of the pan value and tilt value of the imaging device 1000. In this embodiment, the pan value indicates the angle in the pan direction of the imaging direction (optical axis) of the imaging device 1000. In addition, the zoom value of the imaging device 1000 when an image is captured by the imaging device 1000 is calculated from the focal length of the lens.

[0024] The storage unit 1018 stores, as thumbnail images, PTZ (pan-tilt-zoom) position information registered as a preset and image data generated by the image processing unit 1012 at a preset position (registered imaging direction / imaging position).

[0025] The system control unit 1019 controls the entire imaging device 1000 and is configured to include a video / still image output unit 1021. The video / still image output unit 1021 will be described in detail later. The system control unit 1019 analyzes camera control commands transmitted from the client device 2000 and performs processing according to the commands. For example, the system control unit 1019 instructs the image processing unit 1012 to adjust image quality, the zoom control unit 1014 to perform zoom and focus control, and the pan / tilt control unit 1017 to perform pan / tilt operations. The system control unit 1019 also acquires image data generated by the image processing unit 1012 and stores it in the storage unit 1018. The system control unit 1019 also transmits the image data generated by the image processing unit 1012 to the client device 2000 via the communication unit 1020.

[0026] The communication unit 1020 communicates with the client device 2000. For example, the communication unit 1020 transmits image data transmitted from the system control unit 1019 to the client device 2000. The communication unit 1020 also transmits various commands transmitted from the client device 2000, such as various setting commands, camera control commands, and preset control commands, to the system control unit 1019. The communication unit 1020 also transmits responses of the imaging device 1000 to commands transmitted from the client device 2000 to the client device 2000.

[0027] When the video / still image output unit 1021 receives a preset control command transmitted from the communication unit 1020, it instructs the pan / tilt control unit 1017 and the zoom control unit 1014 to operate based on the preset control command. Furthermore, when the video / still image output unit 1021 receives a preset control command accompanying still image output from the communication unit 1020, it acquires a thumbnail image corresponding to the preset control command from the storage unit 1018. Then, it superimposes the acquired thumbnail image on image data transmitted from the system control unit 1019.

[0028] The client device 2000 is an information processing device configured by a general-purpose computer such as a personal computer (PC). The client device 2000 may also be configured by a mobile terminal such as a tablet or smartphone. The client device 2000 in this embodiment includes a display unit 2001, an input unit 2002, a system control unit 2003, a communication unit 2004, and a display image generation unit 2005.

[0029] The display unit 2001 is configured with a display device such as a liquid crystal panel, an organic EL panel, etc. On the screen of the display unit 2001, for example, images generated by a display image generation unit 2005, GUIs used for input operations to the client device 2000 and the imaging device 1000, etc. are displayed.

[0030] The input unit 2002 is composed of a keyboard, a pointing device such as a mouse or a touch panel, etc. A user operating the client device 2000 operates a GUI (Graphical User Interface) via the input unit 2002 to perform input operations on the client device 2000 and generate various commands for the imaging device 1000. GUI is an acronym for Graphical User Interface, and is a user interface that provides intuitive operations using computer graphics and a pointing device.

[0031] The system control unit 2003 controls the entire client device 2000 and is configured to include a display image generation unit 2005. The display image generation unit 2005 will be described in detail later. The system control unit 2003 generates various setting commands, camera control commands, preset control commands, etc. in response to user operations (e.g., GUI operations) and transmits them to the imaging device 1000 via the communication unit 2004. The system control unit 2003 also receives responses from the imaging device 1000 to the various transmitted commands via the communication unit 2004. The system control unit 2003 also displays image data received from the imaging device 1000 via the communication unit 2004 on the display unit 2001. Specifically, the system control unit 2003 causes the display unit 2001 to display a moving image as an image based on image data captured by the imaging device 1000. The system control unit 2003 also causes the display unit 2001 to display a still image as an image based on image data of a still image (to be described later). The system control unit 2003 also functions as a display control unit when displaying various images such as still images and moving images on the display unit 2001. The system control unit 1019 of the imaging device 1000 may display still images, moving images, and other images on the display unit 2001. In this case, the system control unit 1019 can also function as a display control unit.

[0032] The communication unit 2004 communicates with the imaging device 1000. The communication unit 2004 transmits various setting commands and camera control commands transmitted from the system control unit 2003 to the imaging device 1000. The communication unit 2004 also transmits image data transmitted from the imaging device 1000 and responses of the imaging device 1000 to commands transmitted from the client device 2000 to the system control unit 2003. In this way, the client device 2000 can perform various camera controls of the imaging device 1000 via the network 3000. That is, the client device 2000 can control the operation of the imaging device 1000 using various setting commands, camera control commands, etc. transmitted from the system control unit 2003.

[0033] The display image generation unit 2005 generates a display image to be displayed on the display unit 2001 based on a user operation (for example, a GUI operation) or image data and preset information (image capturing direction / image capturing position related information) received from the imaging device 1000 via the communication unit 2004. The display image generation unit 2005 transmits the generated display image to the display unit 2001.

[0034] 4 is a diagram showing an example of a hardware configuration that can be used to realize the functions of the image capturing apparatus 1000 and the client apparatus 2000 in embodiment 1. The image capturing apparatus 1000 and the client apparatus 2000 have the configuration shown in FIG.

[0035] Here, for example, at least some of the functions of the imaging device 1000 shown in FIG. 3 can be realized by a processor such as the CPU 400 executing a program stored in a memory such as the RAM 410, the ROM 420, or the HDD 430. For example, the functions of the image processing unit 1012, the zoom control unit 1014, the pan / tilt control unit 1017, and the system control unit 1019 can be realized by processing executed by the CPU 400. The storage unit 1018 can be realized by, for example, the RAM 410. Furthermore, the communication unit 1020 can be realized by, for example, the I / F 440. Similarly, at least some of the functions of the client device 2000 shown in FIG. 3 can be realized by a processor such as the CPU 400 executing a program stored in a memory such as the RAM 410, the ROM 420, or the HDD 430.

[0036] The central processing unit (CPU) 400 is a central processing unit that controls the imaging device 1000. The random access memory (RAM) 410 can temporarily store computer programs executed by the CPU 400. The RAM 410 also provides a work area used by the CPU 400 when executing processing. The RAM 410 can also function as a frame memory or a buffer memory.

[0037] The read only memory (ROM) 420 stores a program used by the CPU 400 to control the imaging device 1000. The HDD 430 is a storage device (secondary storage device) that records image data and the like. The I / F 440 communicates with external devices via the network 3000. The I / F 440 can perform communication in accordance with TCP / IP, HTTP, and the like.

[0038] At least some of the functions of the imaging device 1000 and the client device 2000 may be realized by dedicated hardware. For example, the process of displaying a graphic user interface (GUI) or image data on the display unit 2001 or the display device 5000 may be performed by a graphics processing unit (GPU). Furthermore, the process of reading program code from the ROM 420 and loading it into the RAM 410 may be performed by a direct memory access (DMA) functioning as a transfer device.

[0039] The configuration of the functional units of the moving image / still image output unit 1021 of this embodiment will be described with reference to Fig. 5. Fig. 5 is a block diagram showing the functional configuration of the moving image / still image output unit 1021 according to this embodiment.

[0040] The video / still image output unit 1021 analyzes the preset control command received by the communication unit 1020 from the client device 2000 via the network 3000, and controls the output of video and still images, and performs superimposition processing to superimpose a predetermined thumbnail image on a still image. The preset function will be described below.

[0041] The preset function is a function for changing the imaging position of the imaging device so as to capture an image at an imaging position indicated by a specified preset position. Specifically, one or more pieces of preset information indicating an imaging direction (imaging position) for capturing an image by the imaging device 1000 are registered in advance by the imaging unit 1011 of the imaging device 1000. Then, when any of the registered preset information is designated by a user operation or the like, the imaging position of the imaging device 1000 is changed (preset movement) so as to capture an image at the imaging position indicated by the preset position. This movement operation for changing the imaging position is also called a preset operation.

[0042] Information indicating the imaging direction in the preset of each preset registration is expressed, for example, by two-dimensional coordinates indicating the coordinates of the pan direction and the coordinates of the tilt direction. As an example, the coordinate information, the preset number, and a thumbnail image are associated with each other, and these three are registered (stored) as preset information. In addition to the information indicating the pan direction and the tilt direction, information indicating the current zoom value (magnification ratio) may also be added as preset information. In other words, information indicating the PTZ state may be included in the preset information. Furthermore, the thumbnail image of a preset may be an image that at least corresponds to the preset information. Furthermore, instead of a thumbnail image, for example, a map image or an icon image indicating the imaging direction indicated in the preset information may be used.

[0043] In this embodiment, the video / still image output unit 1021 is described as a block (functional unit) within the system control unit 1019 of the imaging device 1000, but it may also be included in, for example, the image processing unit 1012. The video / still image output unit 1021 has, as functional units, a preset setting acquisition unit A101, a video / still image switching unit A102, a preset movement state acquisition unit A103, a thumbnail image acquisition unit A104, and a thumbnail image superimposition unit A105.

[0044] The preset setting acquisition unit A101 acquires, from the storage unit 1018, preset settings corresponding to preset control commands received from the client device 2000. After acquisition, the display video generation unit 2005 transmits the acquired preset settings to the preset movement state acquisition unit A103, the image processing unit 1012, the pan-tilt control unit 1017, and the zoom control unit 1014. Furthermore, if a still image output setting during preset operation is registered in a preset, the display video generation unit 2005 transmits a still image output instruction to the video / still image switching unit A102 and an instruction to acquire a thumbnail image associated with the preset to the thumbnail image acquisition unit A104. In other words, the thumbnail image acquisition unit A104 transmits an instruction to acquire a thumbnail image corresponding to the preset position. Then, upon receiving the acquisition instruction, the thumbnail image acquisition unit A104 acquires a thumbnail image corresponding to the preset position and transmits it to the thumbnail image superimposition unit A105.

[0045] When the video / still image switching unit A102 receives a still image output instruction from the preset setting acquisition unit A101, it performs a process of switching the video to be output (output video) from a video to a still image. When this switching process starts, the video / still image switching unit A102 transmits image data of the still image to the thumbnail image superimposition unit A105. Furthermore, when the video / still image switching unit A102 receives a notification that the preset movement is complete from the preset movement status acquisition unit A103, it performs a process of switching the output from a still image to a video. When this switching process starts, it transmits image data captured by the imaging device 1000 to the communication unit 1020 without transmitting image data of the still image to the thumbnail image superimposition unit A105. Note that the process of switching the display video from a video to a still image and from a still image to a video, performed by the video / still image switching unit A102, will be described in detail later.

[0046] The preset movement state acquisition unit A103 compares the preset PTZ position received from the preset setting acquisition unit A101 with the current PTZ position of the imaging device 1000 acquired from the system control unit 1019. By comparing these, it is determined (discriminates) whether the preset movement is complete. The preset movement state acquisition unit A103 also transmits the preset movement state to the video / still image switching unit A102.

[0047] The thumbnail image acquisition unit A104 acquires, from the storage unit 1018, a thumbnail image corresponding to the preset control command received from the client device 2000. Thereafter, the thumbnail image acquisition unit A104 transmits the acquired thumbnail image to the thumbnail image superimposition unit A105.

[0048] The thumbnail image superimposing unit A105 superimposes the thumbnail image received from the thumbnail image acquiring unit A104 on the still image received from the video / still image switching unit A102, and transmits image data of the still image on which the thumbnail image is superimposed to the communication unit 1020. The image data of the still image on which the thumbnail image is superimposed is transmitted to the system control unit 2003 via the communication unit 2004 of the client device 2000. The thumbnail image superimposing unit A105 also functions as a superimposing unit when superimposing the thumbnail image on the still image.

[0049] Hereinafter, the image data output by the moving image / still image output unit 1021 and the process of switching between a moving image (first image) and a still image (second image) will be described with reference to Fig. 6. Fig. 6 is a diagram showing an example of a still image output according to the first embodiment.

[0050] A200 represents the display image displayed before the preset movement. A201 represents the display image displayed during the preset movement. A202 represents the display image displayed after the preset movement. Note that FIG. 6 shows the transition of the image during preset control when still image output is set.

[0051] A203, A204, and A205 each represent a human body. A206, A207, and A208 each represent the center of the angle of view of the imaging device 1000. Here, A206 has coordinate information (0,0), A207 has coordinate information (0,0), and A208 has coordinate information (-60,0). A209 represents a thumbnail image superimposed on a still image. Note that A201 is a state in which the imaging device 1000 is performing preset movement, and therefore a still image in which a thumbnail image is superimposed on a still image at coordinate information (0,0) is displayed on the display unit 2001 as a displayed image. Below, the state of the displayed image in the process of switching from a moving image to a still image and from a still image to a moving image will be described with reference to A200 to A202.

[0052] When the preset setting acquisition unit A101 receives a preset control command while the display image A200, which is a moving image (first image), is being displayed, the preset setting acquisition unit A101 acquires the still image output setting of the preset setting. Then, the moving image / still image switching unit A102 performs processing to switch from the display image A200 to still image output. When the switching processing starts, the thumbnail image superimposition unit A105 first superimposes the thumbnail image A209 acquired from the thumbnail image acquisition unit A104 on the still image received from the moving image / still image switching unit A102. Then, the image data of the still image on which the thumbnail image A209 is superimposed is transmitted to the communication unit 1020.

[0053] Specifically, the image data in which a thumbnail image is superimposed on a still image taken before or immediately before the preset movement (before or immediately before the operation of changing the orientation of the imaging device 1000) is transmitted to the communication unit 1020. It is preferable that the still image is a still image of the video being displayed on the display unit 2001 at the timing of switching the video. At this time, the video / still image switching unit A102 may transmit a command related to still image output to the client device 2000 via the communication unit 1020 as a response to the preset control command. Upon receiving the command, the display video generating unit 2005 transmits to the display unit 2001 a still image with the thumbnail image superimposed as the display video, rather than a video, as the video generated from the transmitted image data. It is also possible to stop the imaging operation of the imaging device 1000 or temporarily halt the transmission of image data of captured images other than the still image. In this way, the video / still image switching unit A102 switches the display video to be displayed on the display unit 2001 from a video to a still image based on the still image output instruction.

[0054] Then, while the display video A201, which is a still image with the thumbnail image A209 superimposed, is displayed, the preset movement status acquisition unit A103 checks (determines) whether the imaging device 1000 has reached the preset position (PTZ movement to the preset position has been completed). If the result of the check is that the imaging device 1000 is currently moving to the preset position, the display of the display video A201, which is a still image with the thumbnail image A209 superimposed, continues (still image output continues). On the other hand, when the preset movement status acquisition unit A103 checks that the imaging device 1000 has completed PTZ movement to the preset position (the orientation of the imaging device has reached the specified imaging position), the video / still image switching unit A102 starts processing to switch the output from still images to video. Note that once this switching processing starts, the video / still image switching unit A102 controls so that still images are not sent to the thumbnail image superimposition unit A105.

[0055] Specifically, the video / still image switching unit A102 transmits a command related to video output and image data captured by the imaging device 1000 to the client device 2000 via the communication unit 1020. The display image generation unit 2005 generates a video from the received image data based on the command and transmits the generated video to the display unit 2001 as a display image. Note that, if the transmission of image data of captured images other than still images has been temporarily stopped as described above, the transmission of image data captured by the imaging device 1000 is resumed. In this way, the video / still image switching unit A102 performs a process of switching the display image displayed on the display unit 2001 from a still image to a video based on a notification that the preset movement has been completed. The video / still image switching unit A102 also functions as a switching unit when switching from a video to a still image and from a still image to a video.

[0056] The above switching process switches the image from display image A201, which is a still image with thumbnail image A209 superimposed, to display image A202, which is a moving image. Furthermore, in this embodiment, switching from a still image to a moving image prevents the still image from being transmitted to the thumbnail image superimposition unit A105. As a result, image data of the still image with the thumbnail image superimposed is not transmitted to the client device 2000, and therefore, when generating a moving image based on the received image data, the display image generation unit 2005 can generate a moving image without a thumbnail image superimposed. In other words, thumbnail images are not superimposed on moving images that are displayed when preset movement is not in progress, but are superimposed only on still images that are displayed during preset movement.

[0057] The position of the thumbnail image superimposed on the still image is not limited to the bottom right as shown in FIG. 6 , but can be changed depending on the position of a person, object, or the like in the image. For example, using FIG. 6 as an example, the thumbnail image may be superimposed at a position (e.g., the top left) that does not overlap with the person A204. In other words, the thumbnail image may be superimposed at any position as long as it does not overlap with a person or object in the image. The thumbnail image may overlap with a person or object in the image. In this case, it is preferable that the superimposed thumbnail image be displayed in the foreground in the image. The position at which the thumbnail image is superimposed may also be specified in advance by a user operation. If a person, object, or the like is present at the position specified by a user operation, it is preferable that the thumbnail image be displayed in the foreground, as described above. If a person, object, or the like is present at the position specified by a user operation, the thumbnail image may also be automatically superimposed at a position where no person, object, or the like is present at the position specified by the user operation.

[0058] The size of the thumbnail image within the image can also be set arbitrarily. That is, the display of the thumbnail image shown in FIG. 6 is an example, and the size of the thumbnail image may be set in advance. Alternatively, the size may be set automatically depending on the position of a person or object in the image. The thumbnail image superimposing unit A105 may superimpose a thumbnail image that has been highlighted on the still image. Examples of highlighting include bolding the border, adding color to the border, using a different color scheme for the thumbnail image than the still image, or flashing the image. In addition to superimposing the thumbnail image, a sound may be used to notify the user or administrator that preset movement is in progress. In this case, it is preferable that the sound be such that it is easy to determine that preset movement is in progress, such as "Currently moving (rotating) to a preset position (predetermined imaging position)."

[0059] Hereinafter, a procedure for superimposing a thumbnail image on a still image displayed during preset movement will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the processing procedure of the video / still image output unit 1021 according to the first embodiment. Each of the following processes is realized by the system control unit 1019 (CPU 400) of the imaging device 1000 executing a program stored in memory. Each process (step) is represented by adding an S to the beginning to omit the description of the process (step). Furthermore, it is assumed that a video (first image) is displayed on the display unit 2001 as the display image before the start of the following processes.

[0060] In S101, the preset setting acquisition unit A101 determines whether or not a preset control command has been received from the communication unit 1020. If it is determined that a preset control command has been received, the process proceeds to S102. On the other hand, if it is determined that a preset control command has not been received, the process waits until a preset control command is received.

[0061] In S102, the preset setting acquisition unit A101 determines whether the preset control command received in S101 is a preset control command related to still image output. If it is determined that the preset control command received in S101 is a preset control command related to still image output, the preset setting acquisition unit A101 acquires the still image output setting of the preset setting from the storage unit 1018. Thereafter, the preset setting acquisition unit A101 transmits a still image output instruction to the video / still image switching unit A102 and transmits a thumbnail image acquisition instruction to the thumbnail image acquisition unit A104 based on the acquired still image output setting. Furthermore, the preset setting acquisition unit A101 transmits the preset position (PTZ position) to the preset movement state acquisition unit A103 and proceeds to S102. On the other hand, if the preset control command received in S101 is not a preset control command related to still image output, the processing ends without acquiring the still image output setting from the storage unit 1018.

[0062] In S103, the video / still image switching unit A102 starts processing to switch the output video from a video to a still image based on the still image output instruction transmitted from the preset setting acquisition unit A101 in S102. Then, image data of the still image is transmitted to the thumbnail image superimposition unit A105, and the process proceeds to S103. In other words, in S103, the video / still image switching unit A102 performs processing to switch the video from a video (first video) to a still image (second video) when changing the orientation of the imaging device 1000 so that it is in the predetermined imaging direction recorded in the storage unit 1018.

[0063] In S104, the thumbnail image acquisition unit A104 acquires a thumbnail image corresponding to the preset control command received in S101 from the storage unit 1018 and transmits the acquired thumbnail image to the thumbnail image superimposition unit A105. In other words, the thumbnail image acquisition unit A104 acquires the thumbnail image from the storage unit 1018 as related information (imaging position related information) related to the imaging direction corresponding to the preset control command. Next, the thumbnail image superimposition unit A105 performs a process of superimposing the acquired thumbnail image on the still image transmitted from the video / still image switching unit A102 in S103. Thereafter, it transmits image data of the still image on which the thumbnail image is superimposed to the communication unit 1020, and the process proceeds to S104. By performing the process of S104, the display image displayed on the display unit 2001 is switched from the video to the still image on which the thumbnail image is superimposed.

[0064] In S105, the preset movement status acquisition unit A103 acquires the current PTZ position acquired from the system control unit 1019. Then, the unit A103 compares the PTZ position (preset position) received from the preset setting acquisition unit A101 with the acquired current PTZ position of the imaging device 1000 to determine whether the preset movement is complete (determines whether the preset position has been reached). If it is determined that the preset movement is complete, the preset movement status acquisition unit A103 sends a video output instruction to the video / still image switching unit A102 and proceeds to S105. On the other hand, if it is determined that the preset movement is not complete, the unit A103 repeatedly performs the same determination process. That is, during the preset movement, a still image (second video) on which a thumbnail image is superimposed continues to be displayed on the display unit 2001.

[0065] In S106, the video / still image switching unit A102 starts processing to switch the output video from a still image to a video, based on the video output instruction transmitted from the preset movement state acquisition unit A103 in S105. When this switching processing starts, image data captured by the imaging device 1000 is transmitted to the client device 2000 via the communication unit 1020. By performing the processing of S106, the display video displayed on the display unit 2001 switches from a still image (second image) on which a thumbnail image is superimposed to a video (first image). At this time, the image data of the still image is not transmitted to the thumbnail image superimposition unit A105. Therefore, the processing of superimposing the thumbnail image on the still image ends.

[0066] The imaging device 1000 may be implemented so that it is possible to select whether to superimpose preset information such as thumbnail images on still images using a user's GUI operation, a remote control, or an internal setting value of the imaging device 1000.

[0067] Note that the thumbnail image superimposing unit A105 may superimpose a thumbnail image on the image data of the still image after the moving image / still image switching unit A102 switches from moving image to still image, and transmit the image data to the communication unit 1020. In this case, a still image without a thumbnail image superimposed thereon is first displayed on the display unit 2001, and then a still image with a thumbnail image superimposed thereon is displayed on the display unit 2001. Then, as described above, the still image with the thumbnail image superimposed thereon continues to be displayed on the display unit 2001 until processing for switching from a still image to a moving image is started.

[0068] As described above, according to the imaging device 1000 of the first embodiment, the video / still image output settings, thumbnail images, and preset movement status are acquired, and preset information such as thumbnail images is superimposed in accordance with the switching of still images in the video output during preset movement based on the acquired information. Then, during preset movement, a still image with the superimposed thumbnail image is displayed, and when the preset movement is complete, a video is displayed. This makes it easy to determine the destination of the preset movement from the displayed image, even if a still image is output during preset operation.

[0069] <Embodiment 2> An imaging system including the imaging device 1000 and the client device 2000 according to the second embodiment will be described below with reference to Fig. 8 and Fig. 9. Note that the following describes the functional configuration and hardware configuration of the imaging system including the imaging device 1000 and the client device 2000 according to the second embodiment that differ from those of the first embodiment, and a description of the similar functional configuration and hardware configuration will be omitted.

[0070] Fig. 8 is a block diagram showing the functional configuration of the moving image / still image output unit 1021 according to the second embodiment. Fig. 9 is a block diagram showing the functional configuration of the display image generation unit 2005 according to the second embodiment.

[0071] The video / still image output unit 1021 analyzes preset control commands received by the communication unit 1020 from the client device 2000 via the network 3000, and controls video and still image output and transmits preset information. In the second embodiment, the video / still image output unit 1021 is described as a block within the system control unit 1019 of the imaging device 1000, but it may also be included in the image processing unit 1012. The video / still image output unit 1021 has a preset setting acquisition unit A301, a video / still image switching unit A302, a preset movement state acquisition unit A303, a thumbnail image acquisition unit A304, and a preset information transmission unit A305.

[0072] The preset setting acquisition unit A301 acquires, from the storage unit 1018, preset settings corresponding to preset control commands received from the client device 2000. The acquired preset settings are transmitted to the preset movement state acquisition unit A303, preset information transmission unit A305, image processing unit 1012, pan / tilt control unit 1017, and zoom control unit 1014. If a still image output setting during preset operation is registered in a preset, the unit A301 transmits a still image output instruction to the video / still image switching unit A302 and an instruction to acquire a thumbnail image linked to the preset to the thumbnail image acquisition unit A304.

[0073] When the video / still image switching unit A302 receives a still image output instruction from the preset setting acquisition unit A301, it performs processing to switch the video to be output (output video) from a video to a still image. When this switching processing starts, the video / still image switching unit A302 transmits image data of the still image to the communication unit 1020. Furthermore, when it receives a notification from the preset movement status acquisition unit A303 that the preset movement has been completed, it performs processing to switch from a still image to a video. When this switching processing starts, the video / still image switching unit A302 transmits image data to the communication unit 1020.

[0074] The preset movement status acquisition unit A303 compares the preset PTZ position received from the preset setting acquisition unit A301 with the current PTZ position of the imaging device 1000 acquired from the system control unit 1019. By comparing these, it is determined (discriminates) whether the preset movement is complete. The preset movement status acquisition unit A303 also transmits the preset movement status to the video / still image switching unit A302 and the preset information transmission unit A305.

[0075] The thumbnail image acquisition unit A304 acquires, from the storage unit 1018, a thumbnail image corresponding to the preset control command received from the client device 2000. Thereafter, the thumbnail image acquisition unit A304 transmits the acquired thumbnail image to the preset information transmission unit A305.

[0076] The preset information transmission unit A305 transmits the preset information received from the preset movement status acquisition unit A303 and the thumbnail image acquisition unit A304 to the communication unit 1020. The transmission of the preset information is performed when the preset movement is not completed.

[0077] The display image generation unit 2005 performs processing to generate a display image to be displayed on the display unit 2001 based on image data of a still image and preset information (information relating to imaging direction / imaging position) received by the communication unit 2004 from the imaging device 1000 via the network 3000. The display image generation unit 2005 functions as a display image generation means when generating the display image. The communication unit 2004 also functions as a receiving means for receiving image data of a still image and preset information transmitted from the imaging device 1000. The display image generation unit 2005 has a preset information acquisition unit A401, a preset progress prediction unit A402, and a preset information superimposition unit A403.

[0078] The preset information acquisition unit A401 acquires preset information via the communication unit 1020 and the communication unit 2004, and transmits the preset information to each processing unit. For example, when a thumbnail image is to be superimposed on a still image, the preset information acquisition unit A401 transmits the thumbnail image acquired from the communication unit 1020 to the preset information superimposition unit A403. When a progress bar is to be superimposed on a still image, the preset PTZ position, PTZ speed, and current PTZ position of the imaging device 1000 are transmitted to the preset progress prediction unit A402.

[0079] The preset progress prediction unit A402 receives the preset PTZ position, PTZ speed, and current PTZ position of the imaging device 1000 from the preset information acquisition unit A401, calculates the progress of the preset control, and transmits it to the preset information superimposition unit A403.

[0080] The preset information superimposing unit A403 superimposes preset information received from the preset information acquiring unit A401 on image data of a still image received via the communication unit 1020 and the communication unit 2004. Furthermore, a progress bar is generated based on the progress of preset control calculated by the preset progress predicting unit A402, and the generated progress bar is superimposed on the image data of the still image. The progress bar in this embodiment is information indicating the progress of the imaging device 1000 moving to a predetermined imaging direction (preset position). The preset information superimposing unit A403 checks the preset movement status received from the preset information acquiring unit A401, and when the preset movement is complete, cancels the superimposition of the preset information and progress bar that have been applied to the still image. Whether or not to superimpose each piece of preset information can be selected, and this may be selected by a user operation (for example, a GUI operation), or a display setting may be stored internally for each client device.

[0081] The transition of the displayed image during preset control when a still image output setting is made will be described below with reference to Fig. 10. Fig. 10 is a diagram showing an example of a still image output according to the second embodiment.

[0082] A500, A600, and A700 represent display images displayed before the preset movement. A501, A601, and A701 represent display images displayed during the preset movement. A502, A602, and A702 represent display images displayed after the preset movement.

[0083] Fig. 10(A) shows the transition of an image when a thumbnail image A509 and a progress bar A510 are superimposed as preset information on a still image displayed on the display unit 2001. Fig. 10(B) shows the transition of an image when a progress bar A510 is superimposed as preset information on a still image displayed on the display unit 2001. Fig. 10(C) shows the transition of an image when a preset name (a character string related to a predetermined imaging direction of the imaging device) and information A511 about the current PTZ position of the imaging device are superimposed as preset information on a still image displayed on the display unit 2001. Note that Fig. 10 shows an example of a display when related information related to the imaging direction is superimposed on a still image in this embodiment, and a display method other than that shown in Fig. 10 may also be used, and is not limited to this.

[0084] 10 are similar to A203 to A208 shown in FIG. 6 of the first embodiment, and therefore will not be described again, and the x and y axes are also similar and therefore will not be shown. Below, a case where a thumbnail image A509 and a progress bar A510 are superimposed during output of a still image will be described with reference to FIG. 10(A).

[0085] When the preset setting acquisition unit A301 receives a preset control command while the display image A500, which is a moving image (first image), is being displayed, the preset setting acquisition unit A301 acquires the still image output setting of the preset setting. Then, the moving image / still image switching unit A302 performs processing to switch to still image output. When the switching processing starts, the preset information transmission unit A305 transmits the preset PTZ position and PTZ speed received from the preset movement state acquisition unit A303, as well as the current PTZ position and preset movement state of the imaging device 1000, to the communication unit 1020. Furthermore, the preset information transmission unit A305 transmits the thumbnail image A509 received from the thumbnail image acquisition unit A304 to the communication unit 1020.

[0086] Next, the preset information acquisition unit A401 transmits the thumbnail image A509 to the preset information superimposition unit A403. The preset information superimposition unit A403 superimposes the thumbnail image A509 on the image data of the still image received from the communication unit 2004. The preset information acquisition unit A401 also transmits the preset PTZ position, PTZ speed, and current PTZ position of the imaging device 1000 to the preset progress prediction unit A402. The preset progress prediction unit A402 then calculates the progress status of preset control based on the acquired information and transmits it to the preset information superimposition unit A403. The preset information superimposition unit A403 generates a progress bar A510 for the image data of the still image received from the communication unit 1020 based on the information on the progress status of preset control and superimposes it on the image data. In this way, the preset information superimposing unit A403 superimposes the thumbnail image A509 and the progress bar A510 on the image data of the still image to generate a display image A501 on which the preset information is superimposed.

[0087] Then, while the display image A501, which is a still image with the thumbnail image A509 and the progress bar A510 superimposed, is displayed, the preset movement status acquisition unit A303 checks (determines) whether the imaging device 1000 has reached the preset position. If the result of the check is that the imaging device 1000 is currently moving to the preset position, the display of the display image A501, which is a still image with the thumbnail image A509 and the progress bar A510 superimposed, continues (continues to output the still image). On the other hand, when the preset movement status acquisition unit A303 checks that the imaging device 1000 has completed PTZ movement to the preset position, the video / still image switching unit A302 starts processing to switch the output from still images to video. When the switching process starts, the preset information superimposition unit A403 refers to the preset movement status acquired by the preset information acquisition unit A401 and cancels the superimposition of the preset information that had been applied to the still image. In other words, when the orientation of the imaging device reaches a predetermined imaging direction (preset position), the superimposition of the preset information that had been applied to the still image is canceled. This switching process switches the image from display image A501, which is a still image in which thumbnail image A509 and progress bar A510 are superimposed, to display image A502, which is a moving image.

[0088] 10B, a case where only the progress bar A510 is superimposed on image data that is a still image will be described. When the preset setting acquisition unit A301 receives a preset control command while the display image A600, which is a moving image (first image), is being displayed, the preset setting acquisition unit A301 acquires the still image output setting of the preset setting. Then, the moving image / still image switching unit A302 performs processing to switch to still image output. When the switching processing starts, the preset information transmission unit A305 transmits to the communication unit 1020 the preset PTZ position and PTZ speed received from the preset movement state acquisition unit A303, as well as the current PTZ position and preset movement state of the imaging device 1000.

[0089] Next, the preset information acquisition unit A401 transmits the preset PTZ position, PTZ speed, and current PTZ position of the imaging device 1000 to the preset progress prediction unit A402. Based on this information, the preset progress prediction unit A402 calculates the progress status of the preset control and transmits it to the preset information superimposition unit A403. The preset information superimposition unit A403 generates a progress bar A510 based on the progress status of the preset control and superimposes it on the image data of the still image received from the communication unit 1020. In this way, the preset information superimposition unit A403 superimposes the progress bar A510 on the image data of the still image to generate a display image A601 on which the preset information is superimposed.

[0090] Then, while the display image A601, which is a still image on which the progress bar A510 is superimposed, is displayed, the preset movement status acquisition unit A303 checks (determines) whether the imaging device 1000 has reached the preset position (PTZ movement to the preset position has been completed). If the result of the check is that the imaging device 1000 is currently moving to the preset position, the display of the display image A601, which is a still image on which the progress bar A510 is superimposed, continues (continues to output the still image). On the other hand, when the preset movement status acquisition unit A303 checks that the imaging device 1000 has completed PTZ movement to the preset position, the video / still image switching unit A302 starts processing to switch the output from still images to video. When the switching process starts, the preset information superimposition unit A403 references the preset movement status acquired by the preset information acquisition unit A401 and cancels the superimposition of the preset information that had been applied to the still image. This switching process switches the image from display image A601, which is a still image on which progress bar A510 is superimposed, to display image A602, which is a moving image.

[0091] 10C, a case will be described below in which information A511 about the preset name and the current PTZ position of the imaging device 1000 is superimposed on image data that is a still image. When the preset setting acquisition unit A301 receives a preset control command while a display image A700 that is a moving image (first image) is being displayed, the preset setting acquisition unit A301 acquires the still image output setting of the preset setting. Then, the moving image / still image switching unit A302 performs processing to switch to still image output. When the switching processing starts, the preset information transmission unit A305 transmits the preset name and the current PTZ position of the imaging device 1000 received from the preset movement state acquisition unit A303 to the communication unit 1020.

[0092] Next, the preset information acquisition unit A401 transmits the preset name and the current PTZ position of the imaging device 1000 to the preset information superimposing unit A403. The preset information superimposing unit A403 superimposes information A511 of the preset name and the current PTZ position of the imaging device 1000 on the image data of the still image received from the communication unit 1020. In this way, the preset information superimposing unit A403 superimposes information A511 of the preset name and the current PTZ position of the imaging device 1000 on the image data of the still image, thereby generating a display image A701 on which the preset information is superimposed.

[0093] Then, while the still image A701 on which the preset name and information A511 of the current PTZ position of the imaging device 1000 are superimposed is displayed, the preset movement status acquisition unit A303 checks (determines) whether the imaging device 1000 has reached the preset position. If the result of the check is that the imaging device 1000 is in preset movement, the display of the display video A601, which is the still image on which the preset name and information A511 of the current PTZ position of the imaging device 1000 are superimposed (still image output continues). On the other hand, when the preset movement status acquisition unit A303 checks that the imaging device 1000 has completed PTZ movement to the preset position, the video / still image switching unit A302 starts processing to switch the output from still images to video. When the switching process starts, the preset information superimposition unit A403 references the preset movement status acquired by the preset information acquisition unit A401 and cancels the superimposition of the preset information that was being applied to the still image. This switching process switches the image from display image A701, which is a still image on which information A511 about the preset name and the current PTZ position of the image capturing device 1000 is superimposed, to display image A702, which is a moving image.

[0094] In this way, the preset information superimposing unit A403 generates a display video on which the preset information is superimposed by superimposing one or more pieces of preset information on the image data of a still image. The number of pieces of preset information to be superimposed is not limited to one. As shown in FIG. 10A, a display video can be generated by combining two pieces of preset information, a thumbnail image A509 and a progress bar A510, and superimposing the combined pieces of preset information on the image data of a still image. For example, the preset information to be superimposed may be two pieces: a thumbnail image A509 and information A511 on the preset name and the current PTZ position of the imaging device 1000. Alternatively, the progress bar A510 and information A511 on the preset name and the current PTZ position of the imaging device 1000. In other words, any combination of pieces of preset information can be superimposed. The number of pieces of preset information to be superimposed is not limited to two. Three or more pieces of preset information may be superimposed on the image data of a still image. In addition, information related to the imaging direction of an imaging device other than those described above or information related to an imaging device may also be used as preset information, in which case the information may be superimposed on the image data of a still image, or may be superimposed in combination with the above-mentioned preset information.

[0095] Hereinafter, with reference to Fig. 11, a procedure in which the imaging device 1000 outputs preset information to the client device 2000 when outputting a still image following preset movement will be described. Fig. 11 is a flowchart showing the processing procedure of the video / still image output unit 1021 according to the second embodiment. Each of the following processes is realized by the system control unit 1019 (CPU 400) of the imaging device 1000 executing a program stored in memory. Each process (step) is represented by adding an S to the beginning to omit the description of the process (step). Furthermore, it is assumed that a video (first image) is displayed on the display unit 2001 as the display image before the start of the following processes.

[0096] In S201, the preset setting acquisition unit A301 determines whether or not a preset control command has been received from the communication unit 1020. If it is determined that a preset control command has been received, the process proceeds to S102. On the other hand, if it is determined that a preset control command has not been received, the process waits until a preset control command is received.

[0097] In S202, the preset setting acquisition unit A301 determines whether the preset control command received in S201 is a preset control command related to still image output. If it is determined that the preset control command received in S201 is a preset control command related to still image output, the preset setting acquisition unit A301 acquires the still image output setting of the preset setting from the storage unit 1018. Then, based on the acquired still image output setting, the preset setting acquisition unit A301 sends a still image output instruction to the video / still image switching unit A302 and sends a thumbnail image acquisition instruction to the thumbnail image acquisition unit A304. The preset setting acquisition unit A301 also sends the preset position to the preset movement state acquisition unit A303 and proceeds to S302. On the other hand, if the preset control command received in S201 is not a preset control command related to still image output, the processing ends without acquiring the still image output setting from the storage unit 1018.

[0098] In S203, the video / still image switching unit A302 starts processing to switch the output video from a video to a still image based on the still image output instruction transmitted from the preset setting acquisition unit A101 in S102, and transmits image data of the still image to the communication unit 1020.

[0099] In S204, the thumbnail image acquisition unit A304 acquires a thumbnail image corresponding to the preset control command received in S101 from the storage unit 1018, and the preset information transmission unit A305 transmits the acquired thumbnail image to the communication unit 1020.

[0100] In S205, the preset information transmission unit A305 transmits the preset movement state, the PTZ position and PTZ speed registered in the preset, and the current PTZ position of the imaging device 1000 to the communication unit 1020.

[0101] In S206, the preset movement status acquisition unit A303 acquires the current PTZ position of the imaging device 1000 acquired from the system control unit 1019. Then, the unit A303 compares the PTZ position (preset position) received from the preset setting acquisition unit A301 with the current PTZ position of the imaging device 1000 acquired from the system control unit 1019 to determine whether the preset movement is complete. If it is determined that the preset movement is complete, the preset movement status acquisition unit A303 sends a video output instruction to the video / still image switching unit A302 and proceeds to S207. On the other hand, if it is determined that the preset movement is not complete, the unit A303 repeatedly performs the same determination process until the preset movement is complete.

[0102] In S207, the video / still image switching unit A302 starts processing to switch the output video from a still image to a video, based on the video output instruction transmitted from the preset movement state acquisition unit A303 in S206. When this switching processing starts, image data captured by the imaging device 1000 is transmitted to the client device 2000 via the communication unit 1020. Then, the processing ends.

[0103] The procedure by which the client device 2000 superimposes preset information (thumbnail image and progress bar) on a still image will be described below with reference to Fig. 12. Fig. 12 is a flowchart showing the processing procedure of the display image generation unit 2005 according to the second embodiment. Each of the following processes is realized by the system control unit 2003 (CPU 400) of the client device 2000 executing a program stored in memory. Each process (step) is represented by adding an S to the beginning, thereby abbreviating the notation of the process (step).

[0104] In S301, the preset information superimposing unit A403 determines whether or not to superimpose a thumbnail image on image data of a still image based on a user's GUI operation, internal setting values, etc. If it is determined that the thumbnail image is to be superimposed and displayed, the process proceeds to S302. On the other hand, if it is determined that the thumbnail image is not to be superimposed and displayed, the process proceeds to S303.

[0105] In S302, the preset information superimposing unit A403 superimposes the thumbnail image acquired by the preset information acquiring unit A401 on the still image transmitted from the communication unit 1020.

[0106] In S303, the preset information superimposing unit A403 determines whether or not to superimpose a progress bar on the image data of a still image based on the user's GUI operation, internal setting values, etc. If it is determined that the progress bar should be superimposed and displayed, the process proceeds to S304. On the other hand, if it is determined that the progress bar should not be superimposed and displayed, the process proceeds to S307.

[0107] In S304, the preset information acquisition unit A401 causes the preset progress prediction unit A402 to calculate a preset progress status from the acquired preset PTZ position, PTZ speed, and current PTZ position of the imaging device 1000. Then, the preset progress prediction unit A402 transmits the calculated preset progress status to the preset information superimposition unit A403.

[0108] In S305, the preset information superimposing unit A403 generates a progress bar based on the preset progress status, superimposes the still image transmitted from the communication unit 1020 on the progress bar, and the process proceeds to S306.

[0109] In S306, it is determined whether the preset movement is complete based on the preset movement status acquired by the preset information acquisition unit A401. If it is determined that the preset movement is complete, the process proceeds to S307. On the other hand, if it is determined that the preset movement is not complete, the process returns to S304.

[0110] In S307, the preset information superimposing unit A403 cancels the superimposition of the preset information that has been superimposed on the still image, and then ends the process.

[0111] As described above, according to the second embodiment, when a still image is output during preset movement, the imaging device 1000 outputs preset information such as a thumbnail image to the client device 2000. Then, the client device 2000 performs a process of superimposing the preset information. This allows the destination of the preset movement to be easily identified from the displayed image while superimposing the preset information according to the use case.

[0112] In each of the above embodiments, the process of displaying video data or image data on the display unit 2001 is performed by the system control unit 2003 of the client device 2000. However, this is not limiting, and the system control unit 1019 of the imaging device 1000 may display video, still images, or other images captured by the imaging unit 1011 on the display unit 2001. In this case, the system control unit 1019 also functions as a display control unit.

[0113] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0114] Furthermore, the functions of the above-described embodiments are not only realized by the computer reading and executing the program code, but also include the operating system (OS) running on the computer performing some or all of the actual processing based on the instructions of the program code.

[0115] Furthermore, the functions of the above-described embodiments may be realized by the following method: Program code is read from a recording medium and written to memory in a function expansion card inserted into a computer or in a function expansion unit connected to the computer. Then, based on the instructions of the program code, a CPU or the like in the function expansion card or the function expansion unit performs some or all of the actual processing.

[0116] When the present invention is applied to the above-mentioned recording medium, the recording medium stores program codes corresponding to the flowcharts described above.

[0117] Although the preferred embodiments of the present invention have been described in detail above, the present invention is not limited to such specific embodiments, and various modifications and variations are possible within the scope of the gist of the present invention as set forth in the claims.

[0118] The disclosure of this embodiment includes the following configuration, method, and program.

[0119] (Configuration 1) a registration means for registering one or more pieces of information indicating an imaging direction of the imaging device; a switching means for switching an image from a first image captured by the imaging device to a second image different from the first image when changing the imaging direction of the imaging device to the predetermined imaging direction recorded in the registration means; and a superimposing means for superimposing related information relating to the predetermined imaging direction on the second image when switching to the second image. A control device characterized by:

[0120] (Configuration 2) The control device according to configuration 1, wherein the switching means switches the image from the second image to the first image when the imaging direction of the imaging device becomes the predetermined imaging direction.

[0121] (Configuration 3) 3. The control device according to configuration 1 or 2, wherein the superimposing means does not superimpose the related information on the first video.

[0122] (Configuration 4) 4. The control device according to any one of configurations 1 to 3, wherein the superimposing means superimposes the related information on the second video after switching to the second video.

[0123] (Configuration 5) the first video is a video captured by the imaging device, 5. The control device according to any one of configurations 1 to 4, wherein the second video is a still image of the first video that was displayed at the timing when the video was switched by the switching means.

[0124] (Configuration 6) 6. The control device according to any one of configurations 1 to 5, wherein the related information is a thumbnail image.

[0125] (Configuration 7) An information processing device configured to be able to communicate with the control device according to claim 1, a receiving means for receiving the second video and the related information from the control device; and a display image generating means for generating a display image to be displayed on a display means based on the second image and the related information. 1. An information processing device comprising:

[0126] (Configuration 8) 8. The information processing device according to configuration 7, wherein the display image generating means generates the display image by superimposing the related information on the second image.

[0127] (Configuration 9) 9. The information processing device according to configuration 7 or 8, wherein the display image generating means cancels the superimposition of the related information when the imaging direction of the imaging device becomes the predetermined imaging direction.

[0128] (Configuration 10) 10. The information processing device according to any one of configurations 7 to 9, wherein the related information is a thumbnail image.

[0129] (Configuration 11) 11. The information processing device according to any one of configurations 7 to 10, wherein the related information is a character string related to the predetermined imaging direction of the imaging device.

[0130] (Configuration 12) 12. The information processing device according to any one of configurations 7 to 11, wherein the related information is information about the imaging direction of the imaging device.

[0131] (Configuration 13) 13. The information processing device according to any one of configurations 7 to 12, wherein the related information is information indicating a progress status of the imaging device as it moves in the predetermined imaging direction.

[0132] (Configuration 14) 14. The information processing device according to any one of configurations 7 to 13, further comprising display control means for causing the second video to be displayed on the display means.

[0133] (Configuration 15) 15. The information processing device according to any one of configurations 7 to 14, wherein the second video is a still image of the first video that was displayed at the timing when the video was switched by the switching means.

[0134] (Configuration 16) the related information includes a thumbnail image, a character string related to the predetermined imaging direction of the imaging device, information on the imaging direction of the imaging device, and information indicating a progress status of the imaging device moving toward the predetermined imaging direction; The information processing device of any one of configurations 7 to 9, wherein the display image generating means generates the display image by superimposing on the second image a combination of at least two of the thumbnail image, a character string related to the predetermined imaging direction of the imaging device, information about the imaging direction of the imaging device, and information indicating a progress status of the imaging device moving in the predetermined imaging direction.

[0135] (Configuration 17) a registration step of registering one or more pieces of information indicating an imaging direction of the imaging device; a switching step of switching an image from a first image captured by the imaging device to a second image different from the first image when changing the imaging direction of the imaging device to the predetermined imaging direction recorded in the registration step; and a superimposing step of superimposing related information related to the predetermined imaging direction on the second image when switching to the second image. A control method for a control device.

[0136] (Configuration 18) A control method for an information processing device configured to be able to communicate with the control device according to claim 1, a receiving step of receiving the second video and the related information from the control device; and a display image generating step of generating a display image to be displayed on a display means based on the second image and the related information. 2. A method for controlling an information processing apparatus comprising:

[0137] (Configuration 19) 19. A program for causing a computer to execute the control method according to configuration 17 or 18. [Explanation of symbols]

[0138] 1000 Imaging Device 1011 Imaging unit 1018 Storage section 1019 System control unit 1020 Communications Department 1021 Video / still image switching section 2000 client devices 2001 Display section 2002 Input section 2003 System Control Unit 2004 Communications Department 2005 Display image generation unit

Claims

1. a registration means for registering one or more pieces of information indicating an imaging direction of the imaging device; a switching means for switching an image from a first image captured by the imaging device to a second image different from the first image when changing the imaging direction of the imaging device to the predetermined imaging direction recorded in the registration means; and a superimposing unit that superimposes related information related to the predetermined imaging direction on the second image when switching to the second image. A control device characterized by:

2. 2. The control device according to claim 1, wherein the switching means switches the image from the second image to the first image when the imaging direction of the imaging device becomes the predetermined imaging direction.

3. The control device according to claim 1 , wherein the superimposing means does not superimpose the related information on the first video.

4. 2. The control device according to claim 1, wherein the superimposing means superimposes the related information on the second video after switching to the second video.

5. the first video is a video captured by the imaging device, 2. The control device according to claim 1, wherein the second video is a still image of the first video that was displayed at the timing when the video was switched by the switching means.

6. 2. The control device according to claim 1, wherein the related information is a thumbnail image.

7. An information processing device configured to be able to communicate with the control device according to claim 1, a receiving means for receiving the second video and the related information from the control device; a display image generating means for generating a display image to be displayed on a display means based on the second image and the related information, 1. An information processing device comprising:

8. The information processing device according to claim 7 , wherein the display image generating means generates the display image by superimposing the related information on the second image.

9. 8. The information processing apparatus according to claim 7, wherein the display image generating means cancels the superimposition of the related information when the imaging direction of the imaging device becomes the predetermined imaging direction.

10. 8. The information processing apparatus according to claim 7, wherein the related information is a thumbnail image.

11. The information processing apparatus according to claim 7 , wherein the related information is a character string related to the predetermined imaging direction of the imaging device.

12. 8. The information processing apparatus according to claim 7, wherein the related information is information about an imaging direction of the imaging device.

13. 8. The information processing apparatus according to claim 7, wherein the related information is information indicating a progress status of the image capture device as it moves in the predetermined image capture direction.

14. 8. The information processing apparatus according to claim 7, further comprising display control means for displaying the second video on the display means.

15. 8. The information processing apparatus according to claim 7, wherein the second video is a still image of the first video that was displayed at the timing when the video was switched by the switching means.

16. the related information includes a thumbnail image, a character string related to the predetermined imaging direction of the imaging device, information on the imaging direction of the imaging device, and information indicating a progress status of the imaging device moving toward the predetermined imaging direction; The information processing device according to claim 7, characterized in that the display image generating means generates the display image by superimposing on the second image a combination of at least two of the thumbnail image, a character string related to the specified imaging direction of the imaging device, information on the imaging direction of the imaging device, and information indicating a progress status of the imaging device moving in the specified imaging direction.

17. a registration step of registering one or more pieces of information indicating an imaging direction of the imaging device; a switching step of switching an image from a first image captured by the imaging device to a second image different from the first image when changing the imaging direction of the imaging device to the predetermined imaging direction recorded in the registration step; a superimposing step of superimposing related information related to the predetermined imaging direction on the second image when switching to the second image. A control method for a control device.

18. A control method for an information processing device configured to be able to communicate with the control device according to claim 1, comprising: a receiving step of receiving the second video and the related information from the control device; a display image generating step of generating a display image to be displayed on a display means based on the second image and the related information.

2. A method for controlling an information processing apparatus comprising:

19. A program for causing a computer to execute the control method according to claim 17 or 18.

Images