Camera device, camera method, display device, and display method

Abstract

The present invention provides a camera device, a camera method, a display device, and a display method. The camera device is capable of changing a shooting area while allowing a user to confirm the current state of a previously shot area. The camera device includes: a first camera unit for shooting a first shooting area; a second camera unit for shooting a second shooting area within the first shooting area; an output unit for cutting out an image of the second shooting area and outputting the cut-out image; a display control unit for causing a client device to display the shot image of the first shooting area and causing the client device to display the cut-out image; and a change unit for, when one of a plurality of cut-out images output by the output unit is selected, changing the second shooting area to a shooting area corresponding to the selected cut-out image.

Description

[0001] (This application is a divisional application of an application filed on November 9, 2018, with application number 201811331758.8 and entitled “IMAGING DEVICE, IMAGING METHOD, DISPLAY DEVICE, AND DISPLAY METHOD.”) Technical Field

[0002] The present invention relates to an imaging device, an imaging method, a display device, and a display method. Background Art

[0003] Conventionally, one way a user can change the shooting area of ​​a camera is by using images captured in the past. For example, Japanese Patent Application Laid-Open No. 2007-43505 discloses a technique in which a panoramic image created using previously captured images is displayed on a display unit, and when a user selects a specific area in the displayed panoramic image, the shooting area is changed to the selected area. Japanese Patent Application Laid-Open No. 2014-236313 discloses a technique in which, when capturing the same area using the same camera, the pan angle, tilt angle, or zoom position, etc., are acquired from previously captured images, and the image is captured using the same pan angle, etc., as the previously captured images.

[0004] The techniques of Japanese Patent Application Laid-Open Nos. 2007-43505 and 2014-236313 utilize images captured in the past, making them useful for reducing load or power consumption, or for comparing the status of the same captured area at a certain past time with the current time. However, if the subject of interest is a moving object, it is necessary to always use the latest image status in order to change the captured area after confirming that a moving object has appeared in a specific area.

[0005] However, Japanese Patent Application Laid-Open Nos. 2007-43505 and 2014-236313 do not support such a demand. Therefore, an object of the present invention is to enable a user to confirm the current state of a past shooting area while enabling a shooting area of ​​an imaging device to be changed. Summary of the Invention

[0006] According to the present invention, a camera device includes: a first camera unit for photographing a first photographing area; a second camera unit for photographing a second photographing area of ​​the first photographing area; a holding unit for holding position information corresponding to the second photographing area photographed by the second camera unit; an output unit for outputting a cut-out image of the second photographing area corresponding to the position information held by the holding unit in the photographed image photographed by the first camera unit; and a changing unit for controlling the second camera unit to photograph the second photographing area corresponding to the selected cut-out image when one of the multiple cut-out images output by the output unit is selected.

[0007] According to the present invention, a display device includes: a first display unit, which is used to display in real time on the display an image of a first shooting area captured by a first camera unit; a second display unit, which is used to display in real time on the display an image of a second shooting area captured by a second camera unit, wherein the second shooting area is narrower than the first shooting area; and a third display unit, which is used to obtain an image corresponding to a third shooting area captured by the second camera unit from the image captured by the first camera unit, and display the obtained image on the display.

[0008] According to a camera method of the present invention, the following steps are included: photographing a first photographing area by using a first camera unit; photographing a second photographing area of ​​the first photographing area by using a second camera unit; maintaining position information corresponding to the second photographing area photographed by the second camera unit by using a holding unit; outputting a cut-out image of the second photographing area corresponding to the position information held by the holding unit in the photographed image photographed by the first camera unit; and when one of the multiple cut-out images outputted is selected, controlling the second camera unit to photograph the second photographing area corresponding to the selected cut-out image.

[0009] According to a display method of the present invention, the present invention includes the following steps: displaying a captured image of a first capturing area captured by a first camera unit on a display in real time; displaying a captured image of a second capturing area captured by a second camera unit on the display in real time, wherein the second capturing area is narrower than the first capturing area; and acquiring an image corresponding to a third capturing area captured by the second camera unit from the captured image captured by the first camera unit, and displaying the acquired image on the display.

[0010] Further features of the present invention will become apparent from the following description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] Figure 1It is a block diagram of a camera device and a UI display unit.

[0012] Figure 2 is a diagram showing a UI display unit.

[0013] Figure 3 is a flowchart illustrating a method of changing a photographing area.

[0014] Figure 4A and Figure 4B It is a diagram showing a method of changing the imaging area.

[0015] Figure 5 is a diagram showing a UI display unit.

[0016] Figure 6 is a flowchart illustrating a method of changing a photographing area.

[0017] Figure 7A and Figure 7B It is a diagram showing a method of changing the imaging area. DETAILED DESCRIPTION

[0018] Preferred embodiments of the present invention will now be described in detail with reference to the accompanying drawings.

[0019] Camera system

[0020] Will refer to Figure 1 The camera system 10 according to the first embodiment of the present invention is described below. The camera system 10 has a camera device 100 and a UI display unit 140 connected to the camera device 100 via an IP network 130. The camera device 100 is installed on the ceiling or wall of a room. The UI display unit 140 is a display device (client device) that is a general-purpose computer with a CPU, ROM, and RAM. The camera device 100 has a wide-angle camera 110, a pan-tilt-zoom camera (PTZ camera) 120, a system control unit 124, and a storage unit 125. The camera device 100 of this embodiment is a camera device in which the wide-angle camera 110 and the PTZ camera 120 are integrated. The wide-angle camera 110 and the PTZ camera 120 are housed in the same housing. In a state where the camera device 100 and the UI display unit 140 can communicate with each other, the camera device 100 is connected to the UI display unit 140 via the IP network 130 by wire or wirelessly. The term UI is an abbreviation of user interface.

[0021] The wide-angle camera 110 includes a photographic optical system 111 formed of a wide-angle lens, etc., for capturing images with a wide angle of view, an imaging device unit 112, and an image processing unit 113. The wide-angle camera 110 of this embodiment does not include components for changing the photographic direction (pan angle, pitch angle) or zoom position (angle of view). Furthermore, the wide-angle camera 110 of this embodiment is formed by a single camera. The wide-angle camera 110 has a wider angle of view than the PTZ camera 120. The wide-angle camera 110 photographs a predetermined photographic area.

[0022] The PTZ camera 120 includes a photographic optical system 121 formed of a zoom lens, a focus lens, or an aperture mechanism, an imaging device unit 122, an image processing unit 123, a drive control unit 126, a zoom motor 127, a pan motor 128, and a tilt motor 129. The PTZ camera 120 can adjust the focus or aperture by driving the photographic optical system 121 using the drive control unit 126. Furthermore, the PTZ camera 120 can change its photographic direction or angle of view by driving the zoom motor 127, the pan motor 128, and the tilt motor 129. In other words, the PTZ camera 120 can change its photographic area. The PTZ camera 120 stores information related to the pan angle, the tilt angle, and the zoom position (angle of view) obtained before the photographic area is changed in the storage unit 125. Although the viewing angle of the PTZ camera 120 is narrower than that of the wide-angle camera 110, the PTZ camera 120 can change the photographing area within the entire viewing angle of the wide-angle camera 110 by driving the motors 127, 128, and 129. The PTZ camera 120 photographs a photographing area within a predetermined photographing area photographed by the wide-angle camera 110.

[0023] The system control unit 124 performs processing such as camera control, image encoding (coding), display image generation, storage in the storage unit 125, network transmission, and cropping of images from the wide-angle camera 110 (digital PTZ). The camera control performed by the system control unit 124 includes control of the wide-angle camera 110 and the PTZ camera 120. When cropping an image from the wide-angle camera 110, a specific area is specified within the image captured by the wide-angle camera 110 and displayed on the UI display unit 140, thereby enabling cropping. The system control unit 124 outputs the cropped image as a cropped image. The system control unit 124 is formed, for example, by a CPU. The system control unit 124 transmits the image captured by the wide-angle camera 110 to the UI display unit 140.

[0024] The storage unit 125 is formed of, for example, a ROM and a RAM. For example, the ROM stores programs and the like required for the system control unit (CPU) 124 to perform processing. The CPU performs processing based on the programs stored in the ROM, thereby realizing the functions or processing ( Figure 3 ) and the like. Note that the program and the like can be stored in an external memory or a removable storage medium (not shown). The RAM is a memory device for developing the program read by the CPU and performing its processing. In addition, as a temporary memory, the RAM is also used as a storage area for temporarily storing data to be processed in various ways. In addition, the storage unit 125 can hold a plurality of pan-tilt-zoom (PTZ) position information viewed in the past by the PTZ camera 120. For the position viewed by the PTZ camera 120, the system control unit 124 extracts the PTZ position that has not moved within a predetermined time, and obtains the position information at that time (pan angle, pitch angle, zoom magnification) from the drive control unit 126.

[0025] The IP network 130 transmits and receives data based on the Internet Protocol. The UI display unit 140 is, for example, a personal computer or a tablet terminal (or its display unit), and has input / output functions or communication functions. The UI display unit 140 transmits various commands to the wide-angle camera 110 and the PTZ camera 120, such as instructions for changing shooting parameters, controlling each of the motors 127 to 129, or starting a video stream. This command transmission enables the UI display unit 140 to control the wide-angle camera 110 and the PTZ camera 120. In response to the above commands, the imaging device 100 transmits a response or a video stream to the UI display unit 140.

[0026] Figure 1 The various functional modules (image processing unit 113, image processing unit 123, system control unit 124, and drive control unit 126) shown are implemented by software or hardware. When implemented by software, programs for providing the functions of the aforementioned functional modules are stored in the ROM of the storage unit 125. The stored programs are appropriately read into the RAM of the storage unit 125 and executed by the CPU of the system control unit 124, thereby implementing the functions of the aforementioned functional modules.

[0027] On the other hand, when the functions are realized by hardware, for example, a predetermined compiler can be used to automatically generate dedicated circuits on the FPGA according to a program for realizing the functions of each functional module. The term FPGA is an abbreviation of Field Programmable Gate Array.

[0028] In addition, gate array circuits can be configured in the same way as FPGAs and implemented as hardware. In addition, application-specific integrated circuits (ASICs) can be used for implementation. Note that Figure 1The illustrated structure of the functional modules is an example, and a plurality of functional modules may form a single functional module, or any of these functional modules may be divided into modules that perform a plurality of functions.

[0029] UI display unit

[0030] Figure 2 Images 201, 202, 204, and 205 are shown, which are generated by the system control unit 124 and displayed on the UI display unit 140. The display screen 200 of the UI display unit 140 is a UI used by the user. The UI display unit 140 has a display unit for displaying images 201, 202, 204, and 205. Image 201 is a real-time image of the area captured by the wide-angle camera 110. Image 202 is a real-time image of the area captured by the PTZ camera 120 (capture area 208).

[0031] In this embodiment, the imaging area of ​​the wide-angle camera 110 and the pan angle, tilt angle, and zoom (telephoto, wide-angle) position of the PTZ camera 120 are linked (correlated, associated) to each other. For example, when the user specifies the area 203 within the image 201 from the UI display unit 140, the system control unit 124 drives the respective motors 127 to 129 so that the PTZ camera 120 captures the area 203 based on the information related to the pan angle, tilt angle, and zoom position linked to the area 203. This motor driving enables the imaging area of ​​the PTZ camera 120 to be changed.

[0032] Image 204 is a thumbnail image in which a shooting area 206 captured in the previous posture of the PTZ camera 120 is cut out from the image currently captured by the wide-angle camera 110, and the shooting area 206 is displayed. Image 205 is a thumbnail image in which a shooting area 207 captured in the previous posture of the PTZ camera 120 is cut out from the image currently captured by the wide-angle camera 110, and the shooting area 207 is displayed. Information (shooting information) related to the pan angle, tilt angle, and zoom position of the PTZ camera 120 obtained when shooting the shooting area 206 is linked to thumbnail image 204 and stored in the storage unit 125.

[0033] Information related to the pan angle, tilt angle, and zoom position of the PTZ camera 120, obtained when capturing the capture area 207, is linked to the thumbnail image 205 and stored in the storage unit 125. The capture areas (capturing ranges) 203 and 206 to 208 each represent an area to be cut out from the image 201 and can therefore be referred to as cutout areas. Furthermore, thumbnail images 204 and 205 are cutout images. Note that the system control unit 124 can display a guide corresponding to each cutout image in a manner overlapping with the image 201. In this case, the color or display form of the guide line can be different for each piece of position information stored in the storage unit 125 to improve visibility.

[0034] Changing the PTZ camera's shooting area

[0035] will be used by Figure 3 、 Figure 4A and Figure 4B The flow in the case where the pan angle, tilt angle, and zoom position of the PTZ camera 120 are changed to shoot the past shooting area is described. Figure 4A As shown, first, the system control unit 124 ( Figure 1 ) detects that the user has selected the thumbnail image 205 using the pointer 401 (S301). The system control unit 124 then reads out information related to the pan angle, tilt angle, and zoom position of the PTZ camera 120, which is linked to and stored in the thumbnail image 205, from the storage unit 125 (S302). The system control unit 124 sends an instruction to the drive control unit 126 of the PTZ camera 120 to drive the zoom motor 127, the pan motor 128, and the tilt motor 129 based on the information related to the pan angle, tilt angle, and zoom position (S303). That is, the system control unit 124 sends drive instructions for the respective motors 127 to 129 to the drive control unit 126, causing the PTZ camera 120 to capture the area 207.

[0036] Next, on the image 201 captured by the wide-angle camera 110, the system control unit 124 changes the cutout area 207 of the selected thumbnail image 205 to the area 208 that has been captured by the PTZ camera 120 before the image selection (S304). Subsequently, the system control unit 124 uses the information on the pan angle, tilt angle, and zoom position of the PTZ camera 120 obtained before the capture area change to match the image ( Figure 2 Finally, the system control unit 124 updates the displayed thumbnail image (S306). Specifically, since Figure 4AThe image 202 is "the image taken in the previous posture (the latest image)", so the image 202 is updated to the image 204, and since Figure 4A Image 204 is “an image captured in the immediately preceding posture”, and therefore image 204 is updated to image 205 . Figure 4A The thumbnail image 205 will be deleted. Figure 4B This state is shown in FIG.

[0037] In this manner, by viewing the real-time image 201 ( Figure 4A After confirming the current state, the user can change the shooting area of ​​the PTZ camera 120 to the shooting area 207 set in the past. Figure 4A The image 202 has been changed to Figure 4B Note that, although two thumbnail images (thumbnail images 204 and 205) of the shooting area captured in the past are displayed on the display screen 200 in the above description, the present embodiment is not limited to this display form. For example, only a single thumbnail image of the shooting area captured in the past may be displayed on the display screen 200, or three or more thumbnail images of the shooting area captured in the past may be displayed on the display screen 200.

[0038] In addition, Figure 4A In the case where thumbnail images 204 and 205 are displayed on the display screen 200, the thumbnail image 204 is displayed on the front layer of the thumbnail image 205. That is, in Figure 4A In the case where there are multiple thumbnail images, the thumbnail image that is closer to the current time in terms of time is displayed on the front layer. This embodiment is not limited to this display form (display order). For example, when multiple thumbnail images are displayed on the display screen 200, the display order may be such that a thumbnail image that has been set as a shooting area for a longer time can be displayed in the front layer.

[0039] Display of the cut-out image position

[0040] When a single thumbnail image is selected, a frame line indicating the outer edge of the area of ​​interest or a line connecting the thumbnail image of interest to the capture area may be displayed to indicate which area is to be captured, and the frame line or line may be superimposed on the capture image 201 of the wide-angle camera 110. Furthermore, when the pointer 401 operated by the user points to a thumbnail image (i.e., a single thumbnail image is selected), the frame line or the connecting line may be displayed and superimposed on the capture image 201. By displaying a graphic or mark such as a frame line or a connecting line on the capture image 201, the thumbnail image and the capture area are associated with each other, which facilitates confirmation of the correspondence between the thumbnail image and the capture area.

[0041] Thumbnail image update timing

[0042] Thumbnail images can be updated if the pan angle, tilt angle, or zoom position of the PTZ camera 120 changes by a predetermined value or greater. Furthermore, if continuous thumbnail image updates are not permitted, thumbnail images can be updated if the pointer 401 does not select a thumbnail image for a predetermined period of time or longer after the capture area has been changed. Alternatively, thumbnail image updates can be permitted after a predetermined period of time has elapsed after the capture area has been changed. Thus, for example, when there are a large number of thumbnail images, continuous thumbnail image updates due to fine-tuning of the capture area can be avoided.

[0043] Image transmission priority

[0044] When the image captured by the wide-angle camera 110 is transmitted to the IP network 130, the area of ​​the cut-out image (for example, Figure 4A The image of the area 207 (shown in the cutout image) can be transmitted with a higher priority than images of other areas. In particular, when the wide-angle camera 110 includes a plurality of cameras, by preferentially transmitting the image of the area showing the cutout image, the time lag between the cutout image captured by the wide-angle camera 110 and the image captured by the PTZ camera 120 can be reduced.

[0045] As described above, according to the present embodiment, the photographing area of ​​the PTZ camera 120 can be changed from the area 208 to the area 207 while displaying the current state of the area 207 photographed in the past to the user by using the real-time images 201 and 205 .

[0046] Next, by using Figures 5 to 7B The second embodiment of the present invention will now be described. In the first embodiment, the imaging area of ​​the PTZ camera 120 is changed to the imaging area of ​​the thumbnail image selected by the user using the pointer 401. In the second embodiment, a case where multiple imaging areas for which the imaging areas of the PTZ camera 120 are preset are sequentially changed will be described. In the second embodiment, the imaging areas of the PTZ camera 120 are changed in a predetermined sequence (a loop sequence). This type of image capture can be referred to as loop-set imaging.

[0047] In the following description, a plurality of preset shooting areas may be referred to as preset positions. A method for changing the shooting area and cutout range of the camera device 101 and a method for displaying thumbnail images in the second embodiment will be described below. Note that the same reference numerals are used for the same components as in the first embodiment, and their descriptions will be omitted. The structure of the camera system 10 of the second embodiment is the same as that of the first embodiment. In the following description, the display on the UI display unit 140 having a form different from that of the first embodiment and changes in the shooting direction and viewing angle of the PTZ camera 120 (changes in the pan angle, pitch angle, and zoom position) will be described.

[0048] UI display unit

[0049] will be used by Figure 5 1 to describe the display of images on the UI display unit 140. Images 501, 502, 503, and 504 are each thumbnail images that cut out an area (i.e., a preset position) that can be captured by the loop-set shooting of the PTZ camera 120 from the image 201 currently captured by the wide-angle camera 110 and display the area. That is, in the loop-set shooting of this embodiment, four thumbnail images 501 to 504 are used. The user can select (set) which thumbnail image to start the loop. For example, if the user selects thumbnail image 504, the shooting area of ​​the PTZ camera 120 changes in the order of thumbnails 504, 501, 502, 503, and then 504. For example, this loop order can be set by the UI display unit 140 based on user instructions, or can be set by the system control unit 124 of the camera device 100. In this embodiment, thumbnail images 501 to 504 are prepared in advance. Thumbnail image 501 corresponds to area 505 , thumbnail image 502 corresponds to area 506 , thumbnail image 503 corresponds to area 507 , and thumbnail image 504 corresponds to area 508 .

[0050] The pan angle, tilt angle, and zoom position of the PTZ camera 120 are linked with the respective thumbnail images 501, 502, 503, and 504 and stored in the storage unit 125. This linking enables the PTZ camera 120 to photograph areas 505 to 508 based on the thumbnail images 501 to 504.

[0051] Changing the PTZ camera's shooting area

[0052] will be used by Figure 6 、 Figure 7A and Figure 7B1 and 2 will now describe a process for changing the pan angle, tilt angle, and zoom position of the PTZ camera 120 to the pan angle, tilt angle, and zoom position linked to the preset position. The following description will describe a case where loop setting shooting starts with the thumbnail image 504. Loop setting shooting is set so that after shooting continues for a predetermined time in one shooting area, shooting automatically moves to the next shooting area.

[0053] like Figure 7A As shown, the system control unit 124 ( Figure 1 ) detects that the user has selected the thumbnail image 504 using the pointer 701 (S601). The system control unit 124 then reads out information related to the pan angle, tilt angle, and zoom position, which is linked to and stored in the thumbnail image 504, from the storage unit 125 (S602). The system control unit 124 sends an instruction to the drive control unit 126 of the PTZ camera 120 to drive the zoom motor 127, the pan motor 128, and the tilt motor 129 based on the readout information related to the pan angle, tilt angle, and zoom position (S603). That is, the system control unit 124 sends drive instructions to the drive control unit 126 for each motor 127 to 129, causing the PTZ camera 120 to capture the area 508. Figure 7B A state after the photographing area of ​​the PTZ camera 120 has been changed is shown.

[0054] The image currently captured by the wide-angle camera 110 is displayed in image 201. Therefore, the user can change the pan, tilt, and zoom positions of the PTZ camera 120 after confirming the status of the preset positions in image 201 while changing the pan, tilt, and zoom positions of the PTZ camera 120 to the preset positions (area 508). After the PTZ camera 120 captures area 508 for a predetermined period of time, the system control unit 124 reads information related to the pan, tilt, and zoom positions linked to the thumbnail images 501 from the storage unit 125 (S604). In other words, the system control unit 124 automatically selects the thumbnail images 501 in sequence. The system control unit 124 then sends an instruction to the drive control unit 126 of the PTZ camera 120 to drive the respective motors 127 to 129 based on the read information related to the pan, tilt, and zoom positions (S603). In this manner, in loop setting shooting, the process proceeds to S604 after S603 without updating the thumbnail image. Then, S603 and S604 are repeated. To stop loop setting shooting, for example, the user sends a stop signal from the UI display unit 140 to the system control unit 124.

[0055] Note that in the above description, although the thumbnail image to start the loop setting shooting is determined by the user selecting a thumbnail image, the thumbnail image to start the loop setting shooting can be preset. For example, the loop setting shooting can be set to start with the thumbnail image 501. In addition, although Figure 6 In the flowchart of FIG, the user selects thumbnail 504 to start loop setting shooting, but loop setting shooting may be started in response to power-on of the UI display unit 140, for example. In addition, the time period for shooting may be different for the four preset positions 505 to 508. For example, the time period for shooting at the preset position 505 may be shorter than the time period for shooting at the preset position 507. Although Figure 7A and Figure 7B In the example of FIG. 5 , four thumbnail images 501 to 504 are used for loop-set photographing, but the number of thumbnail images used in loop-set photographing is not limited to four.

[0056] According to the second embodiment, the user can change the pan angle, tilt angle, and zoom position of the PTZ camera 120 after confirming the state of the preset position in the image when the pan angle, tilt angle, and zoom position of the PTZ camera 120 are changed to the preset position 508. In addition, the current state of the current position (area) of interest can be confirmed for the preset positions 505, 506, and 507 automatically photographed after the preset position 508. In addition, according to the second embodiment, a plurality of preset positions (photographing areas) can be photographed in an automatic cycle at predetermined time intervals.

[0057] Although the wide-angle camera 110 is formed of a single camera without components for changing the shooting direction and zoom position in the first and second embodiments, the wide-angle camera 110 is not limited to this structure. The wide-angle camera 110 may be formed of multiple cameras, or may be formed of a camera capable of changing the shooting direction and zoom position (e.g., a PTZ camera). Although the UI display unit 140 is described as a personal computer, the UI display unit 140 may be, for example, a server. Furthermore, although the wide-angle camera 110 and the PTZ camera 120 are described as being housed in a single housing, the wide-angle camera 110 and the PTZ camera 120 may be housed in separate housings. In other words, the imaging device 100 does not need to be configured so that the two cameras (the wide-angle camera 110) are integrated.

[0058] Using user settings to change

[0059] By sending a setting change instruction from the UI display unit 140 to the wide-angle camera 110, the user can switch which of the past shooting areas and the cycle-set shooting areas of the PTZ camera 120 is cut out and displayed as a thumbnail image. Similarly, the user can also send a drive control instruction to the drive control unit 126 via the UI display unit 140 to drive the various motors (127, 128, 129) and change the shooting area of ​​the PTZ camera 120. Furthermore, the size of the thumbnail images or the display position (layout) of the images can be changed via the UI display unit 140. Furthermore, while the above description describes an example in which the present invention is implemented in the imaging device 100, the present invention can also be implemented on a client device. In the case of client-side implementation, the client device stores information indicating which portion of the image captured by the wide-angle camera 110 will be displayed as a thumbnail on the viewer, as well as information indicating which position of the PTZ camera 120 is to be controlled when each thumbnail is selected. Furthermore, when one of the thumbnails is selected, an instruction can be issued to drive the PTZ camera 120 to the corresponding PTZ position.

[0060] Beneficial effects

[0061] According to the present invention, an image of the second photographing area is cut out from an image of the first photographing area, and the cut out image is displayed, which can facilitate the user to confirm the state of the second photographing area.

[0062] Other embodiments

[0063] The embodiments of the present invention can also be implemented by the following method, that is, providing the software (program) that performs the functions of the above-mentioned embodiments to a system or device through a network or various storage media, and the computer or central processing unit (CPU) or microprocessing unit (MPU) of the system or device reads and executes the program.

[0064] While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments. The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications, equivalent structures and functions.

Claims

1. A camera device, comprising: a first camera unit configured to capture a first capturing area; a second camera unit configured to capture a second capturing area narrower than the first capturing area, wherein the second camera unit is capable of changing the second capturing area; an output unit configured to output a cutout image corresponding to a second photographing area photographed by the second photographing unit, the cutout image being obtained from the photographed image photographed by the first photographing unit; as well as A changing unit is configured to, when one of the plurality of cutout images output by the output unit is selected, control the second imaging unit so that the second imaging unit captures a second imaging area corresponding to the selected cutout image.

2. The imaging device according to claim 1, in, The cutout image of the second photographing area photographed by the second photographing unit is obtained by cutting out a partial image of the second photographing area from the photographed image photographed by the first photographing unit.

3. The camera apparatus according to claim 1 , further comprising a setting unit configured to set a cyclic order of the plurality of cut-out images, in, The changing unit sequentially changes the second photographing area according to the loop order. 4 . The imaging apparatus according to claim 1 , further comprising an associating unit configured to associate the captured image of the first photographing area displayed on the client apparatus with the cutout image by using a graphic or a logo. The imaging device according to claim 4 , wherein: The associating unit overlaps a guide corresponding to an outer edge of the cutout image with the photographed image of the first photographing area displayed on the client device so that the guide will be displayed. 6 . The imaging apparatus according to claim 1 , further comprising an overlapping unit configured to, when one of the plurality of cutout images is selected, overlap a region of the selected cutout image with the captured image of the first capturing region so that the region is displayed.

7. The imaging device according to claim 1, wherein: The output unit causes the client device to display: an image currently captured by the first camera unit; The image currently captured by the second camera unit; and The plurality of cut-out images.

8. The imaging device according to claim 7, in, The output unit causes the client device to display the plurality of cutout images in a manner of arranging them in a predetermined order.

9. The imaging device according to claim 1, wherein The output unit is configured to cause the client device to display a latest cut-out image of the second shooting area captured by the second shooting unit, when the changing unit controls the second shooting unit to capture a second shooting area corresponding to the selected cut-out image, the cut-out image being obtained from the shot image captured by the first shooting unit.

10. The imaging device according to claim 1, wherein The first camera unit is a wide-angle camera, and the second camera unit is a pan-tilt-zoom camera. The imaging device according to claim 10 , wherein: The wide-angle camera is formed by a pan-tilt-zoom camera.

12. The imaging device according to claim 10, in, Each of the plurality of cut-out images is associated with information of pan-tilt-zoom parameters, Wherein, the changing unit is configured to control the second camera unit based on information of pan-tilt-zoom parameters associated with the selected cut-out image when one of the multiple cut-out images output by the output unit is selected, so that the second camera unit captures a second shooting area corresponding to the selected cut-out image.

13. The imaging device according to claim 1, wherein The cut-out image is a thumbnail image.

14. The imaging device according to claim 1, wherein The changing unit sequentially changes the second photographing area at predetermined time intervals according to a cyclic order.

15. A display device comprising: a control unit configured to control a first camera unit for photographing a first photographing area and a second camera unit for photographing a second photographing area, the second photographing area being narrower than the first photographing area; as well as a display unit configured to display in real time on a display the image of the first shooting area captured by the first camera unit, and to display in real time on the display the image of the second shooting area captured by the second camera unit, The display unit displays a cutout image corresponding to a second photographing area photographed in the past by the second photographing unit on the display, wherein the cutout image is obtained from the photographed image photographed by the first photographing unit.

16. The display device according to claim 15, in, The cutout image of the second photographing area photographed by the second photographing unit is obtained by cutting out a partial image of the second photographing area from the photographed image photographed by the first photographing unit.

17. The display device according to claim 15, in, The display unit displays on the display a plurality of cutout images each corresponding to a different second photographing area photographed in the past by the second photographing unit, each of the plurality of cutout images being obtained from a photographed image photographed by the first photographing unit.

18. The display device according to claim 15, wherein The cut-out image is a thumbnail image.

19. A method for photographing, comprising the following steps: photographing a first photographing area by using a first camera unit; By using a second camera unit to capture a second capturing area narrower than the first capturing area, the second camera unit is capable of changing the second capturing area; outputting a cutout image corresponding to a second photographing area photographed by the second photographing unit, the cutout image being obtained from the photographed image photographed by the first photographing unit; as well as When one of the outputted plurality of cutout images is selected, the second imaging unit is controlled so as to capture a second imaging area corresponding to the selected cutout image.

20. A display method comprising the following steps: controlling a first camera unit for photographing a first photographing area and a second camera unit for photographing a second photographing area, wherein the second photographing area is narrower than the first photographing area; Displaying the image of the first shooting area captured by the first camera unit on a display in real time; displaying in real time on the display an image of the second shooting area captured by the second camera unit; as well as A cutout image corresponding to a second photographing area photographed in the past by the second photographing unit is displayed on the display, the cutout image being obtained from the photographed image photographed by the first photographing unit.

Images