Display control device, control method for display control device, and program
The display control device calculates and displays the remaining time or distance for imaging devices in loop operations, addressing the inconvenience of unknown completion times in existing systems.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- CANON KK
- Filing Date
- 2022-07-04
- Publication Date
- 2026-06-22
AI Technical Summary
Existing systems with multiple imaging devices in loop operations lack the ability to accurately determine the remaining time or distance until each device reaches its final imaging range, making it inconvenient for users.
A display control device and method that calculates and visually indicates the remaining time or distance until an imaging device reaches its target imaging range by using a system that includes a display control means to receive current and target imaging ranges and calculate the necessary time or distance, displaying this information on a user interface.
Enables users to visually understand the remaining time or distance until the imaging range of an imaging device reaches its target, facilitating easier timing management in loop operations.
Smart Images

Figure 0007877092000001 
Figure 0007877092000002 
Figure 0007877092000003
Abstract
Description
Technical Field
[0005]
[0001] The present disclosure relates to a display control device, a control method for the display control device, and a program.
Background Art
[0002] There is a technique for changing the imaging range by changing the imaging direction and the angle of view of an imaging device that captures an image. In an imaging device capable of changing the imaging range, the imaging range can be changed by changing the pan-tilt-zoom (hereinafter, PTZ).
[0003] In addition, there is a loop operation function as a function for controlling the imaging device. In the loop operation, the starting imaging range as the starting point, the ending imaging range as the imaging range to be reached as the target, and the moving time or moving speed from the starting imaging range to the ending imaging range are specified. Then, the PTZ of the imaging device is driven from the starting imaging range to the ending imaging range, and after reaching the ending imaging range at the specified moving time or moving speed, it turns back, changes the original ending imaging range to the next starting imaging range, and changes the original starting imaging range to the next ending range. The loop operation function is a function in which the PTZ of the imaging device repeats the above operation and captures images of two or more imaging ranges multiple times. Furthermore, depending on the imaging device, it is also possible to hold a plurality of intermediate imaging ranges between the starting imaging range and the ending imaging range, and to specify a stop time for each imaging range.
[0004] Patent Document 1 discloses a shot operation for controlling the pan, tilt, and zoom of an imaging device so as to reach a target position from the current position within a specified time specified by the user.
Prior Art Documents
Patent Documents
[0005]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0006] However, the aforementioned Patent Document 1 has a drawback in that, when multiple imaging devices are used in a loop operation, the remaining time until each imaging device reaches its final imaging range is unknown, making it inconvenient to use.
[0007] The purpose of this disclosure is to enable the visual indication of the remaining time or distance until the imaging range of an imaging device reaches a target imaging range. [Means for solving the problem]
[0008] The display control device includes a display control means that controls the display to display the image captured by an imaging device that captures an image while moving the imaging range. The system includes a control means that receives the current imaging range of the imaging device from the imaging device and calculates the remaining time or distance until the imaging range of the imaging device reaches the target imaging range, based on the current imaging range of the imaging device and a target imaging range which is a preset or user-specified target imaging range. The display control means has, The remaining time or distance Depending on the circumstances, In this manner, the remaining time or distance is displayed. To control. [Effects of the Invention]
[0009] According to this disclosure, the remaining time or distance until the imaging range of the imaging device reaches the target imaging range can be visually indicated. [Brief explanation of the drawing]
[0010] [Figure 1] This is a diagram showing an example configuration of an imaging system. [Figure 2] This is an external view showing an example of the configuration of an imaging device. [Figure 3] This diagram shows an example configuration of an imaging device and an information processing device. [Figure 4] This diagram shows an example of the hardware configuration of an information processing device. [Figure 5] This flowchart shows the display control for the loop operation function. [Figure 6] This figure shows an example of a UI that displays the estimated arrival time. [Figure 7] This figure shows an example of a UI that displays the estimated arrival time. [Figure 8]This is a flowchart of an information processing device that acquires arrival time from an imaging device. [Modes for carrying out the invention]
[0011] The embodiments will be described in detail below with reference to the drawings. Note that the configurations shown in the following embodiments are merely examples and are not limited to those illustrated.
[0012] (First embodiment) Figure 1 shows an example configuration of an imaging system 150 according to the first embodiment. The imaging system 150 includes an imaging device 100, an information processing device 200, a display 210, and a network 300. The imaging device 100 and the information processing device 200 are interconnected via the network 300. The network 300 is implemented by multiple routers, switches, cables, etc., compliant with a communication standard such as ETHERNET®. The information processing device 200 is an example of a display control device.
[0013] Network 300 may be implemented using the Internet, a wired LAN (Local Area Network), a wireless LAN (Wireless LAN), a WAN (Wide Area Network), or the like.
[0014] The imaging device 100 is a device that captures images and functions as an imaging device capable of changing the imaging range by pan-tilt-zoom. The imaging device 100 transmits the image data of the captured image, information on the date and time the image was captured, identification information to identify the imaging device 100, and information on the imaging range of the imaging device 100 to an external device such as an information processing device 200 via the network 300. The information processing device 200 is, for example, a client device such as a personal computer on which a program for realizing the processing functions described later is installed.
[0015] Note that the imaging system 150 is shown by taking the case of having one imaging device 100 as an example, but it may have a plurality of imaging devices 100. That is, a plurality of imaging devices 100 may be connected to the information processing device 200 via the network 300. In this case, the information processing device 200 determines, for example, which imaging device 100 among the plurality of imaging devices 100 captured the transmitted image by using the identification information associated with the image transmitted from the plurality of imaging devices 100.
[0016] The display 210 is composed of an LCD (Liquid Crystal Display) or the like, and displays an image captured by the imaging device 100. The display 210 is connected to the information processing device 200 via a display cable conforming to a communication standard such as HDMI (Registered Trademark) (High Definition Multimedia Interface). Note that the display 210 and the information processing device 200 may be provided in a single housing.
[0017] Next, referring to FIGS. 2 and 3, the imaging device 100 in FIG. 1 will be described. FIG. 2 is a diagram showing an example of the appearance of the imaging device 100. FIG. 3 is a diagram showing a functional configuration example of the imaging device 100 and the information processing device 200. Note that among the functional blocks of the imaging device 100 shown in FIG. 3, each functional block such as the image processing unit 112, the system control unit 113, the pan-tilt-zoom control unit 114, the storage unit 115, and the communication unit 116 is realized as follows. That is, it is realized by the CPU (Central Processing Unit) 400 of the imaging device 100 executing a computer program stored in the ROM (Read Only Memory) 420 of the imaging device 100, which will be described later with reference to FIG. 4.
[0018] The imaging device 100 includes a lens 101, a lens driving unit 102, a pan driving unit 103, a tilt driving unit 104, an imaging unit 111, an image processing unit 112, a system control unit 113, a pan-tilt-zoom control unit 114, a storage unit 115, and a communication unit 116.
[0019] The direction in which the optical axis of lens 101 points is the imaging direction of imaging device 100. The light beam that has passed through lens 101 forms an image on the imaging element of imaging unit 111 of imaging device 100. Also, lens driving unit 102 is constituted by a drive system that drives lens 101, and changes the focal length and zoom value of lens 101. Lens driving unit 102 is controlled by pan-tilt-zoom control unit 114.
[0020] Pan driving unit 103 is constituted by a mechanical drive system that performs a pan operation and a motor as a drive source, and drives to perform rotational driving for rotationally driving the imaging direction of imaging device 100 in pan direction 105. Also, pan driving unit 103 is controlled by pan-tilt-zoom control unit 114.
[0021] Tilt driving unit 104 is constituted by a mechanical drive system that performs a tilt operation and a motor as a drive source, and drives to perform rotational driving for rotationally driving the imaging direction of imaging device 100 in tilt direction 106. Tilt driving unit 104 is controlled by pan-tilt-zoom control unit 114.
[0022] <0000−107>Imaging unit 111 is constituted by an imaging element (not shown) such as a CCD (charge coupled device) sensor or a CMOS (complementary metal oxide semiconductor) sensor. Then, imaging unit 111 photoelectrically converts the subject image formed through lens 101 to generate an electrical signal. Image processing unit 112 performs image processing such as processing for converting the electrical signal photoelectrically converted in imaging unit 111 into a digital signal and compression encoding processing, and generates image data. [[ID=The memory unit 115 stores (retains) information indicating the imaging range, for example. The memory unit 115 also stores a list of imaging ranges in loop operation, as well as arrival time or movement speed.
[0025] Here, the imaging device 100 has a loop operation function. In loop operation, a starting point imaging range, which is the starting point, an ending point imaging range, which is the target imaging range to be reached, and the time or speed of movement from the starting point imaging range to the ending point imaging range are specified. The pan-tilt-zoom of the imaging device 100 is driven from the starting point imaging range to the ending point imaging range, and after reaching the ending point imaging range at the specified time or speed of movement, it reverses direction, changes the original ending point imaging range to the next starting point imaging range, and changes the original starting point imaging range to the next ending point range. The loop operation function is a function in which the pan-tilt-zoom of the imaging device 100 repeats the above operation and captures two or more imaging ranges multiple times. The imaging device 100 can also hold multiple intermediate imaging ranges between the starting point imaging range and the ending point imaging range, and it is also possible to specify a stop time for each imaging range.
[0026] The communication unit 116 communicates with the information processing device 200 via the I / F440, which will be described later with reference to Figure 4. For example, the communication unit 116 transmits image data of the image captured by the imaging device 100 to the information processing device 200 via the network 300. The communication unit 116 also transmits information indicating the current imaging range of the imaging device 100 to the information processing device 200 via the network 300. Furthermore, the communication unit 116 receives control commands, which are commands for controlling the imaging device 100, transmitted from the information processing device 200, and transmits the control commands to the system control unit 113.
[0027] The system control unit 113 controls the entire imaging device 100 according to the processing performed by the CPU 400, as described later with reference to Figure 4, and performs the following processing, for example: The system control unit 113 analyzes the control commands for controlling the imaging device 100 transmitted from the information processing device 200 and performs processing according to the control commands. The system control unit 113 also gives instructions to the pan-tilt-zoom control unit 114 for pan-tilt-zoom operation. Furthermore, when the system control unit 113 transmits the image data generated by the image processing unit 112 to the information processing device 200, it also adds information about the time of imaging and the imaging range to the image data.
[0028] The imaging range described above is determined by the pan value, tilt value, and zoom value of the imaging device 100. The pan value is the angle of the imaging direction (optical axis) in the pan direction 105 of the imaging device 100, with one of the drive ends of the pan drive unit 103 set to 0°. The tilt value is the angle of the imaging direction (optical axis) in the tilt direction 106 of the imaging device 100, with one of the drive ends of the tilt drive unit 104 set to 0°. The zoom value of the imaging device 100 when an image is captured by the imaging device 100 is calculated from the focal length of the lens 101.
[0029] Furthermore, the system control unit 113 executes processing related to the loop operation, which will be described later. For example, the system control unit 113 calculates the parameters necessary to realize the loop operation from the current imaging range and the target imaging range, which is the imaging range to be reached, and further calculates the time required for the loop operation. At this time, the system control unit 113 calculates the difference (drive amount) between the current imaging range of the imaging device 100 and the target imaging range of the loop operation for each of the pan value, tilt value, and zoom value. Furthermore, the system control unit 113 calculates the following parameters when driving the pan, tilt, and zoom from the current imaging range to the target imaging range. That is, the system control unit 113 calculates the pan time, which is the time required to drive the pan, the tilt time, which is the time required to drive the tilt, and the zoom time, which is the time required to control the zoom. Then, the system control unit 113 calculates the largest value among the pan time, tilt time, and zoom time as the time required to reach the target imaging range. Furthermore, when the imaging range reaches the target imaging range, the system control unit 113 changes the starting imaging range to the target imaging range and calculates the parameters for realizing the loop operation again.
[0030] Next, the information processing of the information processing device 200 will be explained with reference to the functional blocks of the information processing device 200 shown in Figure 3. Each function of the information processing device 200 is implemented as follows, using the ROM 420 and CPU 400, which will be described later with reference to Figure 4. Specifically, each functional block shown in Figure 3 is implemented by the CPU 400 of the information processing device 200 executing a computer program stored in the ROM 420 of the information processing device 200.
[0031] The information processing device 200 includes a display control unit 201, an operation reception unit 202, a system control unit 203, a communication unit 204, and a storage unit 205.
[0032] The display control unit 201 displays images captured by the imaging device 100 and setting screens related to loop operation on the display 210 in Figure 1. The operation reception unit 202 receives information about user operations via an input device (not shown) such as a keyboard, mouse, or touch panel. The input device may be, for example, a button, mouse, or joystick, and will accept various operations from the user.
[0033] Here, for example, the display control unit 201 displays a settings screen on the display 210 for configuring settings related to loop operation, and the operation reception unit 202 receives information about user operations on the settings screen displayed on the display 210. The system control unit 203 transmits control commands to the imaging device 100 via the communication unit 204 in response to user operations.
[0034] The communication unit 204 transmits various setting commands and control commands for the imaging device 100, sent from the system control unit 203, to the imaging device 100 via the I / F 440, which will be described later with reference to Figure 4. The communication unit 204 also receives image data transmitted from the imaging device 100 and responses from the imaging device 100 to commands sent from the information processing device 200 to the imaging device 100, and transmits these to the system control unit 203. The storage unit 205 stores information related to loop operation and images acquired by the communication unit 204.
[0035] The system control unit 203 generates various setting commands and control commands based on user operations received by the operation reception unit 202, and transmits them to the imaging device 100 via the communication unit 204.
[0036] Although the image capture device 100 is shown as an example without a display unit, depending on the application being used, it may have a display unit that displays the image captured by the image capture device 100 or the current values of the image capture device 100. Furthermore, the information processing device 200 may have a built-in display 210.
[0037] Figure 4 shows an example of the hardware configuration of the image processing unit 112, system control unit 113, pan-tilt-zoom control unit 114, storage unit 115, and communication unit 116 of the imaging device 100 shown in Figure 3. The imaging device 100 has a CPU 400, RAM 410, ROM 420, HDD 430, and I / F 440. The image processing unit 112, system control unit 113, pan-tilt-zoom control unit 114, storage unit 115, and communication unit 116 are realized by the CPU 400 executing a computer program stored in the ROM 420, etc.
[0038] The CPU 400 is a central processing unit that provides overall control over the imaging device 100. The RAM 410 temporarily stores computer programs executed by the CPU 400. The RAM 410 also provides a work area used by the CPU 400 when executing processing. Furthermore, the RAM 410 can function, for example, as frame memory or buffer memory.
[0039] ROM420 stores programs and other information for the CPU400 to control the imaging device 100. HDD430 is a storage device that records image data and other data. I / F440 communicates with the information processing device 200 via network 300 according to TCP / IP, HTTP, etc.
[0040] In the above-described embodiment, an example was given in which the CPU 400 performs processing. However, at least a portion of the processing performed by the CPU 400 may be performed by dedicated hardware. For example, the processing of displaying a GUI (Graphical User Interface) or image data may be performed by a GPU (Graphics Processing Unit). Also, the processing of reading program code from ROM 420 and expanding it into RAM 410 may be performed by DMA (Direct Memory Access), which functions as a transfer device.
[0041] The information processing device 200 also has the hardware configuration shown in Figure 4. The information processing device 200 includes a CPU 400, RAM 410, ROM 420, HDD 430, and I / F 440. The CPU 400 executes computer programs stored in the ROM 420 and HDD 430, etc., thereby realizing the display control unit 201, operation reception unit 202, system control unit 203, communication unit 204, and storage unit 205 shown in Figure 3.
[0042] The CPU 400 is a central processing unit that provides overall control over the information processing unit 200. The RAM 410 temporarily stores the computer programs executed by the CPU 400. The RAM 410 also provides a work area used by the CPU 400 when executing processing. Furthermore, the RAM 410 can function, for example, as frame memory or buffer memory.
[0043] ROM420 stores programs for the CPU400 to control the imaging device 100. HDD430 is a storage device that records image data and computer programs. I / F440 communicates with the imaging device 100 via network 300 according to TCP / IP, HTTP, etc.
[0044] Figure 5 is a flowchart illustrating an example of the control method for the information processing device 200, showing the display control of the loop operation function. The imaging device 100 has a loop operation function in which the pan-tilt-zoom repeatedly moves to a predetermined target imaging range at a specified time or speed. The information processing device 200 acquires and displays video from the imaging device 100 while the loop operation is running, and displays the time or distance to reach the target imaging range. The procedure is shown below.
[0045] In step S501, the system control unit 203 waits for input from the user to start the loop operation via the operation reception unit 202. If input to start the loop operation is received, the system proceeds to step S502.
[0046] In step S502, the system control unit 203 sends a loop operation start command to the imaging device 100 via the communication unit 204, and the system proceeds to step S503 to start the loop operation.
[0047] In step S503, the system control unit 203 determines, via the operation reception unit 202, whether or not there is an input from the user to stop the loop operation. If there is no input to stop the loop operation, the system control unit 203 proceeds to step S504; if there is an input to stop the loop operation, it proceeds to step S512.
[0048] In step S504, the system control unit 203 sets the target imaging range of the imaging device 100. For example, the system control unit 203 may set a pre-set target imaging range, or it may be a target imaging range specified by the user at this point. The imaging range is determined by the pan value, tilt value, and zoom value of the imaging device 100.
[0049] Next, in step S505, the system control unit 203 receives the current imaging range of the imaging device 100 from the imaging device 100 via the communication unit 204.
[0050] Next, in step S506, the system control unit 203 determines whether the current imaging range of the imaging device 100 matches the target imaging range. If the current imaging range of the imaging device 100 does not match the target imaging range, the system control unit 203 proceeds to step S507. If the current imaging range of the imaging device 100 matches the target imaging range, the system control unit 203 proceeds to step S511.
[0051] In step S507, the system control unit 203 calculates the time it takes for the imaging device 100 to reach the target imaging range from its current range, based on the time it takes for the imaging range of the imaging device 100 to reach the target imaging range, as specified by the user. The time it takes for the imaging device 100 to reach the target imaging range from its current range is the remaining time until the imaging range of the imaging device 100 reaches the target imaging range.
[0052] Next, in step S508, the system control unit 203 determines whether the time it takes for the imaging device 100 to reach the target imaging range from its current imaging range is shorter than a predetermined threshold T. If the time it takes for the imaging device 100 to reach the target imaging range is shorter than a predetermined threshold T, the system control unit 203 proceeds to step S510. If the time it takes for the imaging device 100 to reach the target imaging range is not shorter than a predetermined threshold T, the system control unit 203 proceeds to step S509.
[0053] In step S509, the display control unit 201 displays the time it takes to reach the target imaging range from the current imaging range as the normal state on the display 210 on the video received from the imaging device 100, and then returns to step S503.
[0054] In step S510, the display control unit 201 displays the time it takes to reach the target imaging range from the current imaging range as the approach state on the display 210 on the image received from the imaging device 100, and then returns to step S503.
[0055] In step S511, the system control unit 203 changes the above target imaging range to the next target imaging range. The next target imaging range may be the imaging range at the start of the above loop operation, or it may be an imaging range specified in advance. Also, if the user has specified a stop time, the imaging device 100 stops moving the imaging range for the specified stop time, and the display control unit 201 may display the remaining stop time on the display 210. After that, the system control unit 203 returns to step S503.
[0056] In step S512, the system control unit 203 transmits a loop operation termination command to the imaging device 100 via the communication unit 204.
[0057] Figures 6(a)-(c) and 7(a)-(b) show examples of the UI (user interface) display screen 600 of an application that displays the time it takes to reach the target imaging range from the current imaging range on the information processing device 200. The display control unit 201 displays the display screen 600 on the display 210. The system control unit 203 receives user input via the operation reception unit 202 and remotely operates the imaging device 100.
[0058] Figure 6(a) shows an example of the basic display screen 600 displayed by the display control unit 201. The display screen 600 has a video display unit 601 that displays video received by the information processing device 200 from the imaging device 100. The display control unit 201 displays the video from the imaging device 100 on the video display unit 601. This allows the user to check the field of view and image quality.
[0059] Furthermore, the display control unit 201 displays the pan, tilt, and zoom values of the current imaging range of the imaging device 100 on the display screen 600 using sliders for the pan control unit 602, tilt control unit 603, and zoom control unit 604, respectively. The user can input the pan, tilt, and zoom values of the target imaging range of the imaging device 100 via the operation reception unit 202. In response to the user's input, the system control unit 203 transmits control commands for the pan, tilt, and zoom values of the target imaging range of the imaging device 100 to the imaging device 100 via the communication unit 204. The imaging device 100 controls the pan, tilt, and zoom according to these control commands. The system control unit 203 receives the current imaging range of the imaging device 100 from the imaging device 100 via the communication unit 204. The display control unit 201 changes the display of the pan control unit 602, tilt control unit 603, and zoom control unit 604 according to the pan value, tilt value, and zoom value of the current imaging range of the imaging device 100. Note that the pan control unit 602, tilt control unit 603, and zoom control unit 604 are not limited to slider displays, but may also display icon buttons or numerical values.
[0060] Figure 6(b) shows an example of the display screen 600 for the normal state arrival time in step S509 of Figure 5. The display screen 600 has a video display unit 601. The display control unit 201 displays the video received from the imaging device 100 on the video display unit 601. In step S509, the display control unit 201 displays the arrival time 611 from the current imaging range to the target imaging range as the normal state on the video display unit 601. Specifically, the display control unit 201 displays the number of seconds of the arrival time 611 superimposed on the video on the video display unit 601 using an inconspicuous color or decoration.
[0061] Figure 6(c) shows an example of the display screen 600 for the approach time in step S510 of Figure 5. The display screen 600 has a video display unit 601. The display control unit 201 displays the video received from the imaging device 100 on the video display unit 601. In step S510, the display control unit 201 displays the approach time 621 from the current imaging range to the target imaging range as the approach time on the video display unit 601. Specifically, the display control unit 201 displays the number of seconds of the arrival time 621 superimposed on the video on the video display unit 601 using a conspicuous color or decoration.
[0062] Figure 7(a) shows another example of the display screen 600 for the normal state arrival time in step S509 of Figure 5. The display screen 600 has a video display unit 601 and an arrival time bar 631. The display control unit 201 displays the video received from the imaging device 100 on the video display unit 601. In step S509, the display control unit 201 displays the arrival time bar 631, which indicates the normal state arrival time, on the side of the video display unit 601 that coincides with the imaging direction. The normal state arrival time bar 631 is decorated with an inconspicuous color. The display control unit 201 displays the arrival time bar 631 according to the imaging direction and the arrival time.
[0063] Figure 7(b) shows another example of the display screen 600 for the arrival time in the approach state in step S510 of Figure 5. The display screen 600 has a video display unit 601 and an arrival time bar 641. The display control unit 201 displays the video received from the imaging device 100 on the video display unit 601. In step S510, the display control unit 201 displays the arrival time bar 641, which indicates the arrival time in the approach state, on the side of the video display unit 601 that coincides with the imaging direction. The arrival time bar 641 in the approach state is decorated with a conspicuous color. The display control unit 201 displays the arrival time bar 641 according to the imaging direction and the arrival time. The blinking interval or color of the arrival time bar 641 may be changed according to the arrival time.
[0064] As described above, in the first embodiment, the display control unit 201 displays either a display screen 600 showing the arrival time in the normal state or a display screen 600 showing the arrival time in the approach state, depending on the arrival time from the current imaging range to the target imaging range. This makes it possible for the user to know the arrival time to the target imaging range at a glance.
[0065] However, the time required to reach the target imaging range from the current imaging range is not limited to this; for example, it may be the respective distances reached by panning, tilting, and zooming from the current imaging range to the target imaging range.
[0066] Furthermore, in step S508, the system control unit 203 determines whether the time it takes to reach the target imaging range from the current imaging range is shorter than a predetermined threshold T, but is not limited to this. For example, the display control unit 201 may display a constantly changing display as the time to reach the target range decreases.
[0067] Furthermore, the display according to arrival time is not limited to those shown in Figures 6(a)-(c) and 7(a)-(b). For example, the display control unit 201 may display the entire edge of the video display unit 601 changing according to the arrival time. Alternatively, the display control unit 201 may display an icon according to the arrival time. Alternatively, the display control unit 201 may display the arrival time only when the arrival time is shorter than the threshold T.
[0068] Furthermore, the display control unit 201 can display information similar to that shown in Figures 6(a)-(c) or 7(a)-(b) depending on the distance reached from the current imaging range to the target imaging range. The display control unit 201 may also display the position of the target imaging range on the display component that displays the current value.
[0069] As described above, loop operation is an operation that automatically repeats regular pan-tilt-zoom movements. In the imaging system 150, multiple imaging devices 100 can be connected to the network 300. For example, one switcher may switch the video from multiple imaging devices 100. By having multiple imaging devices 100 operate in a loop, it is possible to display, for example, a panned view of the audience seats in live video. There is a problem in that the timing of switching is difficult to determine, such as when the imaging range of the imaging device 100 reaches the edge immediately after the video from the imaging device 100 is started to be transmitted to the main line, or when it is difficult to know how long it will take to reach the edge when it is desired to display the image at the edge. According to this embodiment, the information processing device 200 controls the imaging device 100 to perform different display processing depending on the remaining time or distance until the imaging range reaches the target imaging range. As a result, the switcher can instantly know where the imaging device 100 is in the loop operation, making it easier to determine the timing of switching.
[0070] As described above, the imaging device 100 captures an image while moving the imaging range. The display control unit 201 controls the display to show the image captured by the imaging device 100 on the image display unit 601, for example, as shown in Figures 6(a) to (c). In step S509 or S510, the display control unit 201 controls the imaging device 100 to perform different display processing depending on the remaining time or distance until the imaging range reaches the target imaging range.
[0071] Based on the determination in step S508, the display control unit 201 controls the system to perform different display processing depending on whether the remaining time or distance until the imaging range of the imaging device 100 reaches the target imaging range is less than a threshold T. For example, the display control unit 201 controls the system to display the remaining time or distance in different ways depending on the remaining time or distance until the imaging range of the imaging device 100 reaches the target imaging range.
[0072] Furthermore, the display control unit 201 can be controlled to display the remaining time or distance until the imaging range of the imaging device 100 reaches the target imaging range if the remaining time or distance is less than the threshold T. Conversely, the display control unit 201 can be controlled not to display the remaining time or distance until the imaging range of the imaging device 100 reaches the target imaging range if the remaining time or distance is greater than the threshold T.
[0073] The display control unit 201 may control the display of numbers, characters, icons, video display areas, and display components in a way that differs depending on the remaining time or distance until the imaging range of the imaging device 100 reaches the target imaging range.
[0074] In step S505, the system control unit 203 receives the current imaging range of the imaging device 100 from the imaging device 100 via the communication unit 204. In step S507, the system control unit 203 calculates the remaining time or distance until the imaging range of the imaging device 100 reaches the target imaging range, based on the current imaging range and target imaging range of the imaging device 100. The above current imaging range and target imaging range are represented by pan value, tilt value, and zoom value. The above target imaging range is either a preset imaging range or an imaging range specified by the user.
[0075] The movement of the imaging range of the imaging device 100 is achieved by panning, tilting, or zooming the imaging device 100. Furthermore, the movement of the imaging range of the imaging device 100 is a loop operation in which the imaging range is repeatedly moved between a starting imaging range and an ending imaging range. In step S502, the communication unit 204 transmits a command to start the loop operation to the imaging device 100.
[0076] Furthermore, if a user has specified a stop time, the imaging device 100 will stop moving the imaging range for the specified stop time. The display control unit 201 can control the display to show the remaining time until the imaging range of the imaging device 100 starts moving, according to the stop time, when the imaging range of the imaging device 100 is stopped.
[0077] As described above, according to this embodiment, the information processing device 200 can visually indicate the remaining time or distance until the imaging range of the imaging device 100 reaches the target imaging range. The target imaging range is, for example, the end of a loop operation. This allows the user to easily understand the remaining time or distance until the imaging range of the imaging device 100 reaches the target imaging range.
[0078] (Second embodiment) In the first embodiment, the information processing device 200 calculated the time it takes to reach the target imaging range from the current imaging range. In the second embodiment, the imaging device 100 calculates the time it takes to reach the target imaging range from the current imaging range. The differences between the second embodiment and the first embodiment will be described below.
[0079] Figure 8 is a flowchart showing an example of the control method for the information processing device 200, illustrating the display control of the loop operation function. The imaging device 100 calculates the time required to reach the target imaging range from the current imaging range, according to the current imaging range.
[0080] In step S801, the system control unit 203 receives the operating status of the loop operation of the imaging device 100 from the imaging device 100 via the communication unit 204 and determines whether or not the loop operation of the imaging device 100 is in operation. If the loop operation of the imaging device 100 is in operation, the system control unit 203 proceeds to step S802. If the loop operation of the imaging device 100 is not in operation, the system control unit 203 terminates the process shown in the flowchart of Figure 8.
[0081] Next, in step S802, the system control unit 203 receives from the imaging device 100 via the communication unit 204 the time it will take for the imaging device 100 to reach the target imaging range from its current imaging range. The time it will take for the imaging device 100 to reach the target imaging range from its current imaging range is the remaining time until the imaging range of the imaging device 100 reaches the target imaging range.
[0082] Next, in step S803, the system control unit 203 determines whether the time it takes for the imaging device 100 to reach the target imaging range from the current imaging range is shorter than threshold T. If the time it takes for the imaging device 100 to reach the target imaging range is shorter than threshold T, the system control unit 203 proceeds to step S805. If the time it takes for the imaging device 100 to reach the target imaging range is not shorter than threshold T, the system control unit 203 proceeds to step S804.
[0083] In step S804, the display control unit 201 displays the time it takes to reach the target imaging range from the current imaging range as the normal state on the display 210 on the video received from the imaging device 100, and then returns to step S801.
[0084] In step S805, the display control unit 201 displays the time it takes to reach the target imaging range from the current imaging range as the approach state on the display 210 on the image received from the imaging device 100, and then returns to step S801.
[0085] In step S803, the information processing device 200 makes the determination, but this is not limited to it. The imaging device 100 may also determine whether the time it takes to reach the target imaging range from the current imaging range of the imaging device 100 is shorter than the threshold T.
[0086] Alternatively, distance may be used instead of time. In step S802, the communication unit 204 receives from the imaging device 100 the remaining time or distance until the imaging range of the imaging device 100 reaches the target imaging range.
[0087] As described above, in the second embodiment, the imaging device 100 calculates the time it takes to reach the target imaging range from the current imaging range of the imaging device 100. The information processing device 200 displays either a display screen showing the arrival time in the normal state or a display screen showing the arrival time in the approach state, depending on the arrival time. This makes it possible for the imaging device 100 to calculate the time it takes to reach the target imaging range without using the resources of the information processing device 200.
[0088] (Other embodiments) This disclosure can also be implemented by supplying a program that implements one or more of the functions of the embodiments described above to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be implemented by a circuit (e.g., an ASIC) that implements one or more functions.
[0089] Although embodiments have been described above, this disclosure is not limited to these embodiments, and various modifications and changes are possible within the scope of its essence.
[0090] This embodiment includes the following configurations, methods, and programs. (Composition 1) The system includes a display control means that controls the display of an image captured by an imaging device that captures an image while moving the imaging range, The display control means is characterized by controlling the display to perform different display processing according to the remaining time or distance until the imaging range of the imaging device reaches the target imaging range. (Configuration 2) The display control device according to configuration 1, characterized in that the display control means controls the display to perform different display processing depending on whether the remaining time or distance until the imaging range of the imaging device reaches the target imaging range is less than a threshold. (Composition 3) The display control device according to configuration 1 or 2, characterized in that the display control means controls the display to show the remaining time or distance in different ways, depending on the remaining time or distance until the imaging range of the imaging device reaches the target imaging range. (Composition 4) The display control means is If the remaining time or distance until the imaging range of the imaging device reaches the target imaging range is less than a threshold, the device is controlled to display the remaining time or distance. The display control device according to configuration 1 or 2, characterized in that, if the remaining time or distance until the imaging range of the imaging device reaches the target imaging range is greater than a threshold, the remaining time or distance is not displayed. (Composition 5) The display control device according to Configuration 1, characterized in that the display control means controls the display so that the type of ruled lines, the color of the ruled lines, the fill pattern, the color, or the decoration of any of the numbers, characters, icons, video display areas, and display components differs depending on the remaining time or distance until the imaging range of the imaging device reaches the target imaging range. (Composition 6) A display control device according to any one of configurations 1 to 5, further comprising control means for receiving the current imaging range of the imaging device from the imaging device and calculating the remaining time or distance until the imaging range of the imaging device reaches the target imaging range, based on the current imaging range of the imaging device and the target imaging range. (Composition 7) The display control device according to configuration 6, characterized in that the current imaging range and the target imaging range are represented by pan value, tilt value and zoom value. (Composition 8) The display control device according to any one of configurations 1 to 5, further comprising a communication means for receiving from the imaging device the remaining time or distance until the imaging range of the imaging device reaches a target imaging range. (Composition 9) The display control device according to any one of configurations 1 to 8, characterized in that the movement of the imaging range of the imaging device is by panning, tilting, or zooming of the imaging device. (Composition 10) The display control device according to any one of configurations 1 to 9, characterized in that the movement of the imaging range of the imaging device is a loop operation that repeatedly moves the imaging range between a starting imaging range and an ending imaging range. (Composition 11) The display control device according to configuration 10, further comprising communication means for transmitting the command to start the loop operation to the imaging device. (Composition 12) The display control device according to any one of configurations 1 to 11, characterized in that the target imaging range is a preset imaging range or an imaging range specified by the user. (Composition 13) The display control means is characterized in that, when the imaging range of the imaging device is stopped, it displays the remaining time until the imaging range of the imaging device starts moving, according to the stop time, as described in any one of configurations 1 to 12. (Composition 14) A display control device as described in any one of configurations 1 to 13, An imaging device that captures images while moving the imaging range, and An imaging system characterized by having the following features. (Method 1) A step of controlling the imaging device to display the image captured by the imaging device while moving the imaging range, The steps include controlling the imaging device to perform different display processing depending on the remaining time or distance until the imaging range reaches the target imaging range, and A control method for a display control device, characterized by having the following features. (Program 1) A step of controlling the imaging device to display the image captured by the imaging device while moving the imaging range, The steps include controlling the imaging device to perform different display processing depending on the remaining time or distance until the imaging range reaches the target imaging range, and A program that causes a computer to execute something. [Explanation of symbols]
[0091] 100 Imaging device, 200 Information processing device, 201 Display control unit, 202 Operation reception unit, 203 System control unit, 204 Communication unit, 205 Storage unit, 210 Display, 300 Network
Claims
1. A display control means that controls the display of an image captured by an imaging device that captures an image while moving the imaging range, The system includes a control means that receives the current imaging range of the imaging device from the imaging device and calculates the remaining time or distance until the imaging range of the imaging device reaches the target imaging range, based on the current imaging range of the imaging device and a target imaging range which is a preset or user-specified target imaging range. The display control means is characterized by controlling the display to display the remaining time or distance in different ways depending on the remaining time or distance.
2. The display control device according to claim 1, characterized in that the display control means controls the display of the remaining time or distance in different ways depending on whether the remaining time or distance until the imaging range of the imaging device reaches the target imaging range is less than a threshold.
3. The display control means is If the remaining time or distance until the imaging range of the imaging device reaches the target imaging range is less than a threshold, the device is controlled to display the remaining time or distance. The display control device according to claim 1, characterized in that, if the remaining time or distance until the imaging range of the imaging device reaches the target imaging range is greater than a threshold, the remaining time or distance is not displayed.
4. The display control device according to claim 1, characterized in that the display control means controls the display of any of the numbers, characters, icons, video display areas, and display components in a way that differs depending on the remaining time or distance until the imaging range of the imaging device reaches the target imaging range.
5. The display control device according to claim 1, characterized in that the current imaging range and the target imaging range are represented by pan value, tilt value and zoom value.
6. The display control device according to claim 1, characterized in that the movement of the imaging range of the imaging device is performed by panning, tilting, or zooming of the imaging device.
7. The display control device according to claim 1, characterized in that the movement of the imaging range of the imaging device is a loop operation that repeatedly moves the imaging range between a starting imaging range and an ending imaging range.
8. The display control device according to claim 7, further comprising communication means for transmitting the command to start the loop operation to the imaging device.
9. The display control means is characterized in that, when the imaging range of the imaging device is stopped, it displays the remaining time until the imaging range of the imaging device starts moving, according to the stop time, as described in claim 1.
10. The display control device according to claim 1, An imaging device that captures images while moving the imaging range, and An imaging system characterized by having the following features.
11. A step of controlling the imaging device to display the image captured by the imaging device while moving the imaging range, The steps include: receiving the current imaging range of the imaging device from the imaging device, and calculating the remaining time or distance until the imaging range of the imaging device reaches the target imaging range, based on the current imaging range of the imaging device and the target imaging range which is a preset or user-specified target imaging range. The steps include controlling the display of the remaining time or distance in different manner depending on the remaining time or distance, and A control method for a display control device, characterized by having the following features.
12. A step of controlling the imaging device to display the image captured by the imaging device while moving the imaging range, The steps include: receiving the current imaging range of the imaging device from the imaging device, and calculating the remaining time or distance until the imaging range of the imaging device reaches the target imaging range, based on the current imaging range of the imaging device and the target imaging range which is a preset or user-specified target imaging range. The steps include controlling the display of the remaining time or distance in different manner depending on the remaining time or distance, and A program that causes a computer to execute something.
Citation Information
Patent Citations
Photographic device
JP1985143330A
Remote controller for television camera
JP1993268509A
Remote controller pan head system
JP2002027287A
Imaging apparatus, image display device, and image distribution system and control method thereof
JP2006101009A
Camera device and wiper control method
JP2007166313A