Information processing apparatus, control method and program
The information processing device addresses the challenge of balancing operation icons and video visibility by dynamically adjusting their display based on screen size, ensuring optimal visibility and operability in pan/tilt/zoom camera systems.
Patent Information
- Application Number
- JP2023100257
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-06-19
- Publication Date
- 2025-01-07
AI Technical Summary
Existing pan/tilt/zoom camera systems face challenges in balancing the display of operation icons with video visibility, particularly on devices with varying screen sizes, leading to impaired visibility due to superimposed icons invading the video display area.
An information processing device that dynamically adjusts the display of pan/tilt/zoom operation icons based on the screen size, superimposing them on the video area only when necessary, using threshold-based decisions to ensure sufficient video space and maintain visibility.
Enhances image visibility by optimizing the use of display space, preventing redundant superimposition and maintaining operability on devices with limited screen real estate.
Smart Images

Figure 2025000416000001_ABST
Abstract
Description
[Technical field]
[0001] The present invention relates to an information processing device, a control method, and a program. [Background technology]
[0002] Pan-tilt-zoom cameras are known that allow control of the movement of the camera's imaging unit in the pan and tilt directions, as well as zoom control. The operator of a pan-tilt-zoom camera adjusts the composition of the image to be captured using operation icons such as slider bars displayed on a remote display device.
[0003] From the viewpoint of operability, the pan, tilt, and zoom operation icons are placed near the image display area where the operator views the image. Display devices can be PC displays, tablets, mobile terminals, etc., but the size of the area in which images can be displayed varies depending on the device. PC stands for Personal Computer. With display devices with small screen sizes such as mobile terminals, it is difficult to secure both the image display area required to ensure visibility when viewing images and the location of the pan, tilt, and zoom operation icons large enough to be operated by touch.
[0004] The information display device of Patent Document 1 prepares multiple dedicated layout screens for each specific function in advance, which maximize the display area, and attempts to ensure the necessary visibility by switching to the dedicated layout screen in response to the operator's operation. [Prior art documents] [Patent documents]
[0005] [Patent Document 1] JP 2019-28798 A Summary of the Invention [Problem to be solved by the invention]
[0006] Incidentally, the pan / tilt / zoom operations can be used to adjust the composition while viewing the image on the display device. In this case, it is desirable for each operation icon to be displayed together with an image display area large enough to view the image.
[0007] However, in Patent Document 1, the display is merely switched to one of a number of dedicated layout screens prepared in advance, and flexible display switching according to the display area of the display device cannot be performed. Therefore, it is not possible to effectively utilize the free space in the display area other than the video display area. In this case, even if there is free space, there are cases where the operation icons are superimposed on the video display area, causing the video display area to be encroached upon by the operation icons, resulting in a problem of impaired visibility for the operator.
[0008] An object of the present invention is to enable flexible display with improved image visibility. [Means for solving the problem]
[0009] An information processing device of one embodiment of the present invention has an acquisition means for acquiring a captured image, a generation means for generating a setting screen including the image and at least one icon for adjusting the composition of the image, and an output means for outputting information of the setting screen to display the setting screen on a display device, and when the size of the display area of the setting screen is less than a threshold, the generation means superimposes the icon on the image display area displaying the image. Effect of the Invention
[0010] According to the present invention, it is possible to provide a flexible display with improved image visibility. [Brief description of the drawings]
[0011] [Figure 1] 1 is a configuration diagram of a camera control system including a control device according to a first embodiment of the present invention. [Diagram 2] 1 is a functional block diagram of a camera according to a first embodiment of the present invention. [Diagram 3] 4 is a diagram showing an example of a setting screen for receiving a pan-tilt-zoom drive instruction for a camera in the control device according to the first embodiment of the present invention. FIG. [Figure 4] 1A is a diagram showing switching to superimposed display of pan-tilt-zoom operation icons for the camera on a small-screen display device according to the first embodiment of the present invention. FIG. [Diagram 5] FIG. 2 is a flowchart showing a process flow of the control device according to the first embodiment of the present invention. [Figure 6] 13A to 13C are diagrams showing switching from superimposed display of pan-tilt-zoom operation icons for the camera on a display device with a vertically long small screen according to the second embodiment of the present invention. [Figure 7] FIG. 11 is a flowchart showing a process flow of a control device according to a second embodiment of the present invention. [Figure 8] FIG. 11 is a flowchart showing a process flow of a control device according to a second embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0012] Hereinafter, the embodiments of the present invention will be described with reference to the drawings. Note that the following embodiments do not limit the invention according to the claims, and all of the combinations of features described in the embodiments are not necessarily essential to the solution of the invention.
[0013] [First embodiment] A first embodiment of the present invention will be described below with reference to Fig. 1 to Fig. 5. Fig. 1 is a diagram showing the configuration of a camera control system including a control device according to this embodiment. In Fig. 1, reference numeral 100 denotes a camera, 110 denotes a control device, 120 denotes a display device, 130 denotes a mouse, and 140 denotes a network. The camera 100 and the control device 110 are connected via the network 140 in a state in which they can communicate with each other. The control device 110 is an example of an information processing device.
[0014] The video captured by camera 100 is transmitted to control device 110 via network 140. Camera 100 also has a pan / tilt / zoom mechanism. Camera 100 can receive pan / tilt / zoom drive instructions from control device 110 via network 140 and perform the operations.
[0015] The control device 110 includes a video output unit 111 and an external input receiving unit 112. The video output unit 111 outputs a video acquired by the control device 110 from the camera 100 via a network 140. The external input receiving unit 112 receives an input from an external input device such as a mouse 130. The control device 110 generates a pan / tilt / zoom drive instruction in response to the input received by the external input receiving unit 112, and transmits the instruction to the camera 100 via the network 140.
[0016] Display device 120 is a display device for displaying video output from control device 110 via video output unit 111 for display device output. The display screen to be displayed by display device 120 is generated within camera 100, and then control device 110 receives the data and outputs it from video output unit 111, thereby realizing the display of the setting screen on display device 120.
[0017] The mouse 130 is an input device for inputting to the control device 110 via the external input receiving unit 112 .
[0018] In this embodiment, the pan / tilt / zoom drive instructions to the camera 100 are transmitted from the control device 110 via the network 140. The network 140 may be the Internet, a LAN, or a WAN, or may use a serial communication standard such as RS-232C. LAN is an abbreviation for Local Area Network. WAN is an abbreviation for Wide Area Network. The connection method may be wired or wireless. The video captured by the camera 100 may be transmitted via the Internet, a LAN, or a WAN, or may be transmitted using SDI or HDMI (registered trademark). SDI is an abbreviation for Serial Digital Interface. HDMI is an abbreviation for High-Definition Multimedia Interface.
[0019] Furthermore, the display device 120 may be a touch display and may be capable of accepting external input in place of the mouse 130 .
[0020] In addition, pan-tilt-zoom drive instructions may be sent from multiple control devices to one camera, or pan-tilt-zoom drive instructions may be sent from one control device to multiple cameras simultaneously.
[0021] 2 is a functional block diagram of a camera controlled by a control device according to this embodiment. Camera 100 has the components shown in FIG.
[0022] The imaging unit 201 is composed of an imaging lens and an imaging element, and captures an image of a subject and converts the image into an electrical signal.
[0023] The image processing unit 202 performs image processing such as noise removal and gamma correction on the electrical signals converted by the imaging unit 201 to generate image data, and transmits the image data to the system control unit 203 .
[0024] The system control unit 203 is composed of one or more processors such as a CPU or an MPU, and controls the entire camera 100 by executing a program stored in a storage unit 210 described later. The system control unit 203 also controls the transmission of generated image data to a communication unit 211. The system control unit 203 also instructs the image processing unit 202 on shooting parameters such as image quality adjustment settings. The imaging unit 201 performs adjustment control based on the instructions transmitted from the image processing unit 202. The system control unit 203 also performs processing to write and store setting values such as image quality adjustment parameters and video output settings, settings related to pan / tilt control, and the like in a predetermined area of the storage unit 210.
[0025] Furthermore, the system control unit 203 includes an internal control command processing unit 204. The control command processing unit 204 interprets pan / tilt / zoom control instruction commands received by the communication unit 211 from the control device 110 via the network 140, and issues instructions to a pan / tilt control unit 207 and a lens control unit 209.
[0026] The pan drive unit 205 is made up of a mechanical drive system that performs panning, a motor as the drive source, and an angle sensor that detects the angle of the drive unit, and when the motor is driven, the pan drive mechanism drives in the pan direction.
[0027] The tilt drive unit 206 is made up of a mechanical drive system that performs tilt operation, a motor as the drive source, and an angle sensor that detects the angle of the drive unit. When the motor is driven, the tilt drive mechanism drives in the tilt direction.
[0028] The pan / tilt control unit 207 controls the pan driving unit 205 and the tilt driving unit 206 based on an instruction signal transmitted from the system control unit 203 .
[0029] The lens driving unit 208 is composed of a mechanical driving system for the focus lens and zoom lens, a motor as a driving source thereof, and a position sensor that detects the position of the driving unit, and its operation is controlled by a lens control unit 209.
[0030] The lens control unit 209 controls the lens driving unit 208 based on an instruction signal transmitted from the system control unit 203 .
[0031] The storage unit 210 stores programs and setting values used by the system control unit 203 , and is read and written by the system control unit 203 .
[0032] The communication unit 211 communicates with the control device 110 via the network 140 , transmits received communication data to the system control unit 203 , and performs communication processing to transmit communication data transmitted from the system control unit 203 .
[0033] FIG. 3 is a diagram showing an example of a process in which pan-tilt-zoom operation icons are independently superimposed on the image display section according to the size condition of the image display section in the control device according to the present embodiment. This setting screen is output to the display device 120 based on an image being captured, which is received from the camera 100 as a response to an image acquisition request sent from the control device 110 to the camera 100. The setting screen is generated by the control device 110 based on data received from the camera 100. The control device 110 accepts an operation input by an operator of an operation icon displayed on the setting screen, and transmits the data to the camera 100. The control device 110 has a CPU and a storage device. The CPU is an abbreviation for Central Processing Unit. The storage device has a non-volatile memory. The non-volatile memory stores a program executed by the CPU. The CPU executes the program, thereby executing a process by the control device 110, which will be described later.
[0034] Reference numeral 300 denotes the entire display area on the large-screen display device. Reference numeral 301 denotes an image display area within the display area 300, which displays the image currently being captured by the camera 100.
[0035] Reference numeral 302 denotes an operation icon for panning. Reference numeral 303 denotes an operation icon for tilting. Reference numeral 304 denotes an operation icon for zooming. The operator can perform the corresponding pan-tilt-zoom drive operations by operating the operation icons 302 to 304 using the mouse 130. However, if the display device 120 is a touch display, the pan-tilt-zoom drive operations can be performed by touch operation on the display device 120 instead of the mouse 130. In this embodiment, an example in which there are three operation icons will be described, but there may be at least one operation icon.
[0036] When an operator issues an instruction for pan-tilt-zoom drive operation using operation icons 302 to 304, control device 110 calculates the pan-tilt movement amount and zoom magnification, and transmits a pan-tilt-zoom control instruction to camera 100. As a result, pan drive unit 205 and tilt drive unit 206 move the pan-tilt position of camera 100. In addition, lens drive unit 208 performs zoom processing.
[0037] By arranging the operation icons 302 to 304 in the vicinity of the image display area 301, it becomes possible to adjust the composition using the operation icons 302 to 304 while checking the image being shot.
[0038] Next, a display change method for a display device with a small displayable size will be described with reference to FIG.
[0039] Reference numeral 400 denotes the entire display area on a display device with a small display area. Reference numeral 401 denotes an image display area of the display area 400, which displays the image currently being captured by the camera 100. Reference numeral 402 denotes a pan operation icon superimposed on the image display area 401. Reference numeral 403 denotes a tilt operation icon superimposed on the image display area 401. Reference numeral 404 denotes a zoom operation icon superimposed on the image display area 401.
[0040] In a display device with a small viewer area such as a mobile terminal, if the video display area 301 and the operation icons 302 to 304 are displayed in separate areas as shown in Fig. 3, a sufficient size cannot be allocated to the video display area 301, resulting in reduced visibility of the video. In other words, in the case of a display device with a small overall display area, the size of the display area 400 is insufficient.
[0041] Therefore, when a display device smaller than a certain size is used, in order to alleviate the shortage of display area 400, video display area 301 in Fig. 3 is switched to video display area 401 dedicated to a small screen. Also, operation icons 402 to 404 corresponding to operation icons 302 to 304 are displayed superimposed on video display area 401.
[0042] 3. Moreover, only the display form changes when the operation icons 402 to 404 are displayed in a superimposed manner. The behavior after an operation instruction is given using the operation icons 402 to 404 is the same as in the case of FIG.
[0043] In this embodiment, judgments other than the size of the display device are also made. For example, thresholds are set for the vertical and horizontal sizes of the video display section in the display device. Depending on the vertical and horizontal sizes of the video display section, an object to be superimposed on the video display area 401 is selected from the operation icons 402 to 404, and the operation icon to be superimposed is displayed superimposed.
[0044] Next, a process flow for independently superimposing pan-tilt-zoom operation icons in accordance with the size conditions of the image display unit in the control device of this embodiment will be described with reference to the flowchart of Fig. 5. Fig. 5 is a diagram showing the process flow of the control device according to the first embodiment of the present invention in the form of a flowchart.
[0045] The process of this flowchart starts in a state of waiting for reception of a display instruction for display area 400. In order to show a process specialized for superimposition processing, the operation icon display at the start is the display state before superimposition shown in operation icons 302 to 304 in FIG.
[0046] In step S501, the control device 110 determines whether or not a viewer display request, which is a request to display an image from the camera 100 in the display area 300 or 400, has been received. If it is determined that the camera 100 has received the viewer display request, the process of step S502 is executed. If it is determined that the camera 100 has not received the viewer display request, the process of waiting for an instruction in step S501 is repeated.
[0047] In step S502, the control device 110 acquires size information consisting of the vertical size and horizontal size of the display area (display area 300 or display area 400) of the device to be displayed.
[0048] 3, in the first embodiment in which an image display area 301 is arranged in a display area 300 on a display device, a pan operation icon 302 is arranged and displayed in a vertically empty area within the display area 300. Further, a tilt operation icon 303 and a zoom operation icon 304 are arranged and displayed in a horizontally empty area.
[0049] In addition, when a free space cannot be secured in the vertical direction like the display area 400 in Fig. 4, the pan operation icon 402 is subject to the superimposed display change. In addition, when a free space cannot be secured in the horizontal direction like the display area 400 in Fig. 4, the tilt operation icon 403 and the zoom operation icon 404 are subject to the superimposed display change.
[0050] In step S503, the control device 110 compares the horizontal size, which is included in the size information acquired in step S502, with a threshold value for the horizontal direction (horizontal threshold value).
[0051] If the control device 110 determines that the horizontal size is smaller than the horizontal threshold (less than the horizontal threshold), the process of step S504 is executed. If the horizontal size is below the horizontal threshold, the control device 110 determines that the superimposition process of the tilt operation icon 303 and the zoom operation icon 304 arranged near the video display area 301 in the horizontal direction is necessary.
[0052] If the control device 110 determines that the horizontal size is not smaller than the horizontal threshold, the process proceeds to step S505. If the horizontal size is equal to or larger than the horizontal threshold, the control device 110 determines that the superimposition process of the operation icon 303 and the operation icon 304 is not necessary.
[0053] In step S504, the control device 110 performs a superimposition process for the operation icon 303 for tilt, and changes the display of the operation icon 303 to a superimposed display like the operation icon 403. Also in step S504, the control device 110 performs a superimposition process for the operation icon 304 for zoom, and changes the display of the operation icon 304 to a superimposed display like the operation icon 404.
[0054] In step S505, the control device 110 compares the vertical size, out of the size information acquired in step S502, with a threshold value for the vertical direction (vertical threshold value).
[0055] If the control device 110 determines that the vertical size is smaller than the vertical threshold (less than the vertical threshold), the process of step S506 is executed. If the vertical size is below the vertical threshold, the control device 110 determines that the superimposition process of the pan operation icon 302 arranged near the video display area 301 in the vertical direction is necessary.
[0056] If the control device 110 determines that the vertical size is not smaller than the vertical threshold, the process ends. If the vertical size is equal to or larger than the vertical threshold, the control device 110 determines that the superimposition process of the operation icon 302 is not necessary.
[0057] In step S506, the control device 110 handles the superimposition of the operation icon 302 for panning, and changes the display of the operation icon 302 to a superimposed display like the operation icon 402.
[0058] In addition, in the horizontal threshold comparison in step S503, as shown in Fig. 3, there are operation icons 303 and 304 for tilt and zoom, respectively. For this reason, multiple thresholds may be set for the horizontal size of display area 400, such as a first threshold and a second threshold. According to the multiple thresholds set, first, when the first threshold is exceeded, for example, operation icon 303 for tilt is changed to a superimposed display like operation icon 403. There is also a method of gradually changing the display so that operation icon 304 for zoom is superimposed on operation icon 404 when the second threshold is exceeded.
[0059] If it is assumed that the priority of zoom processing is low in terms of the user's workflow, the operation icon 304 for zooming may be superimposed when the first threshold value is exceeded, instead of the operation icon 303 for tilting.
[0060] Furthermore, various controls other than the tilt and zoom operations, or superimposed displays of various setting icons may also be controlled in association with the first threshold value and the second threshold value.
[0061] 1 to 5, a description has been given of the means by which the control device 110 determines whether or not it is necessary to independently superimpose the pan-tilt-zoom operation icons on the video display area 401. According to this determination means, it is possible to control the superimposition process of the operation icons in a gradual manner by providing a plurality of determination thresholds based on the vertical and horizontal sizes of the entire display area on the display device.
[0062] In this way, by carrying out the control of this embodiment described above, the overlay process is performed based on the vertical and horizontal sizes of the entire display area on the display device, which makes it possible to avoid the encroachment of the image display area due to redundant overlay processes that impair the operator's visibility.
[0063] Furthermore, the icons to be superimposed are not limited to operation icons such as pan, tilt, and zoom, but may be all icons such as setting icons displayed on the setting page.
[0064] [Second embodiment] A second embodiment of the present invention will be described below with reference to Fig. 6 to Fig. 7. In the second embodiment, operation icons that need to be superimposed in a single direction, vertical or horizontal, based on the first embodiment are rearranged in the remaining direction, vertical or horizontal. Thereafter, the corresponding determination process S703 or S705 is performed again to avoid redundant superimposition processing. Note that a description of the same parts as in the first embodiment will be omitted.
[0065] A display change method for a small display device that can display only horizontally will be described with reference to FIG.
[0066] Reference numeral 600 denotes the entire display area on a display device whose display area is small only in the horizontal direction. Reference numeral 601 denotes an image display area of the display area 600, which displays an image currently being captured by the camera 100. Reference numeral 602 denotes an operation icon for panning that is not superimposed on the image display area 601, similar to the operation icon 302. Reference numeral 603 denotes an operation icon for tilting that is superimposed on the image display area 601. Reference numeral 604 denotes an operation icon for zooming that is superimposed on the image display area 601. Reference numeral 605 denotes an empty area of the display area 600 in which an operation icon can be additionally arranged in the vertical direction.
[0067] 6, the diagram on the right side shows an operation icon equivalent to the zoom operation icon 604 in the diagram on the left side displayed in a free area 605. Reference numeral 606 denotes a zoom operation icon that has been released from redundant superimposition and is displayed without superimposition.
[0068] In the case of the display device in Figure 6, the display area is small in the horizontal direction, but there is ample space in the vertical direction. In this display device, if a display equivalent to that in Figure 3 is to be performed, the size of the display area is insufficient only in the horizontal direction.
[0069] However, according to the method of the first embodiment, the display area 600 is switched to a video display area 601 dedicated to the small screen, and the operation icons 603-604 arranged in the horizontal direction are displayed superimposed on the video display area 601. On the other hand, since there is a sufficient free space 05 in the vertical direction in the display area 600, the operation icons 602 for panning can be arranged without being superimposed on the video display area 601. In the example of Fig. 6, even when the operation icon 602 for panning is arranged below the video display area 601, a free space 605 remains in the vertical direction.
[0070] In the second embodiment, operation icons 603-604 that have already been superimposed and displayed based on the determination process in the horizontal direction are also moved vertically based on the determination described below. Operation icons that can be moved vertically and displayed are moved to the empty area 605 and the corresponding operation icon is released from the superimposition and displayed, thereby preventing the encroachment of the image display area due to redundant superimposition processing.
[0071] Next, a process for displaying operation icons for panning, tilting, and zooming in a free area according to the size of the display area will be described with reference to Fig. 7. This process makes it possible to avoid redundant superimposition processing.
[0072] The process of the flowchart in FIG. 7 starts after the process of the flowchart in FIG. 5 has ended.
[0073] First, in step S701, the control device 110 determines whether there is free space 605 in which an operation icon can be additionally arranged vertically or horizontally. If the control device 110 determines that there is free space 605, the process of step S702 is executed. If the control device 110 determines that there is no free space 605, the process ends.
[0074] In step S702, the control device 110 acquires the size a of the empty area 605. Next, in step S703, the control device 110 determines whether or not there is any operation icon that can be moved to the empty area 605 among the operation icons already superimposed on the video display area 601.
[0075] Incidentally, the operation in the pan direction of the camera 100 is an operation of moving the image range to be captured left and right. Therefore, if the operation icon 602 for panning is an operation of moving a slider bar left and right, the moving direction of the image range and the moving direction of the slider bar coincide, and the operator can operate without feeling any discomfort. Therefore, it is desirable to arrange the operation icon 602 for panning horizontally, and it is desirable to arrange the operation icon 603 for tilting vertically. In the example of FIG. 6, the operation icon 602 for panning is correlated with the horizontal operation, and the operation icon 603 for tilting is correlated with the vertical operation. On the other hand, the operation icon 604 for zooming is not correlated with the moving direction of the image range, so it may be arranged horizontally or vertically. In this way, the operation icon has an allowable arrangement direction. In step S703, the control device 110 may determine whether the operation icon is a movable operation icon, for example, based on whether the arrangement direction when moved is allowed. In step S703, the control device 110 may determine that the operation icon is a movable operation icon based on other conditions, for example, when the icon is displayed in a superimposed manner.
[0076] 6, the zoom operation icon 604 superimposed on the video display area 601 corresponds to the movable operation icon. If the control device 110 determines that there is an operation icon to be moved, the process of step S704 is executed. If the control device 110 determines that there is no operation icon to be moved, the process is terminated.
[0077] In step S704, the control device 110 calculates a size b, which is the size of the free space required for arranging the operation icon to be moved (here, operation icon A).
[0078] In step S705, the control device 110 compares the size a of the free space 605 with the size b of the free space necessary to arrange the operation icon A. If the control device 110 determines that size a is equal to or greater than size b, the process proceeds to step S706. That is, if size a ≧ size b, the control device 110 determines that operation icon A can be placed in the empty area 605. If the control device 110 determines that size a ≧ size b is not satisfied, the process ends. That is, the control device 110 determines that operation icon A cannot be placed in the empty area 605 unless size a ≧ size b is satisfied.
[0079] In step S706, the control device 110 places the operation icon A in the empty area 605. In the example of Fig. 6, the control device 110 determines that the superimposed zoom operation icon can be moved to the empty area 605, and places in the empty area 605 an operation icon 606 corresponding to the zoom operation icon 304.
[0080] In step S707, the control device 110 updates the size of the new free area 605 by subtracting the size b from the size a, and ends the process.
[0081] In the process of FIG. 7, a case has been described in which there is one operation icon A to be moved, but the determination of whether there is a sufficient free space in step S701 and the determination of whether there is a movable operation icon in step S703 may be repeated multiple times.
[0082] In this embodiment, the condition for moving the display location of the operation icon in step S701 is the presence or absence of free space. However, the present invention is not limited to this. For example, the condition for moving may be whether the operation icon can ensure operability, as shown in the flowchart of FIG. 8. As described above, it is desirable for the movement direction of the image range and the movement direction of the slider bar to match in the operation icon. However, if operability cannot be ensured, the operation icon is moved to a position and orientation that can ensure operability. The process of FIG. 8 will be described below.
[0083] In step S801, the control device 110 judges whether a display width sufficient to ensure the minimum operability can be secured among the operation icons 602 to 604. In the example of FIG. 6, the operation icon 602 for panning is displayed at the bottom outside the video display area 601 because it correlates with horizontal movements and does not require superimposed display. However, if the entire display area 600 on the display device is very narrow in the horizontal direction, the operation icon 602 for panning will be displayed as an icon with a very small display width, and the minimum operability cannot be guaranteed. If the control device 110 judges that the minimum operability can be guaranteed, the process is terminated. If the control device 110 judges that the minimum operability cannot be guaranteed, the process of step S802 is executed.
[0084] In step S802, the control device 110 acquires a width c in the direction in which the operation icon for which it has been determined that operability cannot be ensured is currently arranged. For example, in the case of the operation icon 602 for panning in Fig. 6, this corresponds to the width in the horizontal direction.
[0085] In step S803, the control device 110 acquires the width d in the other direction (the direction perpendicular to the direction in which the operation icon is currently arranged). In the case of the pan operation icon 602 in Fig. 6, this is the width in the vertical direction. In steps S802 and S803, the control device 110 acquires the widths in both the vertical and horizontal directions.
[0086] In step S804, the control device 110 judges which of the widths acquired in steps S802 and S803 is larger. If the control device 110 judges that the width d of the destination is larger than the width c of the direction in which the icon is currently placed, the process of step S805 is executed. In this case, the control device 110 judges that the operation icon should be moved. If the control device 110 judges that the width d of the destination is not larger than the width c of the direction in which the icon is currently placed, the process is terminated. In this case, the control device 110 judges that the operability will be further deteriorated by the moving process.
[0087] In step S805, the control device 110 changes the location of the operation icon in the width d direction of the destination. If a superimposed display is required at the destination, the control device 110 performs a process of changing to a superimposed display according to the above-mentioned method. The method of moving the display location of the operation icon described in the process of FIG. 8 makes it possible to improve not only visibility but also operability.
[0088] In the above embodiment, the display of operation icons for operating the camera 100 has been described, but the present invention is not limited to this. For example, the display of any icon, such as a setting icon for performing various settings of the camera 100 or the control device 110, can be processed in the same manner.
[0089] (Other embodiments) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.
[0090] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention.
[0091] The disclosure of this embodiment includes the following configurations and methods. (Configuration 1) An acquisition means for acquiring the captured image; a generating means for generating a setting screen including the image and at least one icon for adjusting a composition of the image; an output means for outputting information of the setting screen in order to display the setting screen on a display device; When the size of the display area of the setting screen is less than a threshold, the generating means superimposes the icon on an image display area that displays the image. 23. An information processing apparatus comprising: (Configuration 2) When the horizontal size of the display area is less than a horizontal threshold, the generating means superimposes the icon to be displayed horizontally on the video display area. 2. The information processing device according to configuration 1. (Configuration 3) When the vertical size of the display area is less than a vertical threshold, the generating means superimposes the icon to be displayed vertically on the video display area. 3. The information processing device according to configuration 1 or 2. (Configuration 4) The generating means moves the icon to an empty area of the display area. 4. The information processing device according to any one of configurations 1 to 3. (Configuration 5) When operability of the icon cannot be ensured, and when a size of the display area in a direction perpendicular to a direction in which the icon is arranged is larger than a size of the display area in which the icon is arranged, the generating means changes the arrangement destination of the icon in the direction perpendicular to the direction in which the icon is arranged. 5. The information processing device according to any one of configurations 1 to 4. (Configuration 6) The icon is an operation icon. 6. The information processing device according to any one of configurations 1 to 5. (Method 1) An acquisition step of acquiring the captured image; a generating step of generating a setting screen including the image and at least one icon for adjusting a composition of the image; an output step of outputting information of the setting screen in order to display the setting screen on a display device; When a size of a display area of the setting screen is less than a threshold, the generating step superimposes the icon on an image display area that displays the image. A control method comprising: (Program 1) A program for causing a computer to function as each of the means according to any one of configurations 1 to 6. [Explanation of symbols]
[0092] 100 Cameras 110 Control device 120 Display Devices 130 Mouse 140 Network
Claims
1. An acquisition means for acquiring the captured image; a generating means for generating a setting screen including the image and at least one icon for adjusting a composition of the image; an output means for outputting information of the setting screen in order to display the setting screen on a display device; When the size of the display area of the setting screen is less than a threshold, the generating means superimposes the icon on an image display area that displays the image.
23. An information processing apparatus comprising:
2. When the horizontal size of the display area is less than a horizontal threshold, the generating means superimposes the icon to be displayed horizontally on the video display area.
2. The information processing apparatus according to claim 1,
3. When the vertical size of the display area is less than a vertical threshold, the generating means superimposes the icon to be displayed vertically on the video display area.
2. The information processing apparatus according to claim 1,
4. The generating means moves the icon to an empty area of the display area.
2. The information processing apparatus according to claim 1,
5. When operability of the icon cannot be ensured, and when a size of the display area in a direction perpendicular to a direction in which the icon is arranged is larger than a size of the display area in which the icon is arranged, the generating means changes the arrangement destination of the icon in the direction perpendicular to the direction in which the icon is arranged.
2. The information processing apparatus according to claim 1,
6. The icon is an operation icon.
2. The information processing apparatus according to claim 1,
7. An acquisition step of acquiring the captured image; a generating step of generating a setting screen including the image and at least one icon for adjusting a composition of the image; an output step of outputting information of the setting screen in order to display the setting screen on a display device; When a size of a display area of the setting screen is less than a threshold, the generating step superimposes the icon on an image display area that displays the image. A control method comprising:
8. A program for causing a computer to function as each of the means according to any one of claims 1 to 6.
Citation Information
Patent Citations
Information display program, information display device, information display method, and distribution device
JP2019028798A