Electronic device, method for controlling electronic device, and storage medium

Abstract

To suppress deviation between an image displayed on a display unit (for example, an LED wall) and an image captured by an imaging device (for example, a PTZ camera).SOLUTION: An electronic apparatus according to the present invention is an electronic apparatus used in a system including a display device and an imaging device that captures an image of a part of a display surface of the display device, the display device performing display according to an imaging angle of view of the imaging device, the electronic apparatus performing control to suppress a change in the imaging angle of view when an instruction to change the imaging angle of view by a change amount larger than a threshold value is given.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an electronic device, a control method for an electronic device, a program, and a storage medium. [Background technology]

[0002] In recent years, virtual production shooting, in which background images are displayed on a giant LED wall and the background image and real-life subject are shot simultaneously, has rapidly become popular for live broadcasting and streaming.

[0003] Virtual production shooting uses PTZ cameras (cameras that can be panned, tilted, and zoomed, hereafter referred to as PTZ cameras). The images displayed on the LED wall are generated based on the PTZ camera's imaging angle of view (PTZ camera position information and lens setting information such as zoom, aperture, and focus).

[0004] However, if the PTZ camera's imaging angle of view changes significantly between acquiring imaging angle information, generating an image, and displaying that image on the LED wall, it becomes impossible to obtain a correlation between the image displayed on the LED wall and the image captured (filmed) by the PTZ camera.

[0005] Patent Document 1 discloses a technique for predicting the position of a virtual camera after a predetermined time based on movement data relating to past movements of the virtual camera. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Publication No. 2020-144748 Summary of the Invention [Problem to be solved by the invention]

[0007] However, even if the technology disclosed in Patent Document 1 is used, the future position of the camera is merely predicted based on the past movements of the camera, and it is not possible to deal with camera movements that have not occurred in the past.

[0008] The present invention aims to reduce the discrepancy between an image displayed on a display unit (for example, an LED wall) and an image captured by an imaging device (for example, a PTZ camera). [Means for solving the problem]

[0009] The electronic device of the present invention is an electronic device used in a system having a display device and an imaging device that images a portion of the display surface of the display device, and in which the display device performs display according to the imaging angle of view of the imaging device, and is characterized in that it has a control means that performs control to suppress the change of the imaging angle of view when an instruction is given to change the imaging angle of view by an amount greater than a threshold value. [Effects of the Invention]

[0010] According to the present invention, it is possible to reduce the discrepancy between an image displayed on a display unit (for example, an LED wall) and an image captured by an imaging device (for example, a PTZ camera). [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a block diagram showing the configuration of an imaging system according to a first embodiment. [Figure 2] 2 is a schematic diagram showing the relationship between an imaging unit, an LED display unit, and the like according to the first embodiment. FIG. [Figure 3] 4 is a flowchart showing the operation of the imaging system according to the first embodiment. [Figure 4] FIG. 10 is a block diagram showing the configuration of an imaging system according to a second embodiment. [Figure 5] FIG. 10 is a diagram illustrating a delay in the imaging system according to the second embodiment. [Figure 6] 10 is a flowchart showing the operation of the imaging system according to the second embodiment. [Figure 7]11 is a flowchart showing the operation of the imaging system according to the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0012] <Embodiment 1> A first embodiment of the present invention will be described below with reference to the accompanying drawings. Fig. 1 is a block diagram showing the configuration of an imaging system 100 according to the first embodiment. The imaging system 100 is capable of virtual production imaging, which simultaneously captures (photographs) a background image displayed on an LED display unit 106 (described later) and an actual subject.

[0013] The photographing system 100 includes a communication bus 101 , an imaging unit 102 , a position information detection unit 103 , a video processing unit 104 , an LED driving unit 105 , an LED display unit 106 , a camera operation unit 107 , a synchronization signal generation unit 108 , and a control unit 109 .

[0014] Communication bus 101 is a network such as a LAN. Connected to communication bus 101 are an imaging unit 102, a position information detection unit 103, an image processing unit 104, an LED driving unit 105, an LED display unit 106, a camera operation unit 107, a synchronization signal generation unit 108, and a control unit 109. The units connected to communication bus 101 can transmit and receive data to and from each other via communication bus 101. Furthermore, when the amount of data to be communicated is large, the units connected to communication bus 101 may be connected to each other by separately provided communication lines.

[0015] The imaging unit 102 is a PTZ camera. The imaging unit 102 receives an operation command from the control unit 109, and performs at least one of a pan operation, a tilt operation, and a zoom operation in response to the operation command. The imaging unit 102 also transmits information relating to the pan, tilt, and zoom states to the video processing unit 104. The imaging unit 102 is disposed in a position where it can capture an image of a portion of the display surface of the LED display unit 106. The imaging unit 102 transmits the captured video signal to a recording device (not shown).

[0016] The position information detection unit 103 is a positioning device that acquires the position information of the imaging unit 102. The position information detection unit 103 is installed near the housing of the imaging unit 102. The position information detection unit 103 transmits the acquired position information of the imaging unit 102 to the video processing unit 104.

[0017] The video processing unit 104 receives information indicating the pan, tilt, and zoom states from the imaging unit 102, and receives position information from the position information detection unit 103. The video processing unit 104 generates display data (images) to be displayed on the LED display unit 106 based on the information received from the imaging unit 102 and the position information detection unit 103. The video processing unit 104 performs rendering processing of 3DCG data based on the received information, and generates display data. The video processing unit 104 may be a component of an information processing device such as a computer, or may be the computer itself. The video processing unit 104 transmits the display data to the LED driving unit 105.

[0018] The LED driving unit 105 is a signal processing device that drives the LED display unit 106 based on the display data received from the video processing unit 104.

[0019] The LED display unit 106 is a display device. In the LED display unit 106, a plurality of LED elements are arranged in a plane, and the brightness of each LED element can be controlled. The LED display unit 106 is driven by an LED drive unit 105. The display surface of the LED display unit 106 is configured to enable high-resolution display (display at a resolution higher than a predetermined value).

[0020] The camera operation unit 107 is an interface that accepts user operations (instructions) for changing the imaging angle of view of the imaging unit 102 from the outside. In response to the user operations, the camera operation unit 107 transmits operation commands to the control unit 109 that cause the imaging unit 102 to perform panning, tilting, and zooming operations. The camera operation unit 107 is composed of, for example, mechanical buttons and switches. The camera operation unit 107 may include a display device (a display device provided with a touch panel) that can accept touch operations.

[0021] The synchronization signal generating unit 108 is a sync generator and transmits a synchronization signal to each unit connected to the communication bus 101 for each frame period.

[0022] The control unit 109 controls each unit connected to the communication bus 101. The control unit 109 may be one component of an information processing device such as a computer, or may be the information processing device (electronic device) itself. The control unit 109 and the video processing unit 104 may be provided in the same information processing device. However, the location where the control unit 109 is provided is not limited to this, and the control unit 109 may be provided inside the imaging unit 102 or the LED display unit 106, for example.

[0023] In addition, the control unit 109 processes an operation command input from the camera operation unit 107 and controls the imaging unit 102 by transmitting to the imaging unit 102 an operation command for changing the imaging angle of view of the imaging unit 102.

[0024] FIG. 2 is a schematic diagram showing the relationship between the imaging unit 102, the LED display unit 106, and the display data (image).

[0025] An imaging field of view area 201 corresponding to the imaging field of view of the imaging unit 102 is part of the display surface of the LED display unit 106. The control unit 109 controls the imaging unit 102, whereby the imaging field of view area 201 changes.

[0026] The display surface of the LED display unit 106 includes a high-resolution region 202 (inner frustum region) where high-resolution display is performed, and the high-resolution region 202 changes so as to follow, with a delay, changes in the imaging field of view region 201. The display surface of the LED display unit 106 also includes a peripheral region 203 outside the high-resolution region 202.

[0027] In virtual production shooting using the shooting system 100, in order to reduce the rendering processing load on the video processing unit 104, high-precision rendering processing is performed only on the video displayed in the high-resolution area 202. In addition, a still image extracted from 3DCG data is displayed in the peripheral area 203.

[0028] FIG. 3 is a flowchart showing the operation of the imaging system 100.

[0029] In S300, the control unit 109 determines whether or not a panning operation command (an operation command corresponding to a panning operation that causes a panning operation) has been issued from the camera operation unit 107. If a panning operation command has been issued from the camera operation unit 107, the process proceeds to S301. If a panning operation command has not been issued from the camera operation unit 107, the process proceeds to S305.

[0030] In S301, the control unit 109 acquires information on the rendering processing time for generating display data from the video processing unit 104. The rendering processing time is the time required for the video processing unit 104 to perform the rendering processing. The rendering processing time is acquired in frame units synchronized with the synchronization signal transmitted by the synchronization signal generation unit 108.

[0031] In S302, the control unit 109 acquires the coordinates of the current high resolution area 202 (or the area in the display data that corresponds to the high resolution area 202) from the video processing unit 104.

[0032] In S303, the control unit 109 calculates the coordinate range of the image capture field of view area 201 after the rendering processing time has elapsed, based on the content of the pan operation command issued in S300. The control unit 109 also determines whether the coordinate range of the image capture field of view area 201 includes the outside of the coordinate range of the current high resolution area 202. If the coordinate range of the image capture field of view area 201 includes the outside of the coordinate range of the high resolution area 202, the process proceeds to S304. If not, the process proceeds to S315.

[0033] In S304, the control unit 109 limits the amount of movement of the imaging unit 102 (amount of change in the imaging field of view 201) in response to the amount of operation of the pan operation command to an amount of movement smaller than the amount of movement corresponding to the pan operation command (amount of pan operation). The control unit 109 issues an operation command in which the amount of movement of the imaging unit 102 is limited so that the imaging field of view 201 continues to be included in the high-resolution area 202 after the rendering processing time has elapsed.

[0034] In S305, control unit 109 determines whether a tilt operation command (an operation command corresponding to a tilt operation that causes a tilt movement) has been issued from camera operation unit 107. If a tilt operation command has been issued from camera operation unit 107, the process proceeds to S306. If a tilt operation command has not been issued from camera operation unit 107, the process proceeds to S310.

[0035] In S306, the control unit 109 performs the same process as in S301.

[0036] In S307, the control unit 109 performs the same process as in S302.

[0037] In S308, the control unit 109 calculates the coordinate range of the image capture field of view area 201 after the rendering processing time has elapsed, based on the content of the tilt operation command issued in S305. The control unit 109 also determines whether the coordinate range of the image capture field of view area 201 includes the outside of the coordinate range of the current high resolution area 202. If the coordinate range of the image capture field of view area 201 includes the outside of the coordinate range of the high resolution area 202, the process proceeds to S309. If not, the process proceeds to S315.

[0038] In S309, the control unit 109 limits the amount of movement of the imaging unit 102 in response to the amount of operation of the tilt operation command to an amount of movement smaller than the amount of movement corresponding to the tilt operation command (amount of tilt operation). The control unit 109 issues an operation command that limits the amount of movement of the imaging unit 102 so that the imaging field of view area 201 continues to be included in the high resolution area 202 after the rendering processing time has elapsed.

[0039] In S310, the control unit 109 determines whether a zoom operation command (an operation command corresponding to a zoom operation that causes a zoom operation) has been issued from the camera operation unit 107. If a zoom operation command has been issued from the camera operation unit 107, the process proceeds to S311. If a tilt operation command has not been issued from the camera operation unit 107, the process returns to S300.

[0040] In S311, the control unit 109 performs the same process as in S301.

[0041] In S312, the control unit 109 performs the same process as in S302.

[0042] In S313, the control unit 109 calculates the coordinate range of the image capture field of view area 201 after the rendering processing time has elapsed, based on the content of the zoom operation command issued in S310. The control unit 109 also determines whether the coordinate range of the image capture field of view area 201 includes the outside of the coordinate range of the current high resolution area 202. If the coordinate range of the image capture field of view area 201 includes the outside of the coordinate range of the high resolution area 202, the process proceeds to S314. If not, the process proceeds to S315.

[0043] In S314, the control unit 109 limits the amount of movement of the imaging unit 102 in response to the amount of operation of the zoom operation command to an amount of movement smaller than the amount of movement corresponding to the zoom operation command (amount of zoom operation). The control unit 109 issues an operation command that limits the amount of movement of the imaging unit 102 so that the imaging field of view area 201 continues to be included in the high-resolution area 202 after the rendering processing time has elapsed.

[0044] In S315, the control unit 109 transmits the operation command issued in S304, S309, or S314 to the imaging unit .

[0045] In S303, S308, and S313, the control unit 109 calculates the coordinate range of the image capture field of view area 201 after the rendering processing time has elapsed. The control unit 109 also determines whether the coordinate range of the image capture field of view area 201 includes an area outside the coordinate range of the current high resolution area 202. However, the coordinate range (threshold) of the high resolution area 202 is not limited to the current coordinate range, and for example, the control unit 109 may estimate and use the coordinate range of the high resolution area 202 after the rendering processing time has elapsed.

[0046] As described above, according to the operation of the first embodiment, when an instruction is given to change the imaging field of view region 201 so that it includes the outside of the high resolution region 202, control is performed to suppress the amount of change of the imaging field of view region 201 to a smaller amount than the amount of change according to the instruction. This makes it possible to suppress the discrepancy between the image displayed on the LED display unit 106 and the image captured by the imaging unit 102 that occurs due to the rendering processing time.

[0047] Furthermore, in the first embodiment, a video signal captured by the imaging unit 102 may be input to a subject detection unit (not shown). The subject detection unit detects a subject from the video signal using, for example, AI. The subject detection unit may transmit operation commands to the control unit 109 to cause the imaging unit 102 to perform panning, tilting, and zooming operations according to the subject detection result. In this case, the user may input an instruction to detect a subject to the camera operation unit 107, causing the subject detection unit to detect the subject from the video signal.

[0048] In the first embodiment, the control unit 109 limits the amount of change of the imaging field of view 201 (the amount of movement of the imaging unit 102) to an amount smaller than the amount of change corresponding to an operation command from the camera operation unit 107, so that the imaging field of view 201 continues to be included in the high resolution area 202. However, the control unit 109 may not only limit the amount of movement of the imaging unit 102, but also notify the user that the coordinate range of the imaging field of view 201 is outside the coordinate range of the high resolution area 202, for example, by issuing a warning using a display unit (not shown).

[0049] <Embodiment 2> Next, a second embodiment will be described. In the first embodiment, a method was described in which the amount of movement of the imaging unit 102 is suppressed in response to the amount of operation of a panning operation command, a tilting operation command, or a zooming operation command, while taking into consideration only the rendering processing time required for the image processing unit 104 to generate display data. However, in general, in an imaging system, delay times that cause a discrepancy between an image displayed on a display unit and an image captured by an imaging device exist other than the rendering processing time. For example, these delay times include the time required for the imaging device to capture an image with an imaging sensor and output a video signal, and the time required for the display data to be displayed on a display unit after rendering processing of the display data is completed. In the second embodiment, a method that takes these delay times into consideration will be described.

[0050] 4 is a block diagram showing the configuration of an imaging system 400 according to the second embodiment. In the explanation of the second embodiment, differences from the first embodiment will be explained, and similarities with the imaging system 100 will be explained. Detailed explanations will be omitted.

[0051] The video comparison unit 401 may be a component of an information processing device such as a computer, or may be the computer itself. The video comparison unit 401 is connected to the communication bus 101. The video comparison unit 401 receives the video signal captured by the imaging unit 102 and the display data generated by the video processing unit 104, and stores multiple frames of display data in an internal memory (not shown). The video comparison unit 401 calculates a correlation value between the video signal acquired from the imaging unit 102 and the display data stored in the internal memory, and calculates the time difference between the capture timing of the video signal and the generation timing of the display data with the highest correlation value. In the second embodiment, the time difference (time) calculated by the video comparison unit 401 is referred to as a frame delay difference.

[0052] Figure 5 is a diagram illustrating delays in the imaging system 400. The horizontal axis in Figure 5 represents time. Figure 5 also shows the timing at which the image processing unit 104 generates display data, the timing at which the LED display unit 106 displays the display data, and the timing at which the imaging unit 102 outputs a video signal. Below, we will explain the delays of each unit in the imaging system 400 and the frame delay differences resulting from these delays.

[0053] The video processing unit 104 generates one frame of display data every predetermined time. It takes N frames of time from when the display data for one frame (the hatched frame in FIG. 5) is generated by the video processing unit 104 until it is displayed on the LED display unit 106.

[0054] The imaging unit 102 captures an image of the LED display unit 106. It takes M frames of time for the imaging unit 102 to capture an image of the LED display unit 106 and output a video signal.

[0055] As described above, a time equivalent to (N+M) frames is required from the time when the video processing unit 104 generates display data until the display data is reflected in the video signal output from the imaging unit 102 (until the imaging of the LED display unit 106 displaying the display data is completed). Therefore, the frame delay difference acquired by the video comparing unit 401 is a time equivalent to (N+M) frames.

[0056] 6 is a flowchart showing the operation of the imaging system 400. Operations other than S600 to S612 in FIG. 6 are the same as those of the imaging system 100 according to the first embodiment described with reference to FIG.

[0057] In S600, the video comparison unit 401 calculates a correlation value between the video signal transmitted from the imaging unit 102 and the display data generated by the video processing unit 104. The video comparison unit 401 calculates, as a frame delay difference, the time difference between the imaging timing of the video signal and the generation timing of the display data with the highest correlation value among the multiple pieces of display data stored in the internal memory.

[0058] In S601, the control unit 109 acquires information on the frame delay difference from the video comparison unit 401.

[0059] In S602, the control unit 109 calculates the coordinate range of the image capture field of view area 201 after the total time of the rendering processing time and the frame delay difference has elapsed, based on the content of the pan operation command issued in S300. The control unit 109 also determines whether the coordinate range of the image capture field of view area 201 includes the outside of the coordinate range of the current high resolution area 202. If the coordinate range of the image capture field of view area 201 includes the outside of the coordinate range of the high resolution area 202, the process proceeds to S603. If not, the process proceeds to S612.

[0060] In S603, the control unit 109 limits the movement amount of the image capturing unit 102 in response to the operation amount of the panning command to a movement amount smaller than the movement amount corresponding to the panning command. issues an operation command that limits the amount of operation of the image capturing unit 102 so that the image capturing field of view area 201 continues to be included in the high resolution area 202 after the total time including the rendering processing time and the frame delay difference has elapsed.

[0061] In S604, the video comparison unit 401 performs the same process as in S600.

[0062] In S605, the control unit 109 performs the same process as in S601.

[0063] In S606, the control unit 109 calculates the coordinate range of the image capture field of view area 201 after the total time including the rendering processing time and the frame delay difference has elapsed, based on the content of the tilt operation command issued in S305. The control unit 109 also determines whether the coordinate range of the image capture field of view area 201 includes the outside of the coordinate range of the current high resolution area 202. If the coordinate range of the image capture field of view area 201 includes the outside of the coordinate range of the high resolution area 202, the process proceeds to S607. If not, the process proceeds to S612.

[0064] In S607, the control unit 109 limits the amount of movement of the imaging unit 102 in response to the amount of operation of the tilt operation command to a smaller amount of movement than the amount of movement corresponding to the tilt operation command. The control unit 109 issues an operation command that limits the amount of movement of the imaging unit 102 so that the imaging field of view area 201 continues to be included in the high resolution area 202 after the total time including the rendering processing time and the frame delay difference has elapsed.

[0065] In S608, the video comparison unit 401 performs the same process as in S600.

[0066] In S609, the control unit 109 performs the same process as in S601.

[0067] In S610, the control unit 109 calculates the coordinate range of the image capture field of view area 201 after the total time including the rendering processing time and the frame delay difference has elapsed, based on the content of the zoom operation command issued in S310. The control unit 109 also determines whether the coordinate range of the image capture field of view area 201 includes the outside of the coordinate range of the current high resolution area 202. If the coordinate range of the image capture field of view area 201 includes the outside of the coordinate range of the high resolution area 202, the process proceeds to S611. If not, the process proceeds to S612.

[0068] In S611, the control unit 109 limits the amount of movement of the imaging unit 102 in response to the amount of operation of the zoom operation command to an amount of movement smaller than the amount of movement corresponding to the pan operation command. The control unit 109 issues an operation command that limits the amount of movement of the imaging unit 102 so that the imaging field of view area 201 continues to be included in the high-resolution area 202 after the total time including the rendering processing time and the frame delay difference has elapsed.

[0069] In S612, the control unit 109 transmits the operation command issued in S603, S607, or S611 to the imaging unit .

[0070] As described above, according to the operation of the second embodiment, the control unit 109 calculates a total time that is a combination of the rendering processing time and the frame delay difference. Then, the control unit 109 delays the operation of the image capture unit 102 by the total time so that the coordinate range of the image capture angle of view area 201 after the total time has elapsed from the timing when an instruction to change the image capture angle of view area 201 was given continues to be included in the coordinate range of the high resolution area 202. This makes it possible to reduce the difference between the image displayed on the LED display unit 106 and the image captured by the image capture unit 102 due to multiple delay times.

[0071] <Embodiment 3> Next, a third embodiment will be described. In the first embodiment, a method was described in which the amount of movement of the imaging unit 102 is reduced in response to the amount of operation of a pan operation command, a tilt operation command, or a zoom operation command, taking into consideration only the rendering processing time required for the video processing unit 104 to generate display data. In the third embodiment, a method will be described in which the control unit 109 delays the issuance of an operation command to thereby delay the operation of the imaging unit 102, thereby reducing the discrepancy between the image displayed on the LED display unit 106 and the image captured by the imaging unit 102.

[0072] 7 is a flowchart showing the operation of the imaging system 100 according to the third embodiment. In the explanation of the third embodiment, differences from the first embodiment will be explained, and detailed explanation of the similarities with the imaging system 100 will be omitted. Operations other than S700 to S706 in FIG. 7 are the same as those of the imaging system 100 according to the first embodiment explained in FIG.

[0073] In S700, the control unit 109 transmits an instruction to generate display data to the image processing unit 104 based on the amount of change in the imaging field of view 201 caused by the pan operation command issued in S300. The image processing unit 104 generates the display data by performing rendering processing based on the instruction from the control unit 109.

[0074] In S701, the control unit 109 issues an operation command for the panning operation based on the panning operation command issued in S300, with a delay of a rendering processing time from when the user operates the camera operation unit 107. As a result, the panning operation of the imaging unit 102 is also delayed in accordance with the issuance of the operation command.

[0075] In S702, the control unit 109 transmits an instruction to generate display data to the image processing unit 104 based on the amount of change in the imaging field of view 201 caused by the tilt operation command issued in S305. The image processing unit 104 generates the display data by performing rendering processing based on the instruction from the control unit 109.

[0076] In S703, the control unit 109 issues an operation command for the tilt operation based on the tilt operation command issued in S305, with a delay of the rendering processing time from when the user operates the camera operation unit 107. As a result, the tilt operation of the imaging unit 102 is also delayed in accordance with the issuance of the operation command.

[0077] In S704, the control unit 109 transmits an instruction to generate display data to the image processing unit 104 based on the amount of change in the imaging field of view 201 caused by the zoom operation command issued in S310. The image processing unit 104 generates the display data by performing rendering processing based on the instruction from the control unit 109.

[0078] In S705, the control unit 109 issues a zoom operation command based on the zoom operation command issued in S310, with a delay of the rendering processing time from when the user operates the camera operation unit 107. As a result, the zoom operation of the imaging unit 102 is also delayed in accordance with the issuance of the operation command.

[0079] In S706, the control unit 109 transmits the operation command issued in S701, S703, or S705 to the imaging unit .

[0080] In FIG. 3 explaining the first embodiment and FIG. 6 explaining the second embodiment, the step of performing the rendering process based on the instruction of the control unit 109 is omitted, but the rendering process may be performed in the same manner as in FIG. 7 explaining the third embodiment. Also, in FIG. 7, an example is shown in which the rendering process is performed only when the coordinate range of the imaging field of view area 201 includes outside the coordinate range of the high resolution area 202, but this is not limiting. For example, if the coordinate range of the imaging field of view area 201 includes outside the coordinate range of the high resolution area 202, Rendering may be performed even if the coordinate range does not include the area outside of 02.

[0081] As described above, according to the operation of the third embodiment, when an instruction is given to change the imaging field of view region 201 so as to include the outside of the high resolution region 202, the control unit 109 performs control to delay the change of the imaging field of view region 201 by the rendering processing time. This makes it possible to reduce the discrepancy between the image displayed on the LED display unit 106 and the image captured by the imaging unit 102 that occurs due to the rendering processing time.

[0082] The various controls described above may or may not be performed by a single piece of hardware (e.g., a processor or circuit). The entire device may be controlled by multiple pieces of hardware (e.g., multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) sharing the processing.

[0083] The above processor is a processor in the broad sense, and includes general-purpose processors and dedicated processors. General-purpose processors include, for example, CPUs (Central Processing Units), MPUs (Micro Processing Units), and DSPs (Digital Signal Processors). Dedicated processors include, for example, GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), and PLDs (Programmable Logic Devices). Programmable logic devices include, for example, FPGAs (Field Programmable Gate Arrays) and CPLDs (Complex Programmable Logic Devices).

[0084] Although the embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-described embodiments merely represents one embodiment of the present invention, and each embodiment can be combined as appropriate.

[0085] <Other embodiments> The present invention can also be realized by a process in which a program that realizes one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in the computer of the system or device read and execute the program, or by a circuit that realizes one or more functions. [Explanation of symbols]

[0086] 102 Imaging unit 106 LED display section 109 Control Unit 201 Imaging angle of view

Claims

1. 1. An electronic device used in a system having a display device and an imaging device that captures an image of a part of a display surface of the display device, wherein the display device performs a display according to an imaging angle of the imaging device, a control means for suppressing a change in the imaging angle of view when an instruction to change the imaging angle of view by an amount greater than a threshold value is received; An electronic device comprising:

2. the display device performs high-resolution display on a part of the display surface, the area where high resolution display is performed changes in accordance with a change in the imaging angle of view with a delay so as to include the entire imaging angle of view, The control means performs the control to suppress the change of the imaging angle of view so that the entire imaging angle of view continues to be included in the area where high resolution display is performed.

2. The electronic device according to claim 1, wherein the electronic device is a semiconductor device.

3. a first time is required from when the information on the imaging angle of view is acquired until when the image to be displayed on the display device is generated; The control means performs the control such that, when the imaging angle of view according to the instruction after the first time period has elapsed from the timing of the instruction includes an area outside the area where high-resolution display is performed, the amount of change in the imaging angle of view is limited to an amount of change smaller than the amount of change according to the instruction.

3. The electronic device according to claim 2.

4. a first time is required from when the information on the imaging angle of view is acquired until when the image to be displayed on the display device is generated; a second time is required from when an image to be displayed on the display device is generated until when imaging of the display device displaying the image is completed; The control means performs the control such that, when the imaging angle of view according to the instruction after the total time of the first time and the second time has elapsed since the timing of the instruction includes an area outside the area where high-resolution display is performed, the amount of change of the imaging angle of view is limited to an amount of change smaller than the amount of change according to the instruction.

3. The electronic device according to claim 2.

5. a first time is required from when the information on the imaging angle of view is acquired until when the image to be displayed on the display device is generated; The control means performs the control such that, when an imaging angle of view according to the instruction after the first time period has elapsed since the timing of the instruction includes an area outside the high-resolution display area, a change of the imaging angle of view is delayed by the first time period from the timing of the instruction.

3. The electronic device according to claim 2.

6. A method for controlling an electronic device, comprising: an instruction step of issuing an instruction to change the imaging angle of view by an amount greater than a threshold; a suppression step of suppressing a change in the imaging angle of view; A control method comprising:

7. A program for causing a computer to function as the control means for the electronic device according to any one of claims 1 to 5.

8. A computer functions as a control means for the electronic device according to any one of claims 1 to 5. A computer-readable storage medium that stores a program for causing a computer to

Images