Remote control system and method

Abstract

To surely perform a remote control of a relay camera in a moment without a riding of an operator of the relay camera onto a helicopter.SOLUTION: In a first facility, a video image of a subject and a video image of a circumference of the subject are acquired, a first signal is generated by encoding the video image of the subject, a second signal is generated by encoding the video image of the circumference of the subject, and a third signal is generated by combining the first and second signals. In a second facility, the third signal is divided into the first and second signals, the video image of the subject is generated by decoding the first signal, the video image of the circumference of the subject is generated by decoding the second signal, the video image of the subject and the video image of the circumference of the subject are reflected, an operation signal for operating a device in accordance with an introduction input by an operator who views the video image reflected is generated. The operation signal is transmitted to the first facility, and the device is operated in accordance with the operation signal in the first facility.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to a remote control system and method, and more particularly to a remote control system and method for remotely controlling a broadcast camera using two-way communication in a helicopter television transmission system. [Background technology]

[0002] In a conventional helicopter television transmission system, a relay camera operator boards the helicopter and operates a control device to take pictures with the relay camera, then transmits the video signal to ground equipment that receives the relayed video.

[0003] In recent years, a system has been known as a remote control system for an imaging device, in which an imaging device is mounted on an unmanned helicopter and the direction of the imaging device is controlled while viewing an image displayed on a monitor device on the ground. A drive unit controls the attitude of the imaging unit and the pointing direction of the optical system in the imaging unit, and detects the direction of the imaging unit. A GPS receiver detects the position of the unmanned helicopter. An image information processing unit generates image information by superimposing angle information and position information on the image. The generated image information is sent to the monitor device via a video transmitter and video receiver, and displayed on a screen (see, for example, Patent Document 1 (pages 2-3)).

[0004] Also, as a video transmission system for remotely operated construction machinery, a system is known in which multiple cameras mounted on the construction machinery for capturing surrounding surveillance video, an operating device for remotely operating the construction machinery, and multiple displays for displaying the surrounding surveillance video are communicatively connected via a network to transmit the surrounding surveillance video. A connection / disconnection member switches between a connected state and a disconnected state between the cameras and the encoders and decoders of the displays, and a connection / disconnection control device controls the connection / disconnection member so as to connect only the encoders and decoders of the displays showing the surrounding surveillance video in the direction in which the construction machinery is driven (for example, see Patent Document 2 (page 2)). [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2001-309233 A [Patent Document 2] JP 2017-092908 A Summary of the Invention [Problem to be solved by the invention]

[0006] However, in conventional helicopter television transmission systems where the relay camera is operated manually, space is required for the operator and the operation device of the relay camera, which results in a problem of reducing the space for carrying disaster victims and victims in distress, and the space for carrying rescue operation equipment.

[0007] In addition, there was a problem in that the operator of the broadcast camera had to be on board the helicopter, making it impossible to reduce the weight of the entire helicopter and improve fuel efficiency.

[0008] Furthermore, if the operator of the live broadcast camera is not permanently stationed at the heliport, the helicopter pilot cannot take off from the heliport until the operator of the live broadcast camera is on board. This causes a problem of loss of responsiveness in live video broadcasting in an emergency.

[0009] Additionally, the following problems also existed in systems that remotely operate relay cameras, such as video transmission systems for unmanned helicopters and remotely controlled construction machinery.

[0010] For example, there are multiple subjects to be filmed at a shooting site, such as a fire or flood, and the number, location, and condition of the subjects may change from moment to moment. In this case, with only a single live broadcast image, the operator of the live broadcast camera at the ground facility cannot instantly and accurately point the live broadcast camera at the subject to the same extent as if he or she were on board a helicopter and operating the live broadcast camera while judging the surrounding situation.

[0011] Furthermore, when a live camera operator at a ground facility watches a live image from a helicopter, he or she does not feel the reality of actually being on board the helicopter and operating the live camera, which has led to the problem that communication between the live camera operator and the helicopter pilot cannot proceed smoothly.

[0012] The present invention has been made in consideration of these problems, and its object is to provide a relay camera remote control system and method that enables a relay camera operator to remotely control the relay camera instantly and accurately without having to board a helicopter. [Means for solving the problem]

[0013] One aspect of the present invention is a first facility including an operating device for operating a first device, a second device for acquiring an image of the surroundings of a subject, a first encoder for encoding the image acquired by the first device to generate a first signal, a second encoder for encoding the image acquired by the second device to generate a second signal, a device for combining the first signal and the second signal to generate a third signal, and a device for transmitting the third signal, a device for receiving the third signal, a device for dividing the third signal into a first signal and a second signal, and a device for dividing the divided signals into a first signal and a second signal. the first decoder decoding the signal to generate an image of the subject; a second decoder decoding the second signal of the separated signals to generate an image of the subject's surroundings; an output device displaying the image of the subject and the image of the subject's surroundings; and second equipment including a device for generating an operation signal for operating the first device in accordance with an instruction input to an input device by an operator viewing the image displayed on the output device, and a device for transmitting the operation signal to the first equipment, wherein the operation signal is received by the first equipment to operate the operation device.

[0014] Another aspect of the present invention includes the steps of operating a device in a first facility, acquiring a video of the surroundings of a subject, encoding the video of the subject to generate a first signal, encoding the video of the surroundings of the subject to generate a second signal, combining the first signal and the second signal to generate a third signal, transmitting the third signal, receiving the third signal in the second facility, dividing the third signal into a first signal and a second signal, decoding the first signal of the divided signals to generate a video of the subject, decoding the second signal of the divided signals to generate a video of the subject, displaying the video of the subject and the video of the subject's surroundings, generating an operation signal to operate the device according to instructions input by an operator viewing the displayed image, transmitting the operation signal to the first facility, and receiving the operation signal in the first facility and operating the device according to the operation signal.

[0015] With this configuration, images that cannot be captured by the relay camera alone can be transmitted from the helicopter's surrounding camera to ground equipment, and control signals for the surrounding camera can be transmitted from the ground equipment to the helicopter, making it possible to remotely control the relay camera in an instant and accurate manner. Effect of the Invention

[0016] According to the present invention, the steps in the first facility include operating a device, acquiring video of the subject's surroundings, encoding the video of the subject to generate a first signal, encoding the video of the subject's surroundings to generate a second signal, combining the first signal and the second signal to generate a third signal, and transmitting the third signal, and in the second facility include receiving the third signal, dividing the third signal into a first signal and a second signal, decoding the first signal of the divided signals to generate a video of the subject, decoding the second signal of the divided signals to generate a video of the subject's surroundings, displaying the video of the subject and the video of the subject's surroundings, generating an operation signal for operating the device in accordance with instructions input by an operator viewing the displayed video, transmitting the operation signal to the first facility, and receiving the operation signal at the first facility and operating the device in accordance with the operation signal, so that it is possible for the operator of the relay camera to acquire relay video without boarding a helicopter.

[0017] In addition, since the operator of the live broadcast camera does not board the helicopter, the total weight of the equipment mounted on the helicopter can be reduced and the available space inside the helicopter can be increased.

[0018] Furthermore, communication between ground equipment operators and helicopter pilots will be smoother, and even if the number of subjects to be captured at the imaging site increases, the number of subjects can be quickly responded to and captured. [Brief description of the drawings]

[0019] [Figure 1] 1 is an overall diagram of a helicopter television transmission system according to one embodiment of the present invention; [Diagram 2] 1 is a system diagram of an on-board equipment in a helicopter television transmission system according to one embodiment of the present invention. [Diagram 3] 1 is a system diagram of a ground facility in a helicopter television transmission system according to one embodiment of the present invention. [Figure 4]FIG. 2 is a functional block diagram of an on-board equipment in a helicopter television transmission system according to one embodiment of the present invention. [Diagram 5] FIG. 2 is a functional block diagram of a ground facility in a helicopter television transmission system according to one embodiment of the present invention. [Figure 6] 4 is a flowchart of a process in a ground facility of a helicopter television transmission system according to one embodiment of the present invention. [Figure 7] 4 is a flowchart of a process in an on-board facility of a helicopter television transmission system according to one embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0020] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings, in which like reference numerals represent like elements.

[0021] 1 is an overall view of a helicopter television transmission system according to an embodiment of the present invention. The exemplary helicopter television transmission system of the present invention includes a helicopter 200 equipped with on-board equipment, a relay camera 205 included in the on-board equipment and capturing an object at a shooting site, a surroundings capturing camera 210 included in the on-board equipment and capturing an image of the surroundings of the helicopter 200, a ground equipment 301 that receives surroundings images from the helicopter 200 and controls the relay camera 205 to receive the relayed images from the helicopter 200, an image receiving device 303 included in the ground equipment 301 and receives the relayed images from the helicopter 200, an operation console 310 included in the ground equipment 301 and controls the relay camera 205, and a facility 100 to which the relayed images from the helicopter 200 are transmitted from the ground equipment 301.

[0022] In Fig. 1, a facility 100 is connected to ground equipment 301 via a communication line. The facility 100 is actually requesting live video. The facility 100 may be, for example, a facility of an administrative agency such as the police, fire department, meteorological department, maritime security department, general affairs department, land, infrastructure, transport and defense department, or a broadcasting station of a business entity that broadcasts television. The communication line shown in Fig. 1 may be a transmission path used for wired communication or wireless communication.

[0023] 1, one each of relay camera 205 and surroundings shooting camera 210 is shown, but the number of relay camera 205 and the number of surroundings shooting cameras 210 may be more than one. Furthermore, one each of video receiving device 303 and operation console 310 is shown, but the number of video receiving devices 303 and the number of operation consoles 310 may be more than one. One each of facility 100 and communication line is shown, but the number of facilities 100 and the number of communication lines may be more than one. Detailed configurations of relay camera 205, surroundings shooting camera 210, video receiving device 303, and operation console 310 will be described in detail with reference to FIGS. 2 and 3.

[0024] 2 is a system diagram of on-board equipment 201 in a helicopter television transmission system according to one embodiment of the present invention. On-board equipment 201 installed on helicopter 200 includes surroundings photographing camera 210 that photographs the surroundings of helicopter 200, and control signal antenna 204 that receives radio waves from ground equipment 301 and converts them into control signals. On-board equipment 201 also includes control signal receiving device 203 that is connected to control signal receiving antenna 204 via line 223 and receives control signals, and control device 202 that is connected to control signal receiving device 203 via line 222 and controls camera operation device 206 via line 221 in accordance with the control signals. The on-board facility 201 also includes a relay camera 205 that captures an image of a subject to be relayed, a camera operation device 206 that is connected to the relay camera 205 via line 225 and that operates the relay camera 205, and a signal processing device 207 that is connected to a surroundings capturing camera 210 via line 229 and to the camera operation device 206 via line 226 and that combines the surrounding image captured by the surroundings capturing camera 210 and the relay image captured by the relay camera 205. The on-board facility 201 also includes a video transmission device 208 that is connected to the signal processing device 207 via line 227 and that transmits the surrounding image and the relay image combined by the signal processing device 207 to the ground facility 301 as a video signal. The on-board equipment 201 also includes a video antenna 209 that is connected to a video transmitting device 208 via a line 228 and converts video and audio signals into radio waves and transmits them, and a photography position display device 211 that is connected to a signal processing device 207 via a line 230 and displays the photography position to a passenger on the helicopter 200. The control device 202 is further connected to the signal processing device 207 via a line 224 and also controls the signal processing device 207.

[0025] Here, the video signal may include not only the surrounding video and the broadcast video, but also the surrounding video alone or the broadcast video alone. The audio signal is an audio signal for broadcast, such as the voice of a passenger on the helicopter 200.

[0026] The control device 202 may be any control device that includes, for example, a CPU (Central Processing Unit), a main memory device, etc., and is configured to control the camera operation device 206 and the signal processing device 207 in accordance with a control signal.

[0027] The control signal receiving device 203 may be, for example, a VHF (Very High Frequency) radio. The control signal receiving device 203 may be any device that is configured to receive a control signal from the ground facility 301.

[0028] The control signal antenna 204 may be any antenna device configured to receive radio waves from the ground equipment 301 and convert the received radio waves into a control signal.

[0029] The relay camera 205 may be, for example, a broadcast camera, a high-sensitivity HD (High Definition) camera, an ultra-high-sensitivity HD camera, or any other imaging device configured to capture an image of a subject. In one embodiment, the relay camera 205 may be included in a helicopter camera vibration isolation device. In this specification, the relay camera 205 is regarded as the same as a part of the helicopter camera vibration isolation device having a shooting function.

[0030] The camera operation device 206 may be any device configured to change the orientation, zoom ratio, etc. of the broadcast camera 205. In one embodiment, the camera operation device 206 may be included in a helicopter camera vibration isolation device. In this specification, the camera operation device 206 is regarded as the same as a part that controls a part having a shooting function of the helicopter camera vibration isolation device.

[0031] The signal processing device 207 includes an encoder, and may include two or more types of encoders. For example, the encoder may include an encoder for a live video and an encoder for a surrounding video. For example, the encoder for a live video may be an encoder for H.264 / AVC (Advanced Video Coding), and the encoder for a surrounding video may be an encoder for H.265 / HEVC (High Efficiency Video Coding) having a higher compression rate than the encoder for a live video. The signal processing device 207 may be any device configured to be capable of encoding the live video and encoding the surrounding video. The signal processing device 207 may include an MTX (Matrix Switcher) that selects a video.

[0032] The signal processing device 207, the video transmission device 208, and the video antenna 209 may be referred to as a single system, called an FPU (Field Pickup Unit; a radio station for broadcasting business). The signal processing device 207, the video transmission device 208, and the video antenna 209 can not only transmit a combination of surrounding video and relay video, but also transmit only surrounding video or only relay video in some cases.

[0033] The video transmission device 208 may be, for example, a super high frequency (SHF) radio. The video transmission device 208 may be any device that is configured to transmit relayed video to the ground facility 301.

[0034] The video antenna 209 may include a PA (Power Amplifier). The video antenna 209 may be any antenna device configured to convert the relayed video into radio waves and transmit the converted radio waves to the ground facility 301.

[0035] The surroundings photographing camera 210 is, for example, a 360-degree camera, and may be any imaging device configured to be able to photograph the surroundings of the helicopter 200 in all 360-degree directions.

[0036] The shooting position display device 211 can display the shooting range of the live video and the address of the center of the shooting range on an electronic map for passengers of the helicopter 200, such as the pilot and co-pilot of the helicopter 200, based on data from the signal processing device 207. The shooting position display device 211 can be, for example, an electronic computer such as a tablet terminal or a mobile computer. Furthermore, the shooting position display device 211 can enable the passengers of the helicopter 200 to monitor and easily control the helicopter television transmission system. The weight of the shooting position display device 211 can be, for example, in the range of 250 g to 350 g. The shooting position display device 211 can include a Wi-Fi wireless device.

[0037] The lines 225, 226, and 229 may be, for example, SDI (Serial Digital Interface) cables. The lines 227 and 228 may be, for example, lines carrying SHF. The line 222 may be, for example, a line capable of bearer communication, such as an RS-232C (Recommended Standard 232 version C) cable. The line 222 may be a line for half-duplex communication or intermittent communication.

[0038] 3 is a system diagram of the ground equipment 301 in the helicopter television transmission system according to one embodiment of the present invention. The ground equipment 301, which communicates with the on-board equipment 201, includes a video antenna 302 that receives radio waves from the on-board equipment 201 and converts them into video and audio signals, and a video receiving device 303 that is connected to the video antenna 302 via a line 321 and receives the video and audio signals. The ground equipment 301 also includes a signal processing device 304 that is connected to the video receiving device 303 via a line 322 and separates the video signal into a relayed video and a surrounding video, and a video transmitting device 305 that is connected to the signal processing device 304 via a line 323 and transmits the relayed video to the facility 100. The ground equipment 301 also includes an operation console 310 that is connected to the signal processing device 304 via a line 326, receives the surrounding video, and operates the camera operation device 206 and the signal processing device 207 of the on-board equipment 201, and a control device 309 that is connected to the operation console 310 via a line 329 and generates a control signal. The ground equipment 301 also includes a control signal transmitting device 308 connected to the control device 309 via a line 328 and transmitting a control signal to the on-board equipment 201, a control signal antenna 307 connected to the control signal transmitting device 308 via a line 327 and converting the control signal into radio waves and transmitting the same, and a rotating platform device 306 connected to the control device 309 via a line 324 and changing the orientation of the video antenna 302. The control device 309 is further connected to the signal processing device 304 via a line 325 and also controls the signal processing device 304.

[0039] The video antenna 302 may be any antenna device configured to receive radio waves from the on-board equipment 201 and convert the received radio waves into video and audio signals.

[0040] The video receiving device 303 may be, for example, an SHF radio. The video receiving device 303 may be any receiving device configured to receive video and audio signals from the on-board equipment 201.

[0041] The signal processing device 304 includes a decoder, and may include two or more types of decoders. For example, the decoder may include a decoder for a broadcast video and a decoder for a surrounding video. For example, the decoder for the broadcast video may be a decoder for H.264 / AVC (Advanced Video Coding), and the decoder for the surrounding video may be a decoder for H.265 / HEVC (High Efficiency Video Coding). The decoder of the signal processing device 304 may be any decoder configured to be able to decode the broadcast video and the surrounding video encoded by the signal processing device 207. The signal processing device 304 may include an MTX (Matrix Switcher) that selects a video.

[0042] The video antenna 302, the video receiving device 303, and the signal processing device 304 may be referred to as a single system as an FPU. The video antenna 302, the video receiving device 303, and the signal processing device 304 may receive not only a combination of surrounding video and relayed video as a video signal, but also, in some cases, only surrounding video or only relayed video.

[0043] The video transmission device 305 may be any device configured to be capable of transmitting video and audio signals via a network.

[0044] The rotating platform device 306 may be any device configured to change the orientation of the video antenna 302. In one embodiment, the rotating platform device 306 may include the video antenna 302. In this specification, the video antenna 302 is considered to be the same as the portion of the rotating platform device 306 having an antenna function.

[0045] The control signal antenna 307 may be any antenna device configured to convert the control signal into radio waves and transmit the radio waves to the on-board equipment 201 .

[0046] The control signal transmitting device 308 may be, for example, a VHF radio. The video transmitting device 208 may be any device that is configured to transmit relayed video to the ground facility 301.

[0047] The control device 309 may be any control device that includes, for example, a CPU, a main memory device, etc., and is configured to generate control signals for controlling the camera control device 206, the signal processing device 207, the rotating platform device 306, and the signal processing device 304 based on instructions from the operation console 310.

[0048] The operation console 310 includes, for example, a CPU, a main memory device, an input device, an output device, and a human-machine interface, etc. The operation console 310 may be any device configured to be able to instruct the control device 309 to control the camera operation device 206, the signal processing device 207, the rotating platform device 306, and the signal processing device 304.

[0049] The lines 322, 323, and 326 may be, for example, SDI cables. The line 321 may be, for example, a line carrying SHF. The line 328 may be, for example, an RS-232C cable or other line capable of bearer communication. The line 328 may be a line for half-duplex communication or intermittent communication.

[0050] With this configuration, the relay camera can be remotely controlled in an instant and accurate manner.

[0051] 4 is a functional block diagram of the on-board equipment 201 in the helicopter television transmission system according to one embodiment of the present invention. The on-board equipment 201 includes, as functional blocks, a control signal receiving unit 401 included in the control signal receiving device 203 for receiving a control signal transmitted from the ground equipment 301, and a control signal processing unit 402 included in the control device 202 for identifying the control signal transmitted from the ground equipment 301. The on-board equipment 201 also includes a surrounding image acquiring unit 403 included in the surroundings capturing camera 210 for acquiring surrounding images, a signal processing unit 404 included in the signal processing device 207 for generating a video signal combining the surrounding image and the relayed image by different encoding processes, and a video transmitting unit 405 included in the video transmitting device 208 for transmitting the video signal. The on-board equipment 201 also includes a relay video acquisition unit 406 that is included in the relay camera 205 and acquires relay video, a camera operation unit 407 that is included in the camera operation device 206 and operates the relay camera 205, and a simplified control / display unit 408 that is included in the shooting position display device 211 and simply controls the relay camera 205 and displays the shooting position.

[0052] The functional blocks of the on-board equipment 201 will be described in detail with reference to FIG.

[0053] Fig. 5 is a functional block diagram of the ground equipment 301 in the helicopter television transmission system according to one embodiment of the present invention. The ground equipment 301 includes, as functional blocks, a human-machine interface unit 501 included in the control console 310, which provides the operator of the control console 310 with a human-machine interface for the control console 310, and a control signal generation unit 502 included in the control device 309, which generates a control signal. The ground equipment 301 also includes a control signal transmission unit 503 included in the control signal transmission device 308, which transmits a control signal to the on-board equipment 201, a video reception unit 504 included in the video reception device 303, which receives a video signal from the on-board equipment 201, and a signal processing unit 505 included in the signal processing device 304, which separates the video signal into an ambient video and a relay video by different decoding processes. Details of each functional block of the ground equipment 301 will be described with reference to Fig. 6.

[0054] 6 is a flowchart of a process in the ground equipment 301 of the helicopter television transmission system according to one embodiment of the present invention. In the process described below, the order of steps is an example for illustration, and the present invention is not limited to the order of steps described. As an example, when the operation console 310 is operated, the process of the present invention starts.

[0055] In step S601, when an instruction to start acquiring a surrounding image is input to the human-machine interface unit 501, a signal for starting acquisition of a surrounding image by the surroundings photographing camera 210 of the on-board facility 201 is generated by the control signal generating unit 502 and transmitted to the control signal transmitting unit 503. The generated signal is transmitted by the control signal transmitting unit 503 to the on-board facility 201 via the control signal antenna 307. Then, acquisition of the surrounding image is started in the on-board facility 201, and the surrounding image is transmitted to the ground facility 301.

[0056] In step S602, the surrounding image from the on-board equipment 201 is received by the image receiving unit 504 via the image antenna 302, and the surrounding image is transmitted by the signal processing unit 505 to the operation console 310. Then, the surrounding image is displayed on the operation console 310.

[0057] In step S603, when an instruction to start acquiring relayed video is input to the human-machine interface unit 501, a signal for starting acquisition of relayed video by the relay camera 205 of the on-board facility 201 is generated by the control signal generating unit 502 and transmitted to the control signal transmitting unit 503. The generated signal is transmitted by the control signal transmitting unit 503 to the on-board facility 201 via the control signal antenna 307. Then, the on-board facility 201 starts photographing the subject to be relayed, and a video signal combining the relayed video including the photographed subject and the surrounding video that has already started to be acquired is transmitted to the ground facility 301.

[0058] In step S604, the video signal from the on-board equipment 201 is received by the video receiving unit 504 via the video antenna 302, and the video signal is separated by the signal processing unit 505 into a live video and a surrounding video through different decoding processes, and the separated live video and surrounding video are transmitted to the operation console 310. Then, the live video and the surrounding video are displayed on the operation console 310.

[0059] In step S605, when an instruction to operate the relay camera 205, such as changing the orientation of the relay camera 205 or changing the zoom ratio of the relay camera 205, is input to the human-machine interface unit 501, an operation signal for operating the relay camera 205 of the on-board facility 201 is generated by the control signal generation unit 502 and transmitted to the control signal transmission unit 503. The generated operation signal is transmitted by the control signal transmission unit 503 to the on-board facility 201 via the control signal antenna 307. Then, the relay camera 205 or the camera operation device 206 is operated in the on-board facility 201 according to the operation signal.

[0060] In step S606, it is determined whether an instruction to end the acquisition of the relayed video has been input to the human-machine interface unit 501. If it is determined that an instruction to end the acquisition of the relayed video has been input, a signal for ending the acquisition of the relayed video by the relay camera 205 of the on-board facility 201 and the surrounding video by the surroundings shooting camera 210 is generated by the control signal generating unit 502 and transmitted to the control signal transmitting unit 503. The generated signal is transmitted by the control signal transmitting unit 503 to the on-board facility 201 via the control signal antenna 307. Then, the acquisition of the relayed video and the surrounding video in the on-board facility 201 is terminated.

[0061] If it is determined in step S606 that an instruction to end the acquisition of the live video has not been input to the human-machine interface unit 501, the process returns to step S605.

[0062] By such processing, the operator of the operation console 310 can operate the relay camera 205 to obtain relay video while watching the surrounding video.

[0063] 7 is a flowchart of the process in the on-board equipment 201 of the helicopter television transmission system according to one embodiment of the present invention. In the process described below, the order of steps is one example for illustration, and the present invention is not limited to the order of steps described. As an example, the process of the present invention starts when the operation console 310 is operated and a signal for starting the acquisition of surrounding images by the surroundings capturing camera 210 of the on-board equipment 201 is transmitted from the ground equipment 301.

[0064] In step S701, a signal for starting acquisition of a surrounding image by the surroundings imaging camera 210 is received by the control signal receiving unit 401 via the control signal antenna 204 and transmitted to the control signal processing unit 402. When the control signal processing unit 402 identifies that the received signal is a signal for starting acquisition of a surrounding image, the control signal processing unit 402 instructs the surrounding image acquisition unit 403 to acquire the surrounding image. The surrounding image acquisition unit 403 starts acquiring the surrounding image.

[0065] In step S702, the surrounding image acquired by the surrounding image acquisition unit 403 is transmitted to the signal processing unit 404. A video signal including the surrounding image is generated by the signal processing unit 404, and the video signal is transmitted by the video transmission unit 405 to the ground equipment 301 via the video antenna 209. Next, the ground equipment 301 receives the video signal via the video antenna 302. The signal processing device 304 generates a surrounding image based on the received video signal. The surrounding image is then displayed on the operation console 310. When the operator checks the surrounding image and wishes to view the relayed image, the operator operates the operation console 310, and a signal for starting acquisition of the relayed image by the relay camera 205 is transmitted from the control signal antenna 307.

[0066] In step S703, a signal for starting acquisition of relay video by relay camera 205 is received by control signal receiving unit 401 via control signal antenna 204 and transmitted to control signal processing unit 402. When control signal processing unit 402 identifies that the received signal is a signal for starting acquisition of relay video, control signal processing unit 402 instructs relay video acquisition unit 406 to acquire relay video. Relay video acquisition unit 406 starts acquiring relay video including the photographed subject.

[0067] In step S704, the relay video acquired by relay video acquisition unit 406 is transmitted to signal processing unit 404. A video signal combining the relay video with the surrounding video that has already started to be acquired is generated by signal processing unit 404, and the video signal is transmitted by video transmission unit 405 via video antenna 209 to ground equipment 301. The ground equipment 301 receives the video signal combining the relay video and the surrounding video. The relay video and the surrounding video are displayed on operation console 310. Operation console 310 is operated, and an operation signal for operating relay camera 205 is transmitted.

[0068] In step S705, an operation signal for operating relay camera 205, such as changing the orientation of relay camera 205 or changing the zoom ratio of relay camera 205, is received by control signal receiving unit 401 via control signal antenna 204 and transmitted to control signal processing unit 402. When control signal processing unit 402 identifies that the received signal is an operation signal for operating relay camera 205, control signal processing unit 402 instructs camera operation unit 407 to operate relay camera 205. Camera operation unit 407 operates relay camera 205 based on the operation signal.

[0069] In step S706, control signal processing unit 402 determines whether the control signal received by control signal receiving unit 401 via control signal antenna 204 is a signal for instructing the end of acquisition of relayed video. If it is determined that the control signal is a signal for instructing the end of acquisition of relayed video, control signal processing unit 402 generates a signal for relayed video acquisition unit 406 to end acquisition of relayed video by relay camera 205 and a signal for surrounding video acquisition unit 403 to end acquisition of surrounding video by surrounding shooting camera 210, and transmits these to relayed video acquisition unit 406 and surrounding video acquisition unit 403, respectively. Relayed video acquisition unit 406 ends acquisition of relayed video, and surrounding video acquisition unit 403 ends acquisition of surrounding video.

[0070] If it is determined in step S706 that the control signal received by the control signal receiving unit 401 via the control signal antenna 204 is not a signal for instructing the end of acquisition of the relayed video, the process returns to step S705.

[0071] By performing such processing, it is possible to obtain both the live video and the surrounding video while operating the live camera 205.

[0072] In this specification, the reason why the device related to the audio signal is not described is for the purpose of making the description easier to understand. A person skilled in the art would understand that, as one of the devices related to the audio signal, for example, if a sound collecting microphone is attached to the outside of the helicopter 200, it is possible to generate an audio signal and transmit it to the ground equipment 301.

[0073] In the present specification, the helicopter television transmission system of the present invention has been described using an operation signal for relay camera 205. However, the operation signal may include an operation signal for surroundings photographing camera 210 in addition to the operation signal for relay camera 205. In this case, a camera with variable zoom, resolution, etc. may be used as surroundings photographing camera 210. [Industrial Applicability]

[0074] The present invention can be widely used by government agencies such as police, fire departments, meteorological departments, coast guard, general affairs departments, land infrastructure transport departments, and defense departments, as well as television broadcasting companies. [Explanation of symbols]

[0075] 200 Helicopter 202 Control device 203 Control signal receiving device 204 Control signal antenna 205 Broadcast Camera 206 Camera Control Device 207 Signal Processing Device 208 Video transmission device 209 Video Antenna 210 Surroundings camera 211 Shooting position display device 221~230 lines 302 Video Antenna 303 Video Receiving Device 304 Signal Processing Device 305 Video Transmission Equipment 306 Rotating platform device 307 Control Signal Antenna 308 Control signal transmitter 309 Control Device 310 Control console 321~329 lines 401 Control signal receiving unit 402 Control signal processing unit 403 Surrounding image acquisition unit 404 Signal Processing Unit 405 Video transmission unit 406 Live Video Acquisition Unit 407 Camera Control Unit 408 Simple control and display unit 501 Human Machine Interface Division 502 Control signal generating unit 503 Control signal transmission unit 504 Video receiving unit 505 Signal Processing Unit

Claims

1. A remote control system for controlling a first device that transmits an image of a subject, comprising: an operating device for operating the first device; A second device that captures an image of the surroundings of the subject; a first encoder for encoding an image captured by the first device to generate a first signal; a second encoder for encoding the video captured by the second device to generate a second signal; a device for combining the first signal and the second signal to generate a third signal; a device for transmitting the third signal; A first facility comprising: a device for receiving the third signal; a device for splitting the third signal into the first signal and the second signal; a first decoder for decoding the first signal out of the divided signals to generate an image of the subject; a second decoder for decoding the second signal from among the separated signals to generate an image of the surroundings of the subject; an output device that displays an image of the subject and an image of the surroundings of the subject; a device for generating an operation signal for operating the first device according to an instruction input to an input device by an operator viewing the image displayed on the output device; A device for transmitting the operation signal to the first facility; A second facility comprising: wherein the operation signal is received by the first facility and causes the operation device to operate.

2. 2. The remote control system according to claim 1, wherein the second encoder has a higher compression ratio than the first encoder.

3. 2. The remote control system according to claim 1, wherein the image of the subject is transmitted from the second facility to a third facility.

4. The first facility includes: A device for monitoring the remote control system; A device for controlling the remote control system; The remote control system according to claim 1, further comprising:

5. 10. The remote control system of claim 1, wherein the remote control system is included in a helicopter television transmission system.

6. 1. A method for remotely controlling a device that transmits an image of a subject, comprising: In the first facility, operating the device; acquiring an image of the surroundings of the subject; encoding an image of the object to generate a first signal; encoding an image of an area surrounding the subject to generate a second signal; combining the first signal and the second signal to generate a third signal; transmitting the third signal; In the second facility, receiving the third signal; splitting the third signal into the first signal and the second signal; decoding the first signal of the separated signals to generate an image of the subject; decoding the second signal from the separated signals to generate an image of the surroundings of the subject; displaying an image of the subject and an image of the surroundings of the subject; generating an operation signal for operating the device according to an instruction input by an operator viewing the projected image; transmitting the operation signal to the first equipment; receiving the operation signal in the first facility and operating the device according to the operation signal; 23. A method comprising:

7. 7. The method of claim 6, wherein generating the second signal includes encoding video of the subject's surroundings with a higher compression ratio than generating the first signal.

8. 7. The method of claim 6, further comprising transmitting the image of the object from the second facility to a third facility.

9. In the first facility, monitoring the first facility and the second facility; controlling the first equipment and the second equipment; The method of claim 6 further comprising:

10. 7. The method of claim 6, wherein said first facility and said second facility are included in a helicopter television transmission system.

Images