Information processing device, imaging device, and information processing method

Abstract

This information processing device is provided with a transmission unit that, when one or more imaging devices among two or more imaging devices is designated as an imaging device related to prescribed processing, transmits control information, which is for preferentially allocating wireless resources to the imaging device related to the designation or a wireless communication terminal connected to the imaging device related to the designation, to a network device that performs processing relating to the allocation of the wireless resources. The transmission unit transmits multiple pieces of control information to the network device on a control-flow-by-control-flow basis.

Description

Information processing device, imaging device, and information processing method

[0001] The present disclosure relates to an information processing device, an imaging device, and an information processing method.

[0002] Demand for wireless transmission of captured data has been increasing. For example, in recent years, there has been an increasing demand for transmitting images captured by an imaging device (hereinafter also referred to as a camera) using a cellular network such as 5G.

[0003] International Publication No. 2021 / 193189

[0004] In order for an information processing device (e.g., a device for broadcasting / distribution) to stably process video captured by a camera, it is necessary for the camera to stably transmit captured data wirelessly. However, with conventional technology, it is difficult to stably transmit captured data wirelessly. For example, when multiple cameras are located in one cell formed by a base station, there is a possibility that stable wireless transmission will not be possible due to a lack of wireless resources.

[0005] Therefore, the present disclosure proposes an information processing device, an imaging device, and an information processing method that can realize stable wireless transmission of captured data.

[0006] It should be noted that the above problem or object is merely one of multiple problems or objects that can be solved or achieved by multiple embodiments disclosed in this specification.

[0007] In order to solve the above problem, an information processing device of one embodiment according to the present disclosure includes a transmission unit that, when designating one or more of two or more imaging devices as imaging devices related to a predetermined process, transmits control information for preferentially allocating wireless resources to the designated imaging device or a wireless communication terminal connected to the designated imaging device to a network device that performs processing related to the allocation of the wireless resources, and the transmission unit transmits multiple pieces of control information to the network device on a control flow basis.

[0008] 10 is a diagram for explaining a problem of the present embodiment. FIG. ... tally signal. FIG. 10 is a diagram for explaining an operation of the imaging system of the present embodiment. FIG. 10 is a diagram for explaining a configuration of the imaging system according to the present embodiment. FIG. 10 is a diagram for explaining an example configuration of an information processing device according to an embodiment of the present disclosure. FIG. 10 is a diagram for explaining a configuration of a management device according to the present embodiment. FIG. 10 is a diagram for explaining a configuration of a base station according to the present embodiment. FIG. 10 is a diagram for explaining a configuration of a terminal device according to the present embodiment. FIG. 10 is a diagram for explaining an example configuration of an imaging device according to an embodiment of the present disclosure. FIG. 10 is a diagram for explaining an example configuration of a 5G network architecture. FIG. 10 is a diagram for explaining an example RAN architecture applied to the imaging system. FIG. 10 is a diagram for explaining another example RAN architecture applied to the imaging system. FIG. 10 is a diagram for explaining a configuration of an imaging system according to Configuration Example 1. FIG. 10 is a diagram for explaining a configuration of an imaging system according to Configuration Example 2. FIG. 10 is a diagram for explaining a configuration of an imaging system according to Configuration Example 3. FIG. 10 is a diagram for explaining a configuration of an imaging system according to Configuration Example 4. FIG. 10 is a diagram for explaining an operation of the imaging system according to the present embodiment. FIG. 10 is a diagram for explaining an example of association information that associates first identification information and second identification information. FIG. 10 is a diagram for explaining allocation control of radio resources. FIG. 10 is a sequence diagram showing an example of camera priority setting processing. FIG. 10 is a sequence diagram showing an example of FIG. 10 is a flowchart showing an example of a switching process when a camera is selected. FIG. 11 is a flowchart showing an example of a cancellation process when a camera is selected. FIG. 12 is a sequence diagram showing another example of a camera priority setting process. FIG. 13 is a sequence diagram showing another example of a camera priority setting process. FIG. 14 is a sequence diagram showing another example of a camera priority setting process. FIG. 15 is a hardware configuration diagram showing an example of a computer that realizes the functions of the photography system.

[0009] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In the following embodiments, the same components are designated by the same reference numerals, and redundant description will be omitted.

[0010] In addition, in this specification and drawings, multiple components having substantially the same functional configuration may be distinguished by adding different numbers to the same reference numeral. For example, multiple components having substantially the same functional configuration may be distinguished by adding different numbers to the same reference numerals to the terminal device 40 as needed. １ , 40 ２ , and 40 ３ However, when there is no need to particularly distinguish between multiple components having substantially the same functional configuration, only the same reference numerals are used. For example, the terminal device 40 １ , 40 ２ , and 40 ３ When there is no need to particularly distinguish between them, they will be simply referred to as terminal devices 40.

[0011] One or more embodiments (including examples and variations) described below can be implemented independently. However, at least a portion of the embodiments described below may be implemented in appropriate combination with at least a portion of another embodiment. These embodiments may include novel features that are different from one another. Therefore, these embodiments may contribute to solving different purposes or problems and may produce different effects.

[0012] <<1. Overview>> First, an overview of this embodiment will be described.

[0013] <1-1. Issues> There is a growing demand for wireless transmission of captured data. For example, in recent years, in order to broadcast / distribute videos captured from various angles, there has been a growing demand for wireless transmission of videos captured by multiple imaging devices (hereinafter also referred to as cameras) using a mobile network (e.g., a cellular network such as 5G).

[0014] The camera wirelessly transmits captured data to the broadcasting / distribution equipment using its built-in wireless communication function or via a wireless communication terminal connected directly or indirectly to the camera. The broadcasting / distribution equipment is, for example, an information processing device for broadcasting / distribution, such as a decoder, a video editing device, or a switcher.

[0015] In order for an information processing device to stably process images captured by a camera, it is necessary for the camera to stably transmit captured data (e.g., video data) wirelessly to the information processing device. However, with conventional technology, it is difficult to stably transmit captured data wirelessly.

[0016] For example, in a cellular network, transmission rate control (link adaptation) of the wireless section is adaptively applied according to the quality of wireless communication of the camera (or the wireless communication terminal connected to the camera). This maintains a constant error rate in the wireless section. However, the amount of traffic related to the transmission of captured data is determined by the resolution or frame rate of the video. Therefore, if a low transmission rate is set in link adaptation, the use of wireless resources per camera increases significantly. In a cell where such a camera is present, a shortage of wireless resources (congestion) occurs. This prevents the camera from stably transmitting captured data wirelessly.

[0017] Furthermore, cellular communications are divided into public networks provided for general users and private networks primarily used for business-to-business (B2B) applications. Private networks provide dedicated wireless resources in specific locations. Therefore, when a private network is used for wireless transmission of image data, it is expected that stable wireless transmission of the image data will be achieved in most cases.

[0018] However, the communication area of ​​a private network is limited to a specific location. Therefore, when a private network is used for wireless transmission of captured image data, the captured image area is limited. Furthermore, even if there are sufficient wireless resources, when a camera (or a wireless communication terminal connected to the camera) moves away from a base station, the network device (e.g., a base station / core network) needs to lower the communication rate (e.g., modulation level or error correction code coding rate) to ensure a certain transmission speed, resulting in an increase in wireless resource usage. Therefore, even if a private network is used for wireless transmission of captured image data, there is a possibility that a shortage of wireless resources may occur.

[0019] On the other hand, public networks provide a wide communication area for general users. Therefore, when a public network is used for wireless transmission of photographed data, a wide photographed area is ensured. However, in a public network, it is assumed that a network device must allocate wireless resources fairly to users. Therefore, in an environment with a large number of users or a high traffic volume, a shortage of wireless resources occurs. In this case, stable wireless transmission of photographed data cannot be achieved.

[0020] The above problem will be explained in more detail using the drawings. Figures 1 to 5 are diagrams for explaining the problem of this embodiment.

[0021] In the examples of FIGS. 1 to 3, multiple cameras are located in one cell of a cellular network. More specifically, two cameras are located in one cell formed by one base station (BS). One of the two cameras is a main broadcast camera that captures the video to be broadcast. The two cameras are each connected to a wireless communication terminal. Specifically, the main broadcast camera is connected to UE #1, and the other camera is connected to UE #2. The two cameras each transmit captured data via the wireless communication terminal (UE #1 or UE #2).

[0022] In the example of Figure 1, both cameras are located in areas of the cell with good wireless quality. Therefore, the wireless resources used by UE #1 and UE #2 are kept below a certain amount. Therefore, in the example of Figure 1, the wireless resources used by the entire cellular network are kept below the provided resource amount.

[0023] Here, as shown in Figure 2, assume that one of the two cameras (the camera connected to UE #2 in the example of Figure 2) moves to an area within the cell with poor wireless quality (for example, a cell edge). In this case, the wireless quality of UE #2 deteriorates, and the wireless resources used by UE #2 increase. In the example of Figure 2, the increase in the wireless resources used by UE #2 causes a shortage of wireless resources throughout the cellular network.

[0024] In the example of Fig. 2, it appears that the lack of radio resources does not affect UE #1. However, in reality, if there is a shortage of radio resources in the entire cellular network, a shortage of radio resources will occur not only in UE #2 but also in UE #1, as shown in Fig. 3. This will also affect the transmission of data captured by the main broadcast camera.

[0025] In other words, if there is a camera with poor wireless quality in a cell (or in a cellular network), it will affect the wireless transmission of data captured by other cameras. If there is a camera in that cell being used for broadcasting / distribution, this will cause distortion in the broadcast / distribution video.

[0026] Also, in the examples of Figures 4 and 5, three cameras are located in one cell formed by one base station (BS). One of the three cameras is a main broadcast camera that captures the video to be broadcast, and the other is a camera for adjusting the image quality of the camera video. Each of the three cameras is connected to a wireless communication terminal. Specifically, the main broadcast camera is connected to UE #1, the camera for image quality adjustment is connected to UE #2, and the remaining camera is connected to UE #3. Each of the three cameras transmits captured data via a wireless communication terminal (UE #1, UE #2, or UE #3).

[0027] In the example of Figure 4, all three cameras are located in areas of the cell with good wireless quality. Therefore, the wireless resources used by UE #1, UE #2, and UE #3 are kept below a certain amount. Therefore, in the example of Figure 4, the wireless resources used by the entire cellular network are kept below the provided resource amount.

[0028] Here, as shown in Figure 5, assume that one of the three cameras (the camera connected to UE #3 in the example of Figure 5) moves to an area in the cell with poor wireless quality (for example, a cell edge). In this case, the wireless quality of UE #3 deteriorates, and the wireless resources used by UE #3 increase. In the example of Figure 5, the increase in the wireless resources used by UE #3 causes a shortage of wireless resources in the entire cellular network.

[0029] Even if the wireless resources for UE #1 are secured preferentially, if there is a shortage of wireless resources in the entire cellular network, a shortage of wireless resources will occur not only for UE #3 but also for UE #2, which will affect the transmission of image data captured by the image quality adjustment camera.

[0030] In other words, if there is a camera with poor wireless quality in a cell (or in a cellular network), it will affect the wireless transmission of data captured by other cameras. If there is a camera in that cell being used for image quality adjustment, this will cause distortion in the broadcast / distributed video.

[0031] <1-2. Overview of Solution> Therefore, in this embodiment, the above-mentioned problems are solved as follows.

[0032] The imaging system of this embodiment is a system for broadcasting / distributing video, and includes a plurality of cameras directly or indirectly connected to a cellular network, and an information processing device that processes the video captured by the cameras.

[0033] An information processing device is, for example, a device that performs processing for broadcasting / distributing video captured by a camera. For example, the information processing device is a switcher that switches between videos from multiple cameras. The switcher is a device used by a switcher operator (hereinafter simply referred to as the operator) to switch between cameras involved in a predetermined process (for example, cameras that capture video to be broadcast / distributed).

[0034] The information processing device is also a camera selector that switches between images from multiple cameras. The camera selector is a device used by a video engineer (hereinafter simply referred to as an engineer) to switch between cameras involved in a predetermined process (for example, a camera that adjusts the image quality of a camera image (for example, white balance)). Below, an overview of the solution will be described assuming that the information processing device is a switcher or a camera selector, but the information processing device of this embodiment is not limited to a switcher or a camera selector. The information processing device may also be, for example, a selector that switches between images from cameras used for multi-viewer display in a studio.

[0035] 6 is a diagram illustrating a tally signal. The switcher transmits a tally signal to the camera in accordance with an operator's operation. The tally signal is a control signal transmitted from the switcher to the camera. For example, the tally signal is a control signal that includes information (first control information) for designating one or more of two or more cameras as cameras related to a predetermined process. Alternatively, the tally signal is a control signal that is assigned the role of the first control information. The switcher or camera selector uses the tally signal to designate, for example, one or more of two or more cameras as cameras related to a predetermined process (for example, cameras that capture video to be broadcast / distributed).

[0036] Cameras for broadcasting / streaming are sometimes equipped with indicator lights called tally lamps. Tally lamps are indicator lights that, for example, notify the subject or the like that the camera is being used for a specific process (e.g., filming for broadcasting / streaming). Tally lamps are also called tally lights, on-air lamps, or cue lights. The tally signal sent from the switcher to the camera includes, for example, information specifying whether the tally lamp should be turned on / off (off) and / or information about the color of the tally lamp. The camera controls the tally lamp (e.g., at least one of turning it on, off, and changing its color) based on the received tally signal.

[0037] In the example of FIG. 6 , three of the two or more cameras connected to the cellular network (cameras #1, #3, and #4 in FIG. 6 ) have their tally lamps illuminated in red, yellow, or green. The other cameras have their tally lamps unilluminated. The camera whose tally lamp is illuminated red (camera #1) is, for example, a camera that shoots video for broadcast. The camera whose tally lamp is illuminated yellow (camera #4) is, for example, a camera that shoots video for internet distribution. The camera whose tally lamp is illuminated green (camera #3) is, for example, a camera that shoots other video (e.g., video for editing). Note that the above example of tally lamp illumination is merely one example. The association between the on / off / color of the tally lamp and the role of the camera can be determined arbitrarily by the user or the system / device developer.

[0038] 7 is a diagram illustrating the operation of the imaging system of this embodiment. In addition to a switcher, a camera selector, and a camera, the imaging system of this embodiment includes a network device that provides functions for realizing a cellular network. The network device may be a base station (BS), a device that constitutes a core network (CN), or an entity called an application function (AF). The application function may be a network function of the core network, or a function outside the core network.

[0039] In the example of Fig. 7, the camera is indirectly connected to the cellular network via the wireless communication terminals (UE#1 / UE#2). However, if the camera has a wireless communication function, the camera may directly connect to the cellular network using the wireless communication function. Below, an overview of the operation of the imaging system of this embodiment will be described with reference to Fig. 7.

[0040] First, the switcher transmits a tally signal and tally information to a network device (step S1). The tally signal is, for example, a control signal including information (first control information) for designating one or more of two or more cameras as cameras related to a predetermined process. Alternatively, the tally signal is a control signal assigned the role of the first control information. Furthermore, the tally information is information (second control information) for preferentially allocating wireless resources to the designated camera (or a wireless communication terminal connected to the designated camera). The second control information may be transmitted to the network device as a tally signal together with the first control information, or may be transmitted to the network device separately from the tally signal.

[0041] Here, suppose that a camera connected to UE #1 and a camera connected to UE #2 are located in the same cell. The switcher then transmits a tally signal to the camera connected to UE #1 to turn its tally lamp red. In this case, the transmission priority of the video captured by the camera connected to UE #1 is higher than the transmission priority of the video captured by the camera connected to UE #2. Therefore, the switcher transmits control information (second control information) to the network device, including a request to preferentially allocate radio resources to UE #1.

[0042] The network device that receives the tally information (second control information) performs control (e.g., QoS (Quality of Service) control) to preferentially allocate radio resources to UE #1. For example, assume that the tally information (second control information) is transmitted from the switcher to the application function. At this time, the application function performs configuration on the core network / base station to preferentially allocate radio resources to UE #1. For example, assume that the core network is a 5G Core network (5GC). At this time, the application function may set a higher level 5QI (5G QoS Identifier) ​​for UE #1 than for UE #2 via the NEF (Network Exposure Function).

[0043] Based on the setting, the core network / base station performs priority control (step S2) to allocate radio resources preferentially to UE #1. For example, based on the setting, the core network / base station allocates radio resources to UE #1 with priority over UE #2. UE #1 transmits the captured data to the information processing device using the allocated radio resources. This allows UE #1 to stably transmit the captured data related to broadcast / distribution wirelessly. As a result, disturbances in the broadcast / distribution video are suppressed.

[0044] The network device may predict the throughput of UE #1 and / or UE #2 (step S3). This prediction may be performed by an application function. For example, at least one of the UE, the base station, and the core network periodically transmits information used for predicting the throughput to the application function. The application function uses this periodically transmitted information to predict the throughput. Furthermore, the prediction performed by the network device is not limited to throughput prediction. In addition to or instead of the throughput prediction, the network device may predict the communication status of UE #1 and / or UE #2.

[0045] The network device may transmit the throughput prediction result to the switcher (step S4). Then, the switcher may control the data rate of the video captured by the camera based on the throughput prediction result (step S5). For example, if the switcher determines that it is difficult to transmit video of a predetermined quality using the wireless resources allocated to UE #2, it requests the camera connected to UE #2 to reduce the video resolution and / or frame rate. The switcher may transmit this request via the cellular network.

[0046] The camera that receives the request reduces the video data rate (for example, resolution and / or frame rate) based on the request, allowing UE #2, which has been assigned a low priority, to stably transmit captured data wirelessly.

[0047] Next, the camera selector transmits camera information (e.g., information for adjusting the image quality of the camera image) to the network device (step S6). The camera information is, for example, a control signal including information for designating one or more of the two or more cameras as cameras related to a predetermined process. Alternatively, the camera information is information for preferentially allocating wireless resources to the designated camera (or a wireless communication terminal connected to the designated camera).

[0048] Here, suppose that the camera connected to UE #1 and the camera connected to UE #2 are located in the same cell. The camera selector then transmits a tally signal to the camera connected to UE #2 to turn its tally lamp green. In this case, the transmission priority of the video captured by the camera connected to UE #2 is lower than the transmission priority of the video captured by the camera connected to UE #1. Therefore, the camera selector transmits control information to the network device as tally information (second control information), which includes a request to allocate radio resources to UE #2 with priority after UE #1.

[0049] The network device that receives the camera information performs control (e.g., QoS control) to preferentially allocate radio resources to UE #2. For example, assume that tally information (second control information) is transmitted from the camera selector to the application function. At this time, the application function performs configuration on the core network / base station to preferentially allocate radio resources to UE #1. For example, assume that the core network is a 5G Core network (5GC). At this time, the application function may set a higher level 5QI (5G QoS Identifier) ​​for UE #1 than for UE #2 via the NEF (Network Exposure Function).

[0050] Based on the setting, the core network / base station performs priority control (step S7) to allocate radio resources preferentially to UE #2. For example, based on the setting, the core network / base station allocates radio resources to UE #2, prioritizing UE #2 after UE #1. UE #2 uses the allocated radio resources to transmit the captured data to the information processing device. This allows UE #2 to stably transmit the captured data related to image quality adjustment wirelessly. As a result, degradation of the image quality of the camera video is suppressed.

[0051] The outline of this embodiment has been described above, and the photographing system 1 of this embodiment will now be described in detail.

[0052] <<2. Configuration of the Imaging System>> First, the configuration of the imaging system 1 will be described.

[0053] 8 is a diagram showing the configuration of an image capture system 1 according to this embodiment. The image capture system 1 includes an information processing device 10, a terminal device 40, and an imaging device 50. In addition to these devices, the image capture system 1 may also include a management device 20 and a base station 30. The image capture system 1 provides a wireless network (mobile network) that enables mobile communication to the user by the wireless communication devices (e.g., the management device 20 and the base station 30) that make up the image capture system 1 operating in cooperation with each other. Note that the image capture system 1 can also be referred to as a communication system 1.

[0054] The wireless network of this embodiment may be, for example, a cellular network composed of a radio access network RAN ​​and a core network CN. The mobile network may include a terminal device 40. In this embodiment, a wireless communication device (wireless communication terminal) refers to a device having wireless communication capabilities. In the example of FIG. 8, the base station 30 and the terminal device 40 correspond to wireless communication devices (wireless communication terminals). In the following description, devices constituting a wireless network may be referred to as network devices. For example, a network device may be a device constituting a wireless access network (e.g., a 5G RAN and / or a 4G RAN) or a device constituting a core network (a 5G core network and / or a 4G core network). In the example of FIG. 8, for example, the management device 20 and / or the base station 30 are network devices.

[0055] The photographing system 1 may include a plurality of information processing devices 10, a plurality of management devices 20, a plurality of base stations 30, a plurality of terminal devices 40, and a plurality of image capturing devices 50. In the example of FIG. 8 , the photographing system 1 includes the information processing device 10 １ and information processing device 10 ２ The management device 20 includes the management device 20 １ and management device 20 ２ The imaging system 1 also includes a base station 30.１ , base station 30 ２ , and base station 30 ３ The terminal device 40 is provided with the terminal device 40 １ , terminal device 40 ２ , and terminal device 40 ３ The photographing system 1 also includes the photographing device 50. １ , imaging device 50 ２ , and the imaging device 50 ３ It is equipped with:

[0056] 8, the imaging device 50 is connected to the wireless network via the terminal device 40, but if the imaging device 50 has a wireless communication function, it may be directly connected to the wireless network. Also, in the example of Fig. 8, the imaging device 50 is connected to the information processing device 10 via the wireless network, but if the imaging device 50 has a wired communication function, it may be connected to the information processing device 10 via a wired connection.

[0057] The terminal device 40 may be configured to connect to a network using a radio access technology (RAT) such as LTE (Long Term Evolution), NR (New Radio), 6G, Wi-Fi (registered trademark), or Bluetooth (registered trademark). In this case, the terminal device 40 may be configured to be able to use different radio access technologies (wireless communication methods). For example, the terminal device 40 may be configured to be able to use NR and Wi-Fi. Furthermore, the terminal device 40 may be configured to be able to use different cellular communication technologies (e.g., LTE, NR, or 6G). In the following description, the terminal device 40 may be referred to as UE (User Equipment) 40.

[0058] LTE and NR are types of cellular communication technologies that enable mobile communication for terminal devices by arranging multiple areas covered by base stations in the form of cells. 6G, also a type of cellular communication technology, has the potential to become a technology that enables mobile communication for terminal devices by arranging multiple areas covered by base stations in the form of cells.

[0059] In the following description, "LTE" includes LTE-A (LTE-Advanced), LTE-A Pro (LTE-Advanced Pro), and EUTRA (Evolved Universal Terrestrial Radio Access). NR includes NRAT (New Radio Access Technology) and FEUTRA (Further EUTRA). A single base station 30 may manage multiple cells. In the following description, a cell corresponding to LTE is referred to as an LTE cell, and a cell corresponding to NR is referred to as an NR cell.

[0060] NR is the next generation (5th generation) radio access technology after LTE (4th generation communications including LTE-Advanced and LTE-Advanced Pro). NR is a radio access technology that can support various use cases, including eMBB (Enhanced Mobile Broadband), mMTC (Massive Machine Type Communications), and URLLC (Ultra-Reliable and Low Latency Communications). NR was standardized in 3GPP (registered trademark) Rel-15 as a technical framework that corresponds to the usage scenarios, requirements, and deployment scenarios of these use cases. Furthermore, beyond 5G and 6G, it is required to simultaneously achieve multiple axes of high speed, large capacity, low latency, high reliability, and multiple simultaneous connections.

[0061] 6G is the next generation of cellular communications technology after NR (5th generation mobile communications) and 5GS (5G system). 6G includes radio access technology and network technologies between base stations, core networks, and data networks. 6G also includes technologies for extreme connectivity of eMBB, mMTC, and URLLC, which were the main use cases or requirements of NR. 6G also includes new technologies in new areas. For example, 6G may include technologies related to AI (cognitive network, AI native air interface), sensing (including radar sensing and network as a sensor), and terahertz communications.

[0062] The wireless network may support at least one of radio access technologies (RATs) such as LTE (Long Term Evolution), NR (New Radio), and 6G. LTE, NR, and 6G are types of cellular communication technologies that enable mobile communication for terminal devices by arranging multiple areas covered by base stations in the form of cells. The wireless access method used by the imaging system 1 is not limited to LTE, NR, or 6G, and may be other wireless access methods such as W-CDMA (Wideband Code Division Multiple Access) and cdma2000 (Code Division Multiple Access 2000).

[0063] Furthermore, the base station 30 may be a terrestrial station or a non-terrestrial station. The non-terrestrial station may be a satellite station or an aircraft station. If the non-terrestrial station is a satellite station, the wireless network may be a bent-pipe (transparent) type mobile satellite communication system.

[0064] In this embodiment, terrestrial stations and terrestrial base stations refer to base stations and relay stations installed on the ground. Here, "terrestrial" refers to terrestrial in a broad sense, including not only land but also underground, on water, and underwater. In the following description, the term "terrestrial station" may be replaced with "gateway."

[0065] Note that an LTE base station may be referred to as an eNodeB (Evolved Node B) or eNB. An NR base station may be referred to as a gNodeB or gNB. A 6G base station may be referred to as a 6G NodeB (6GNB). In LTE, NR, and 6G, a terminal device (also referred to as a mobile station or terminal) may be referred to as a UE (User Equipment). Note that a terminal device is a type of communication device and is also referred to as a mobile station or terminal.

[0066] The terminal device 40 may be able to connect to a network using a wireless access technology (wireless communication method) other than LTE, NR, 6G, Wi-Fi, or Bluetooth. For example, the terminal device 40 may be able to connect to a network using low power wide area (LPWA) communication. The terminal device 40 may also be able to connect to a network using proprietary wireless communication.

[0067] Here, LPWA communication refers to wireless communication that enables low-power, wide-range communication. For example, LPWA wireless refers to IoT (Internet of Things) wireless communication using a specific low-power radio (e.g., the 920 MHz band) or the ISM (Industry-Science-Medical) band. The LPWA communication used by the terminal device 40 may conform to the LPWA standard. The LPWA standard may be, for example, at least one of ELTRES, ZETA, SIGFOX, LoRaWAN, LTE-M, and NB-IoT. Of course, the LPWA standard is not limited to these and may be another LPWA standard.

[0068] Each wireless communication device shown in Fig. 8 may be considered as a device in a logical sense, i.e., a part of each wireless communication device may be realized by a virtual machine (VM), a container such as Docker, or the like, and these may be physically implemented on the same hardware.

[0069] In this embodiment, the concept of a wireless communication device includes not only portable mobile devices (terminal devices) such as mobile terminals, but also devices installed in structures or mobile bodies. The structures or mobile bodies themselves may be considered wireless communication devices. Furthermore, the concept of a wireless communication device includes not only terminal devices 40 but also base stations 30. A wireless communication device is a type of processing device or information processing device. A wireless communication device can also be referred to as a transmitting device or a receiving device.

[0070] Below, we will explain in detail the configuration of each wireless communication device that makes up the photography system 1. Note that the configuration of each wireless communication device shown below is merely an example. The configuration of each wireless communication device may be different from the configuration shown below.

[0071] 2-1. Configuration of Information Processing Apparatus First, the configuration of the information processing apparatus 10 will be described.

[0072] The information processing device 10 is, for example, a device that performs processing to broadcast / distribute video captured by the imaging device 50. Broadcasting is, for example, the transmission of video using terrestrial and / or non-terrestrial waves. For example, broadcasting is television broadcasting (terrestrial broadcasting and / or satellite broadcasting). Distribution is, for example, the transmission of video using a communication network. For example, distribution is internet distribution.

[0073] The information processing device 10 may be a switcher or camera selector that switches between images from multiple imaging devices 50. The switcher is, for example, a device that switches between imaging devices that capture images to be broadcast or distributed based on instructions from an operator. The switcher may also be referred to as a broadcast controller, a Software Defined Network (SDN) controller, a network orchestrator, or the like. The camera selector is, for example, a device that switches between imaging devices that perform previewing or image quality adjustment based on instructions from an engineer. The camera selector may also be referred to as a remote control panel, a master setup unit, a broadcast controller, a camera network adapter, a broadcast control panel, or the like.

[0074] The information processing device 10 is not limited to a switcher or a camera selector. For example, the information processing device 10 may be a decoder that decodes the captured data encoded by the imaging device 50. The information processing device 10 may also be a converter that converts the decoded captured data into various signals (for example, signals for broadcasting / distribution or signals for display).

[0075] The information processing device 10 may be an application server or a web server. The information processing device 10 may be a PC server, a mid-range server, or a mainframe server. The information processing device 10 may also be an information processing device that performs data processing (edge ​​processing) near a user or a terminal. For example, the information processing device 10 may be an information processing device (computer) attached to or built into a base station 30. The information processing device 10 may also have a function as a core network. For example, the information processing device 10 may be a device that functions as a management device 20. Of course, the information processing device 10 may also be an information processing device that performs cloud computing. The information processing device 10 of this embodiment can function as an application function.

[0076] The information processing device 10 is connected to the management device 20 and / or other information processing devices 10 via a network. Here, the network is, for example, a public network such as the Internet. Note that the network is not limited to the Internet and may be, for example, a local area network (LAN), a wide area network (WAN), a cellular network, a fixed telephone network, or a regional Internet Protocol (IP) network. The network may include a wired network or a wireless network.

[0077] 9 is a diagram illustrating an example configuration of an information processing device 10 according to an embodiment of the present disclosure. The information processing device 10 includes a communication unit 11, a storage unit 12, and a control unit 13. The configuration illustrated in FIG. 9 is a functional configuration, and the hardware configuration may be different from this. Furthermore, the functions of the information processing device 10 may be distributed and implemented in multiple physically separated configurations. For example, the information processing device 10 may be configured by multiple information processing devices.

[0078] The communication unit 11 is a communication interface for communicating with other devices. For example, the communication unit 11 is a network interface. For example, the communication unit 11 is a LAN (Local Area Network) interface such as a NIC (Network Interface Card). The communication unit 11 may be a wired interface or a wireless interface. The communication unit 11 communicates with the management device 20, the base station 30, the terminal device 40, and other information processing devices 10 under the control of the control unit 13.

[0079] The storage unit 12 is a storage device that can read and write data, such as a dynamic random access memory (DRAM), a static random access memory (SRAM), a flash memory, or a hard disk.

[0080] The control unit 13 is a controller that controls each unit of the information processing device 10. The control unit 13 may be realized by a processor such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). For example, the control unit 13 may be realized by a processor executing various programs stored in an internal storage device of the information processing device 10 using a RAM (Random Access Memory) or the like as a work area. The control unit 13 may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The control unit 13 may also be realized by a GPU (Graphics Processing Unit). A CPU, an MPU, an ASIC, an FPGA, and a GPU can all be considered controllers. The control unit 13 may be composed of multiple physically separated objects. For example, the control unit 13 may be composed of multiple semiconductor chips.

[0081] The control unit 13 includes at least one block selected from a first transmission unit 131, a second transmission unit 132, a notification unit 133, and a request unit 134. Each block (first transmission unit 131 to request unit 134) constituting the control unit 13 is a functional block indicating a function of the control unit 13. These functional blocks may be software blocks or hardware blocks. For example, each of the above-described functional blocks may be a software module realized by software (including a microprogram), or may be a circuit block on a semiconductor chip (die). Of course, each functional block may be a processor or an integrated circuit. The control unit 13 may be configured with functional units different from the above-described functional blocks. The method of configuring the functional blocks is arbitrary.

[0082] <2-2. Configuration of Management Device> Next, the configuration of the management device 20 will be described.

[0083] The management device 20 is an information processing device (computer) that manages the wireless network. For example, the management device 20 is an information processing device that manages communication of the base station 30.

[0084] The management device 20 may be a device constituting a core network CN. For example, the management device 20 may be a device having a function as an MME (Mobility Management Entity). The management device 20 may also be a device having a function as an AMF (Access and Mobility Management Function) and / or an SMF (Session Management Function). The MME, AMF, and SMF are control plane network function nodes in the core network CN. The management device 20 may be a device having a function as a control plane network function (6G CPNF) in 6G. The 6G CPNF may be composed of one or more logical nodes.

[0085] Of course, the functions of the management device 20 are not limited to MME, AMF, SMF, and 6G CPNF. The management device 20 may be a device having functions as a Network Slice Selection Function (NSSF), an Authentication Server Function (AUSF), a Policy Control Function (PCF), and a Unified Data Management (UDM). Furthermore, the management device 20 may be a device having functions as a Home Subscriber Server (HSS).

[0086] The management device 20 may have a gateway function. For example, the management device 20 may have a function as an S-GW (Serving Gateway) or a P-GW (Packet Data Network Gateway). The management device 20 may also have a UPF (User Plane Function) function. In this case, the management device 20 may have multiple UPFs. The management device 20 may also be a device that has a function as a 6G User Plane Network Function (6G UPNF).

[0087] The core network CN is composed of multiple network functions, and each network function may be consolidated into one physical device or distributed across multiple physical devices. In other words, the management device 20 may be distributed across multiple devices. Furthermore, this distributed distribution may be controlled so that it is executed dynamically. The base station 30 and the management device 20 form a single network, providing wireless communication services to terminal devices 40. The management device 20 is connected to the Internet, and the terminal devices 40 can use various services provided via the Internet via the base station 30.

[0088] The management device 20 does not necessarily have to be a device that constitutes the core network CN. For example, assume that the core network CN is a core network of W-CDMA (Wideband Code Division Multiple Access) or cdma2000 (Code Division Multiple Access 2000). In this case, the management device 20 may be a device that functions as an RNC (Radio Network Controller).

[0089] FIG. 10 is a diagram showing the configuration of the management device 20 according to this embodiment. The management device 20 includes a communication unit 21, a storage unit 22, and a control unit 23. The configuration shown in FIG. 10 is a functional configuration, and the hardware configuration may be different. Furthermore, the functions of the management device 20 may be statically or dynamically distributed and implemented in multiple physically separated configurations. The management device 20 may also be configured by multiple server devices.

[0090] The communication unit 21 is a communication interface for communicating with a wireless communication device (e.g., base station 30). The communication unit 21 may be a network interface or a device connection interface. The communication unit 21 may be a LAN (Local Area Network) interface such as a NIC (Network Interface Card), or a Universal Serial Bus (USB) interface configured by a USB host controller or a USB port. The communication unit 21 may be a wired interface or a wireless interface. The communication unit 21 is controlled by the control unit 23.

[0091] The storage unit 22 is a readable and writable storage device such as a DRAM, an SRAM, a flash memory, or a hard disk. The storage unit 22 stores, for example, the connection state of the terminal device 40. The storage unit 22 stores the state of the RRC (Radio Resource Control) of the terminal device 40 and the state of the ECM (EPS Connection Management) or the 5G System CM (Connection Management). The storage unit 22 may function as a home memory that stores location information of the terminal device 40.

[0092] The control unit 23 is a controller that controls each unit of the management device 20. The control unit 23 may be realized by a processor such as a CPU or an MPU. For example, the control unit 23 may be realized by a processor executing various programs stored in a storage device inside the management device 20 using RAM or the like as a work area. The control unit 23 may be realized by an integrated circuit such as an ASIC or an FPGA. The control unit 23 may also be realized by a GPU. A CPU, an MPU, an ASIC, an FPGA, and a GPU can all be considered controllers. The control unit 23 may be composed of multiple physically separated objects. For example, the control unit 23 may be composed of multiple semiconductor chips.

[0093] <2-3. Configuration of Base Station> Next, the configuration of the base station 30 will be described.

[0094] The base station 30 is a wireless communication device that performs wireless communication with other wireless communication devices (e.g., a terminal device 40, an imaging device 50, or another base station 30). The base station 30 may wirelessly communicate with the terminal device 40 via a relay station, or may wirelessly communicate directly with the terminal device 40.

[0095] The base station 30 is a device equivalent to a radio base station (such as a base station, Node B, eNB, gNB, or 6GNB) or a radio access point. The base station 30 may be a radio relay station. The base station 30 may be an optical device called a remote radio head (RRH). The base station 30 may be a receiving station such as a field pickup unit (FPU). The base station 30 may be an integrated access and backhaul (IAB) donor node or an IAB relay node that provides radio access lines and radio backhaul lines using time division multiplexing, frequency division multiplexing, or space division multiplexing.

[0096] The wireless access technology used by the base station 30 may be cellular communication technology. The wireless access technology used by the base station 30 may be wireless LAN technology. The wireless access technology used by the base station 30 may be low-power wide-area (LPWA) communication technology. However, the wireless access technology used by the base station 30 is not limited to these and may be other wireless access technologies. The wireless communication used by the base station 30 may be wireless communication using millimeter waves or wireless communication using terahertz waves. The wireless communication used by the base station 30 may be wireless communication using radio waves or wireless communication using infrared or visible light (optical wireless). Furthermore, the base station 30 may be capable of NOMA (Non-Orthogonal Multiple Access) communication with the terminal device 40. Here, NOMA communication refers to communication (transmission, reception, or both) using non-orthogonal resources. Note that the base station 30 may be capable of NOMA communication with other base stations 30.

[0097] The base station 30 may be able to communicate with the core network via a base station-core network interface (e.g., NG Interface, S1 Interface, etc.). This interface may be either wired or wireless. The base station may also be able to communicate with other base stations via an inter-base station interface (e.g., Xn Interface, X2 Interface, F1 Interface, etc.). This interface may be either wired or wireless.

[0098] The concept of a base station (also called a "base station device") includes not only a donor base station but also a relay base station (also called a "relay station"). A relay base station may be any one of an RF Repeater, a Smart Repeater, and an Intelligent Surface. The concept of a base station includes not only a structure with base station functions but also equipment installed in the structure.

[0099] Examples of structures include high-rise buildings, houses, steel towers, station facilities, airport facilities, port facilities, office buildings, school buildings, hospitals, factories, commercial facilities, stadiums, and other buildings. The concept of a structure includes not only buildings, but also non-building structures such as tunnels, bridges, dams, fences, and steel pillars, as well as equipment such as cranes, gates, and wind turbines. The concept of a structure includes not only land (ground in the narrow sense) or underground structures, but also water-based structures such as piers or megafloats, and underwater structures such as ocean observation facilities. A base station can also be referred to as an information processing device.

[0100] The base station 30 may be a donor station or a relay station (relay station). The base station 30 may also be a fixed station or a mobile station. A mobile station is a wireless communication device (e.g., a base station) configured to be mobile. In this case, the base station 30 may be a device installed in a mobile body, or may be the mobile body itself. For example, a relay station with mobility can be considered a base station 30 as a mobile station. Furthermore, devices that are inherently mobile and have base station functionality (at least part of the base station functionality), such as vehicles, UAVs (Unmanned Aerial Vehicles) represented by drones, and smartphones, also fall under the category of a base station 30 as a mobile station.

[0101] Here, the moving body may be a mobile terminal such as a smartphone or a mobile phone. The moving body may be a moving body that moves on land (ground in the narrow sense) (e.g., a vehicle such as an automobile, bicycle, bus, truck, motorcycle, train, or linear motor car), or a moving body that moves underground (e.g., in a tunnel) (e.g., a subway). The moving body may also be a moving body that moves on water (e.g., a ship such as a passenger ship, cargo ship, or hovercraft), or a moving body that moves underwater (e.g., a submersible vessel such as a submarine, submarine, or unmanned underwater vehicle). The moving body may also be a moving body that moves within the atmosphere (e.g., an aircraft such as an airplane, airship, or drone).

[0102] The base station 30 may be a terrestrial base station (ground station) installed on the ground. The base station 30 may be a base station located on a structure on the ground, or a base station installed on a mobile object moving on the ground. The base station 30 may be an antenna installed on a structure such as a building and a signal processing device connected to that antenna. The base station 30 may be the structure or the mobile object itself. "Ground" refers not only to land (ground in the narrow sense) but also to ground, on water, and underwater in a broad sense. The base station 30 is not limited to a terrestrial base station. If the imaging system 1 is a satellite communication system, the base station 30 may be an aircraft station. From the perspective of the satellite station, an aircraft station located on Earth is a ground station.

[0103] The base station 30 is not limited to a ground station. The base station 30 may be a non-terrestrial base station device (non-terrestrial station) that can float in the air or space. The base station 30 may be an aircraft station or a satellite station.

[0104] A satellite station is a satellite station capable of floating outside the atmosphere. The satellite station may be a device mounted on a space vehicle such as an artificial satellite, or may be the space vehicle itself. A space vehicle is a vehicle that moves outside the atmosphere. The space vehicle may be at least one of an artificial satellite, a spacecraft, a space station, and a probe. Of course, the space vehicle may also be an artificial celestial body other than these. Note that a satellite that serves as a satellite station may be any of a low Earth orbiting (LEO) satellite, a medium Earth orbiting (MEO) satellite, a geostationary Earth orbiting (GEO) satellite, or a highly elliptical orbiting (HEO) satellite. The satellite station may be a device mounted on a low Earth orbiting (LEO), a medium Earth orbiting (MEO), a geostationary Earth orbiting (GEO), or a highly elliptical orbiting (HEO) satellite.

[0105] An aircraft station is a wireless communication device capable of floating in the atmosphere of an aircraft or the like. The aircraft station may be a device mounted on the aircraft or the like, or may be the aircraft itself. The concept of aircraft includes not only heavier-than-air vehicles such as airplanes and gliders, but also lighter-than-air vehicles such as balloons and airships. The concept of aircraft includes not only heavier-than-air vehicles or lighter-than-air vehicles, but also rotorcraft such as helicopters and autogyros. The aircraft station, or an aircraft equipped with an aircraft station, may be an unmanned aerial vehicle such as a drone.

[0106] The concept of unmanned aerial vehicles also includes unmanned aerial systems (UAS) and tethered unmanned aerial systems (UAS). The concept of unmanned aerial vehicles also includes lighter than air UAS (LTA) and heavier than air UAS (HTA). The concept of unmanned aerial vehicles also includes high altitude unmanned aerial system platforms (HAPs).

[0107] The coverage size of the base station 30 may be relatively large, such as a macrocell, or relatively small, such as a picocell. The coverage size of the base station 30 may also be extremely small, such as a femtocell. The base station 30 may have a beamforming function. The base station 30 may form a cell or service area for each beam. Additionally or alternatively, in addition to beamforming, which gives directionality to the beam, the base station 30 may have a function to pinpoint a desired wave to a specific point by further considering distance information from the antenna of the base station 30. This function may be called beam focusing or point forming.

[0108] Fig. 11 is a diagram showing the configuration of a base station 30 according to this embodiment. The base station 30 includes a wireless communication unit 31, a storage unit 32, and a control unit 33. However, the configuration shown in Fig. 11 is a functional configuration, and the hardware configuration may be different. Furthermore, the functions of the base station 30 may be distributed and implemented in multiple physically separated units.

[0109] The wireless communication unit 31 is a signal processing unit for wireless communication with other wireless communication devices (for example, the terminal device 40, the imaging device 50, or another base station 30). The wireless communication unit 31 is controlled by the control unit 33. The wireless communication unit 31 supports one or more wireless access methods. The wireless communication unit 31 may support at least one of NR, LTE, and 6G. In addition to NR, LTE, and 6G, the wireless communication unit 31 may also support W-CDMA, cdma2000, and the like. The wireless communication unit 31 may also support automatic retransmission techniques such as HARQ (Hybrid Automatic Repeat reQuest).

[0110] The wireless communication unit 31 includes a transmission processing unit 311, a reception processing unit 312, and an antenna 313. The wireless communication unit 31 may include multiple transmission processing units 311, multiple reception processing units 312, and multiple antennas 313. When the wireless communication unit 31 supports multiple wireless access methods, each unit of the wireless communication unit 31 may be configured separately for each wireless access method. The transmission processing unit 311 and the reception processing unit 312 may be configured separately for LTE, NR, and 6G. The antenna 313 may be configured with multiple antenna elements, for example, multiple patch antennas. The wireless communication unit 31 may have a beamforming function. For example, the wireless communication unit 31 may have a polarization beamforming function using vertical polarization (V polarization) and horizontal polarization (H polarization) (or a polarization beamforming function using dual polarization in polarization directions 45 degrees and -45 degrees from the vertical direction).

[0111] The transmission processing unit 311 performs transmission processing of the downlink control information and downlink data. For example, the transmission processing unit 311 encodes the downlink control information and downlink data input from the control unit 33 using a coding method such as block coding, convolutional coding, or turbo coding. Here, the encoding may be performed using polar codes or low-density parity check codes (LDPC codes). The transmission processing unit 311 then modulates the encoded bits using a predetermined modulation method such as binary phase shift keying (BPSK), quadrature phase shift keying (QPSK), quadrature amplitude modulation (16QAM), 64QAM, 256QAM, or a higher-order multi-level modulation method. In this case, the signal points on the constellation do not necessarily need to be equidistant. The constellation may be a non-uniform constellation (NUC). The transmission processing unit 311 then multiplexes the modulation symbols of each channel and the downlink reference signal and allocates the multiplexed signals to predetermined resource elements. The transmission processing unit 311 then performs various signal processing on the multiplexed signals. For example, the transmission processing unit 311 performs processing such as conversion to the frequency domain by discrete Fourier transform (fast Fourier transform may be used as a high-speed algorithm), addition of a guard interval (cyclic prefix), generation of a baseband digital signal, conversion to an analog signal, quadrature modulation, up-conversion, removal of unnecessary frequency components, and power amplification. The signals generated by the transmission processing unit 311 are transmitted from the antenna 313.

[0112] The reception processing unit 312 processes the uplink signal received via the antenna 313. For example, the reception processing unit 312 performs downconversion, removal of unnecessary frequency components, control of amplification level, quadrature demodulation, conversion to a digital signal, removal of guard intervals (cyclic prefixes), extraction of frequency domain signals using a discrete Fourier transform, and the like on the uplink signal. The reception processing unit 312 then separates uplink channels such as a PUSCH (Physical Uplink Shared Channel) and a PUCCH (Physical Uplink Control Channel) and an uplink reference signal from the processed signal. The reception processing unit 312 also demodulates the received signal using a modulation scheme such as BPSK or QPSK for the modulation symbols of the uplink channel. The modulation scheme used for demodulation may be 16QAM, 64QAM, or 256QAM. In this case, the signal points on the constellation do not necessarily have to be equidistant. The constellation may be a non-uniform constellation (NUC). The reception processing unit 312 then performs a decoding process on the coded bits of the demodulated uplink channel. The decoded uplink data and uplink control information are output to the control unit 33.

[0113] The antenna 313 is an antenna device that converts electric current and radio waves into each other. The antenna 313 may be composed of a single antenna element, for example, a single patch antenna. The antenna 313 may be composed of multiple antenna elements, for example, multiple patch antennas. When the antenna 313 is composed of multiple antenna elements, the wireless communication unit 31 may have a beamforming function. The wireless communication unit 31 may be configured to generate a directional beam by controlling the directivity of a wireless signal using the multiple antenna elements. The antenna 313 may be a dual-polarized antenna. When the antenna 313 is a dual-polarized antenna, the wireless communication unit 31 may use vertical polarization (V polarization) and horizontal polarization (H polarization) (or dual polarization with polarization directions at 45 degrees and -45 degrees from the vertical direction) when transmitting a wireless signal. The wireless communication unit 31 may control the directivity of a wireless signal transmitted using vertical polarization and horizontal polarization (or dual polarization with polarization directions at 45 degrees and -45 degrees from the vertical direction). Furthermore, the wireless communication unit 31 may transmit and receive spatially multiplexed signals via multiple layers each consisting of multiple antenna elements.

[0114] The storage unit 32 is a readable and writable storage device such as a DRAM, an SRAM, a flash memory, or a hard disk.

[0115] The control unit 33 is a controller that controls each unit of the base station 30. The control unit 33 may be realized by a processor such as a CPU or an MPU. For example, the control unit 33 may be realized by a processor executing various programs stored in a storage device inside the base station 30 using RAM or the like as a work area. The control unit 33 may be realized by an integrated circuit such as an ASIC or an FPGA. The control unit 33 may also be realized by a GPU. A CPU, an MPU, an ASIC, an FPGA, and a GPU can all be considered controllers. The control unit 33 may be composed of multiple physically separated objects. For example, the control unit 33 may be composed of multiple semiconductor chips.

[0116] In some embodiments, the base station 30 may be configured as a collection of multiple physical or logical devices. As an example, the base station 30 of this embodiment may be divided into multiple devices such as a baseband unit (BBU) and a radio unit (RU). The base station 30 may be interpreted as a collection of these multiple devices. Furthermore, the base station may be either a BBU or an RU, or may be both. The BBU and the RU may be connected by a predetermined interface such as an enhanced Common Public Radio Interface (eCPRI).

[0117] The RU may be referred to as an RRU (Remote Radio Unit) or an RD (Radio DoT). The RU may correspond to a gNB-DU (gNB Distributed Unit) described later. The BBU may correspond to a gNB-CU (gNB Central Unit) described later. The RU may be a device integrally formed with an antenna. The antenna of the base station 30, for example, an antenna integrally formed with the RU, may employ an Advanced Antenna System and support MIMO such as FD-MIMO or beamforming. The antenna of the base station 30 may have, for example, 64 transmitting antenna ports and 64 receiving antenna ports.

[0118] The antenna mounted on the RU may be an antenna panel consisting of one or more antenna elements, and the RU may be equipped with one or more antenna panels. The RU may be equipped with two types of antenna panels, a horizontally polarized antenna panel and a vertically polarized antenna panel. The RU may be equipped with two types of antenna panels, a right-handed circularly polarized antenna panel and a left-handed circularly polarized antenna panel, or an antenna panel with a polarization direction at 45 degrees from the vertical direction and an antenna panel with a polarization direction at -45 degrees from the vertical direction. Multiple antennas with these multiple polarization directions may be mounted on a single antenna panel. The RU may form and control an independent beam for each antenna panel.

[0119] A plurality of base stations 30 may be connected to each other. One or more base stations 30 may be included in a radio access network (RAN). In this case, the base station 30 may be simply referred to as a RAN, a RAN node, an AN (Access Network), an AN node, or the like. The RAN in LTE may be called an Enhanced Universal Terrestrial RAN (EUTRAN). The RAN in NR may be called an NGRAN. Furthermore, the RAN in 6G may be called a 6GRAN. The RAN in W-CDMA (UMTS) may be called a UTRAN.

[0120] An LTE base station 30 may be referred to as an eNodeB (Evolved Node B) or eNB. In this case, the EUTRAN includes one or more eNodeBs (eNBs). An NR base station 30 may be referred to as a gNodeB or gNB. In this case, the NGRAN includes one or more gNBs. A 6G base station may be referred to as a 6GNodeB, 6gNodeB, 6GNB, or 6gNB. In this case, the 6GRAN includes one or more 6GNBs. The EUTRAN may include a gNB (en-gNB) connected to a core network (EPC) in an LTE communication system (EPS). The NGRAN may include an ng-eNB connected to a core network 5GC in a 5G communication system (5GS).

[0121] When the base station 30 is an eNB, gNB, 6GNB, or the like, the base station 30 may be referred to as a 3GPP access. When the base station 30 is a wireless access point, the base station 30 may be referred to as a non-3GPP access. The base station 30 may be a radio extension device called an RRH (Remote Radio Head). When the base station 30 is a gNB, the base station 30 may be a combination of the gNB-CU and gNB-DU described above, or may be either a gNB-CU or a gNB-DU.

[0122] Here, the gNB-CU hosts multiple upper layers (e.g., RRC (Radio Resource Control), SDAP (Service Data Adaptation Protocol), PDCP (Packet Data Convergence Protocol)) of the access stratum for communication with the UE. On the other hand, the gNB-DU hosts multiple lower layers (e.g., RLC (Radio Link Control), MAC (Medium Access Control), PHY (Physical layer)) of the access stratum. That is, among the messages / information described below, RRC signaling (semi-static notification) is generated by the gNB-CU, while MAC The CE and DCI (dynamic notification) may be generated by the gNB-DU. Alternatively, some configurations of the RRC configuration (semi-static notification), such as IE:cellGroupConfig, may be generated by the gNB-DU, and the remaining configurations may be generated by the gNB-CU. These configurations may be transmitted and received over the F1 interface described below.

[0123] The base station 30 may be configured to be able to communicate with other base stations. When multiple base stations 30 are eNBs or a combination of eNBs and en-gNBs, these base stations 30 may be connected via an X2 interface. When multiple base stations 30 are gNBs or a combination of gn-eNBs and gNBs, these base stations 30 may be connected via an Xn interface. When multiple base stations 30 are a combination of gNB-CUs and gNB-DUs, these base stations 30 may be connected via the F1 interface described above. Messages / information (e.g., RRC signaling, MAC Control Element (CE), or Downlink Control Information (DCI)) described below may be transmitted between multiple base stations 30 via, for example, the X2 interface, the Xn interface, or the F1 interface.

[0124] A cell provided by the base station 30 may be referred to as a serving cell. The concept of a serving cell includes a PCell (Primary Cell) and an SCell (Secondary Cell). When dual connectivity is provided to the terminal device 40, the PCell and zero or more SCells provided by a Master Node (MN) may be referred to as a Master Cell Group. The dual connectivity may be at least one of EUTRA-EUTRA Dual Connectivity, EUTRA-NR Dual Connectivity (ENDC), EUTRA-NR Dual Connectivity with 5GC, NR-EUTRA Dual Connectivity (NEDC), NR-NR Dual Connectivity, NR-6G Dual Connectivity, and 6G-NR Dual Connectivity. Of course, dual connectivity is not limited to these.

[0125] The serving cell may include a PSCell (Primary Secondary Cell or Primary SCG Cell). When dual connectivity is provided to the terminal device 40, the PSCell provided by a Secondary Node (SN) and zero or more SCells may be referred to as a Secondary Cell Group (SCG). Unless special configuration (e.g., PUCCH on SCell) is performed, the Physical Uplink Control Channel (PUCCH) is transmitted by the PCell and PSCell but not by the SCell. Radio link failure is detected by the PCell and PSCell but not (does not need to be detected by) the SCell. As such, the PCell and PSCell play special roles among serving cells and are therefore also referred to as Special Cells (SpCells).

[0126] One cell may be associated with one downlink component carrier and one uplink component carrier. The system bandwidth corresponding to one cell may be divided into multiple BWPs (Bandwidth Parts). In this case, one or multiple BWPs may be configured in the terminal device 40, and one BWP may be used by the terminal device 40 as an active BWP. Radio resources available to the terminal device 40, such as a frequency band, numerology (subcarrier spacing), or slot format, may differ for each cell, component carrier, or BWP.

[0127] 2-4. Configuration of Terminal Device Next, the configuration of the terminal device 40 will be described.

[0128] The terminal device 40 is a wireless communication terminal (e.g., UE (User Equipment)) that performs wireless communication with other wireless communication devices (e.g., base stations 30 or other terminal devices 40). If the imaging device 50 has a wireless communication function, the terminal device 40 may be configured to be able to communicate wirelessly with the imaging device 50.

[0129] The terminal device 40 may be any type of information processing device (computer). For example, the terminal device 40 may be a mobile terminal such as a mobile phone, a smart device (smartphone or tablet), a PDA (Personal Digital Assistant), or a notebook PC. The terminal device 40 may also be a communication module that is connected to an information processing device (e.g., an imaging device without wireless communication capabilities) and provides the information processing device with wireless communication capabilities. The terminal device 40 may also be an imaging device with wireless communication capabilities (e.g., a camcorder).

[0130] The terminal device 40 may be a motorcycle or a mobile broadcasting vehicle equipped with a communication device such as a Field Pickup Unit (FPU). The terminal device 40 may be a Machine to Machine (M2M) device or an Internet of Things (IoT) device. The terminal device 40 may be a wearable device such as a smartwatch.

[0131] Furthermore, the terminal device 40 may be an XR (Extended Reality) device such as an AR (Augmented Reality) device, a VR (Virtual Reality) device, or an MR (Mixed Reality) device. In this case, the XR device may be a glasses-type device such as AR glasses or MR glasses, or a head-mounted device such as a VR head-mounted display. When the terminal device 40 is an XR device, the terminal device 40 may be a standalone device consisting only of a part worn by a user (e.g., a glasses part). Furthermore, the terminal device 40 may be a terminal-linked device consisting of a part worn by a user (e.g., a glasses part) and a terminal part (e.g., a smart device) linked to the part worn by a user.

[0132] The terminal device 40 may be capable of NOMA communication with the base station 30. The terminal device 40 may be able to use an automatic repeat transmission technique such as HARQ when communicating with the base station 30. The terminal device 40 may be capable of sidelink communication with another terminal device 40. The terminal device 40 may be able to use an automatic repeat transmission technique such as HARQ when performing sidelink communication. The terminal device 40 may be capable of NOMA communication when performing sidelink communication with another terminal device 40. The terminal device 40 may be capable of LPWA communication with other wireless communication devices such as the base station 30. The wireless communication used by the terminal device 40 may be wireless communication using millimeter waves. The wireless communication used by the terminal device 40, including sidelink communication, may be wireless communication using radio waves or wireless communication using infrared or visible light (i.e., optical wireless).

[0133] The terminal device 40 may be a mobile wireless communication device, i.e., a mobile device. The terminal device 40 may be a wireless communication device installed in a mobile device, or may be the mobile device itself. The terminal device 40 may be a vehicle that moves on a road, such as an automobile, bus, truck, or motorcycle, or a train that runs on a track, or may be a wireless communication device mounted on the vehicle. The mobile device may be a mobile terminal, or a mobile device that moves on land (in the narrow sense of the word), underground, on water, or underwater. The mobile device may also be a mobile device that moves within the atmosphere, such as an airplane, airship, balloon, or helicopter, or a mobile device that moves outside the atmosphere, such as an artificial satellite. The mobile device may also be a UAV (Unmanned Aerial Vehicle) such as a drone. The terminal device 40 may also be a wireless communication device mounted on the mobile device.

[0134] The terminal device 40 may be capable of simultaneously connecting to and communicating with a plurality of base stations 30 or a plurality of cells. When one base station 30 supports a communication area via a plurality of cells (for example, a PCell or an SCell), the plurality of cells can be bundled together to enable communication between the base station 30 and the terminal device 40 by using carrier aggregation (CA) technology, dual connectivity (DC) technology, multi-connectivity (MC) technology, or the like. Alternatively, communication between the terminal device 40 and the plurality of base stations 30 can also be performed via cells of different base stations 30 by coordinated multi-point transmission and reception (CoMP) technology.

[0135] The terminal device 40 may be a relay terminal that relays communications to a remote terminal.

[0136] Fig. 12 is a diagram showing the configuration of a terminal device 40 according to this embodiment. The terminal device 40 includes a wireless communication unit 41, a storage unit 42, and a control unit 43. The configuration shown in Fig. 12 is a functional configuration, and the hardware configuration may be different from this. Furthermore, the functions of the terminal device 40 may be distributed and implemented in multiple physically separated components.

[0137] The wireless communication unit 41 is a signal processing unit for wireless communication with other wireless communication devices (for example, the base station 30 or other terminal devices 40). The wireless communication unit 41 is controlled by the control unit 43. The wireless communication unit 41 supports one or more wireless access methods. The wireless communication unit 41 may support at least one of NR, LTE, and 6G. In addition to NR, LTE, and 6G, the wireless communication unit 41 may also support W-CDMA, cdma2000, and the like. The wireless communication unit 41 may also support automatic retransmission techniques such as HARQ (Hybrid Automatic Repeat reQuest).

[0138] The wireless communication unit 41 includes a transmission processing unit 411, a reception processing unit 412, and an antenna 413. The wireless communication unit 41 may include multiple transmission processing units 411, multiple reception processing units 412, and multiple antennas 413. If the wireless communication unit 41 supports multiple wireless access methods, each unit of the wireless communication unit 41 may be configured separately for each wireless access method. The transmission processing unit 411 and the reception processing unit 412 may be configured separately for LTE, NR, and 6G. The antenna 413 may be configured with multiple antenna elements, for example, multiple patch antennas. The wireless communication unit 41 may have a beamforming function. For example, the wireless communication unit 41 may have a polarization beamforming function using vertical polarization (V polarization) and horizontal polarization (H polarization) (or a polarization beamforming function using dual polarization in polarization directions 45 degrees and -45 degrees from the vertical direction). Furthermore, the antenna 413 does not necessarily have to be part of the terminal device 40 or the wireless communication unit 41. For example, the antenna 413 may not be included in the wireless communication unit 41, but may be installed as an external antenna or the like.

[0139] The storage unit 42 is a readable and writable storage device such as a DRAM, an SRAM, a flash memory, or a hard disk.

[0140] The control unit 43 is a controller that controls each unit of the terminal device 40. The control unit 43 may be realized by a processor such as a CPU or an MPU. For example, the control unit 43 may be realized by a processor executing various programs stored in a storage device inside the terminal device 40 using RAM or the like as a work area. The control unit 43 may be realized by an integrated circuit such as an ASIC or an FPGA. The control unit 43 may be realized by a GPU. A CPU, an MPU, an ASIC, an FPGA, and a GPU can all be considered controllers. The control unit 43 may be composed of multiple physically separated objects. For example, the control unit 43 may be composed of multiple semiconductor chips.

[0141] The control unit 43 includes at least one block of a receiving unit 431 and a transmitting unit 432. Each block (receiving unit 431 to transmitting unit 432) constituting the control unit 43 is a functional block that indicates the function of the control unit 43. These functional blocks may be software blocks or hardware blocks. For example, each of the above-described functional blocks may be a software module realized by software (including a microprogram), or may be a circuit block on a semiconductor chip (die). Of course, each functional block may be a processor or an integrated circuit. The control unit 43 may be configured with functional units different from the above-described functional blocks. The method of configuring the functional blocks is arbitrary. The operation of each functional block of the control unit 43 may be the same as the operation of each functional block of the terminal device 40 described below.

[0142] 2-5. Configuration of the Imaging Device Next, the configuration of the imaging device 50 will be described.

[0143] The imaging device 50 is an information processing device (computer) equipped with an imaging function. For example, the imaging device 50 may be a professional camera or a general-purpose camera. The imaging device 50 may be an integrated imaging device in which a camera and an encoder are integrated, or a separate imaging device in which a camera and an encoder are separated. If the imaging device 50 is a separate imaging device, only the camera portion may be considered to be the imaging device 50, or the set of the camera and the encoder may be considered to be the imaging device 50.

[0144] The imaging device 50 may have a wireless communication function. In this case, the imaging device 50 can be considered a type of terminal device 40. An imaging device 50 with a wireless communication function can be referred to as a wireless camera. If the imaging device 50 has a wireless communication function, the imaging device 50 may directly connect to a wireless network using the wireless communication function. Note that the imaging device 50 can also indirectly connect to a wireless network via another device (e.g., the terminal device 40) that has a wireless communication function. In this case, the imaging device 50 does not necessarily have a wireless communication function. Furthermore, if some of the camera's functions (e.g., an encoder) are provided as a separate device from the imaging device 50, the imaging device 50 may be indirectly connected to the terminal device 40 via the separate device. In this case, the imaging device 50 may be indirectly connected to the wireless network via the separate device and the terminal device 40.

[0145] The imaging device 50 is installed, for example, at a photography venue (for example, a sports facility or an event venue) and transmits photography data (for example, sports footage or event footage) to the information processing device 10 via a wireless network.

[0146] Fig. 13 is a diagram illustrating an example configuration of an imaging device 50 according to an embodiment of the present disclosure. The imaging device 50 includes a wireless communication unit 51, a storage unit 52, a control unit 53, a network communication unit 54, and an imaging unit 55. Note that the configuration illustrated in Fig. 13 is a functional configuration, and the hardware configuration may be different from this. Furthermore, the functions of the imaging device 50 may be distributed and implemented in multiple physically separated components.

[0147] The wireless communication unit 51 is a signal processing unit for wirelessly communicating with other wireless communication devices (e.g., the base station 30, the terminal device 40, and another imaging device 50). The wireless communication unit 51 operates under the control of the control unit 53. The configuration of the wireless communication unit 51 may be the same as that of the wireless communication unit 31 of the base station 30.

[0148] The storage unit 52 is a data readable / writable storage device such as a DRAM, an SRAM, a flash memory, or a hard disk. The storage unit 52 stores shooting data (e.g., video data) captured by the imaging unit 55. The shooting data may include not only video data but also audio data and / or metadata. The shooting data is not limited to video data. The shooting data may also include still image data. The shooting data may be in a file format. In this case, multiple files with different resolutions may be stored in the storage unit 52. For example, the files recorded in the storage unit 52 may be at least one of a standard resolution file (e.g., a file for real-time broadcasting / real-time distribution) in which standard resolution images are recorded, and a high-resolution file (e.g., an editing file for creating replays or highlights) in which images with a higher resolution than the standard resolution are recorded.

[0149] Furthermore, the files recorded in the storage unit 52 may be configured so that the type of shooting data can be identified. For example, the files recorded in the storage unit 52 may be assigned identification information for identifying the type of shooting data (e.g., on-air, next, etc.). In this case, the files recorded in the storage unit 52 may include at least one of a file recording on-air video, a file recording next video, and a file recording other live video that is neither on-air nor next. Here, on-air video refers to video currently being broadcast / distributed (e.g., live streaming), and next video refers to video that will be aired next. The imaging device 50 may acquire information for identifying the type of shooting data from, for example, the information processing device 10 (e.g., a switcher or a camera selector). The information for identifying the type of shooting data is, for example, first control information included in a tally signal.

[0150] The control unit 53 is a controller that controls each unit of the imaging device 50. The control unit 53 may be realized by a processor such as a CPU or an MPU. For example, the control unit 53 may be realized by a processor executing various programs stored in a storage device inside the imaging device 50 using RAM or the like as a work area. The control unit 53 may be realized by an integrated circuit such as an ASIC or an FPGA. The control unit 53 may be realized by a GPU. A CPU, an MPU, an ASIC, an FPGA, and a GPU can all be considered controllers. Note that the control unit 53 may be composed of multiple physically separated objects. For example, the control unit 53 may be composed of multiple semiconductor chips.

[0151] The control unit 53 includes at least one block of a receiving unit 531 and a transmitting unit 532. Each block (receiving unit 531 to transmitting unit 532) constituting the control unit 53 is a functional block that indicates the function of the control unit 53. These functional blocks may be software blocks or hardware blocks. For example, each of the above-described functional blocks may be a software module realized by software (including a microprogram), or may be a circuit block on a semiconductor chip (die). Of course, each functional block may be a processor or an integrated circuit. The control unit 53 may be configured by functional units different from the above-described functional blocks. The functional blocks may be configured in any manner. The operation of each functional block of the control unit 53 may be the same as the operation of each functional block of the imaging device 50, which will be described later.

[0152] The network communication unit 54 is a communication interface for communicating with other devices. For example, the network communication unit 54 is a LAN interface such as a NIC. The network communication unit 54 may be a wired interface or a wireless interface. The network communication unit 54 communicates with other devices under the control of the control unit 53.

[0153] The imaging unit 55 is a conversion unit that converts an optical image into an electrical signal. The imaging unit 55 includes, for example, an image sensor and a signal processing circuit that processes analog pixel signals output from the image sensor, and converts light entering through the lens into digital data (image data). Note that the image captured by the imaging unit 55 is not limited to a video, and may be a still image.

[0154] 2-6. Network Architecture A network architecture defined by 3GPP (registered trademark) can be applied to the core network CN of the imaging system 1. Below, the network architecture of a fifth-generation mobile communication system (5G) will be described as an example of the architecture of the core network CN.

[0155] It should be noted that the network architecture applied to the photography system 1 is not limited to the 5G network architecture. For example, the network architecture applied to the photography system 1 may be the network architecture of a fourth-generation mobile communication system (4G) or the network architecture of a sixth-generation mobile communication system (6G). Of course, the network architecture applied to the photography system 1 may be a network architecture other than these.

[0156] FIG. 14 is a diagram showing an example of a 5G network architecture. The 5G core network CN is also called 5G Core (5GC) / Next Generation Core (NGC). Hereinafter, the 5G core network CN is also referred to as 5GC / NGC. The core network CN is connected to a UE (User Equipment) 40 via an (R)AN 630. The UE 40 is, for example, a terminal device 40. If the imaging device 50 has a wireless communication function, the UE 40 may be the imaging device 50.

[0157] The (R)AN 630 has a function of enabling connection to a Radio Access Network (RAN) and connection to an Access Network (AN) other than the RAN. The (R)AN 630 includes a base station called a gNB or ng-eNB.

[0158] The core network CN mainly performs connection permission and session management when the UE 40 connects to the network. The core network CN includes a user plane function group 620 and a control plane function group 640.

[0159] The user plane function group 620 includes a UPF (User Plane Function) 621 and a DN (Data Network) 622. The UPF 621 has a user plane processing function. The UPF 621 includes a routing / transfer function for data handled in the user plane. The DN 622 has a function to provide connection to an operator's own service, such as an MNO (Mobile Network Operator), a function to provide Internet connection, or a function to provide connection to a third-party service. In this way, the user plane function group 620 plays the role of a gateway that serves as the boundary between the core network CN and the Internet.

[0160] The control plane function group 640 includes an Access Management Function (AMF) 641, a Session Management Function (SMF) 642, an Authentication Server Function (AUSF) 643, a Network Slice Selection Function (NSSF) 644, a Network Exposure Function (NEF) 645, a Network Repository Function (NRF) 646, a Policy Control Function (PCF) 647, a Unified Data Management (UDM) 648, and an Application Function (AF) 649.

[0161] The AMF 641 has functions such as registration processing, connection management, and mobility management for the UE 40. The SMF 642 has functions such as session management, IP allocation and management for the UE 40, etc. The AUSF 643 has an authentication function. The NSSF 644 has a function related to network slice selection. The NEF 645 has a function of providing network function capabilities and events to third parties, the AF 649, and edge computing functions.

[0162] The NRF 646 has the function of discovering network capabilities and maintaining network capability profiles. The PCF 647 has the function of policy control. The UDM 648 has the function of generating 3GPP AKA authentication information and processing user identities. The AF 649 has the function of interacting with the core network to provide services.

[0163] For example, the control plane function group 640 acquires information from the UDM 648 in which subscriber information of the UE 40 is stored, and determines whether or not the UE 40 may connect to the network. For this determination, the control plane function group 640 uses the contract information of the UE 40 and an encryption key contained in the information acquired from the UDM 648. The control plane function group 640 also generates encryption keys, etc.

[0164] That is, the control plane function group 640 determines whether or not the UE 40 can connect to the network depending on whether or not information about the UE 40 linked to a subscriber number called an IMSI (International Mobile Subscriber Identity) is stored in the UDM 648. The IMSI is stored in a SIM (Subscriber Identity Module) card in the UE 40, for example.

[0165] Here, Namf is a service-based interface provided by the AMF 641, and Nsmf is a service-based interface provided by the SMF 642. Furthermore, Nnef is a service-based interface provided by the NEF 645, and Npcf is a service-based interface provided by the PCF 647. Nudm is a service-based interface provided by the UDM 648, and Naf is a service-based interface provided by the AF 649. Nnrf is a service-based interface provided by the NRF 646, and Nnssf is a service-based interface provided by the NSSF 644. Nausf is a service-based interface provided by the AUSF 643. Each of these NFs (Network Functions) exchanges information with other NFs via each service-based interface.

[0166] 14, N1 is a reference point between the UE 40 and the AMF 641, and N2 is a reference point between the RAN / AN 630 and the AMF 641. N4 is a reference point between the SMF 642 and the UPF 621, and information is exchanged between these NFs (Network Functions).

[0167] The core network CN provides an interface for transmitting information and controlling functions via an application programming interface (API) called a service-based interface.

[0168] The API allows a resource to be specified, and enables operations such as GET (obtaining a resource), POST (creating a resource or adding data), PUT (creating a resource or updating a resource), and DELETE (deleting a resource) to that resource. Such functions are commonly used in, for example, web-related technical fields.

[0169] For example, when establishing a communication session, the AMF 641, the SMF 642, and the UDM 648 shown in Fig. 14 exchange information with each other using APIs. Conventionally, it has not been assumed that an application (e.g., the AF 649) will use such an API. However, by the AF 649 using such an API, the AF 649 can use information on a 5G cellular network, thereby further improving the functionality of the application.

[0170] 2-7. RAN Architecture The O-RAN (Open Radio Access Network) architecture defined by the O-RAN Alliance can be applied to the radio access network (RAN) of the imaging system 1. Hereinafter, the O-RAN architecture will be described as an example of the architecture of the RAN of the imaging system 1.

[0171] It should be noted that the RAN architecture applied to the imaging system 1 is not limited to the O-RAN architecture. For example, the RAN architecture applied to the imaging system 1 may be the RAN architecture defined by the xRAN Forum or the RAN architecture defined by the C-RAN Alliance. Of course, the RAN architecture applied to the imaging system 1 may be a RAN architecture other than these.

[0172] Fig. 15 is a diagram showing an example of a RAN architecture applied to the imaging system 1. Specifically, Fig. 15 is a diagram showing the O-RAN architecture defined by the O-RAN Alliance.

[0173] In O-RAN, RAN Intelligent Controller (RIC) is defined as a control unit that makes RAN functions intelligent. There are two types of RIC, Non-Real Time RIC (hereinafter also referred to as Non-RT RIC) and Near-Real Time RIC (hereinafter also referred to as Near-RT RIC), which have different control periods.

[0174] The Non-RT RIC is responsible for policy generation, notification, control, etc. related to RAN control. The Non-RT RIC operates at a longer control cycle than the Near-RT RIC. The Non-RT RIC is located inside the Service Management and Orchestration (SMO), which performs RAN maintenance and orchestration.

[0175] The Near-RT RIC is a RIC that performs processing related to the network functions of the O-RAN (for example, at least one of the O-CU-CP (O-RAN Central Unit Control Plane), the O-CU-UP (O-RAN Central Unit User Plane), the O-DU (O-RAN Distributed Unit Control Plane), and the O-RU (O-RAN Radio Unit)). The Near-RT RIC collects information from the network functions of the O-RAN. The Near-RT RIC then controls the network functions of the O-RAN in accordance with policies notified from the Non-RT RIC via the A1 interface. The network functions of the O-RAN are connected to the NG-Core via the NG interface. The NG-Core is, for example, 5GC (5G Core).

[0176] The SMO may control not only NFs (Network Functions) such as O-CU and O-DU, but also the Cloud. For example, the SMO may be provided with an interface with an external network (O2 interface). The SMO may then control the O-Cloud via the O2 interface. The O-Cloud is a virtualization platform that provides virtual resources to an NF Deployment that defines virtual resources for vRAN applications. The SMO may also be connected to an O-RAN Radio Unit (O-RU) and perform management such as maintenance or monitoring of the O-RU. The SMO may also operate in cooperation with other domains. For example, the SMO may operate in cooperation with an Application Function (AF).

[0177] It should be noted that the RAN architecture applied to the imaging system 1 is not limited to the architecture shown in Fig. 15. For example, the RAN architecture applied to the imaging system 1 may be the RAN architecture shown in Fig. 16. Fig. 16 is a diagram showing another example of the RAN architecture applied to the imaging system 1.

[0178] The SMO may include network functions that manage domains other than the RAN (e.g., core network and / or transport). In the figure, VNF stands for Virtual Network Function, and PNF stands for Physical Network Function. NFVI (NFV Infrastructure) is an infrastructure (e.g., physical resources and virtualization functions) for executing VNF (Network Functions Virtualization).

[0179] As shown in FIG. 16, an AF (Application Function) may be connected to the SMO and the core network via a common API.

[0180] <<3. Specific Configuration Example of the Photography System>> The configuration of the photography system 1 has been described above, but before describing the operation of the photography system 1, a specific configuration example of the photography system 1 will be described. Note that the configuration of the photography system 1 is not limited to the configuration shown below.

[0181] 17 is a diagram showing the configuration of an imaging system 1 according to configuration example 1. The imaging system 1 according to configuration example 1 includes a wireless camera system, a wired camera system, an integrated control unit, an information processing device 10 (switcher and camera selector), a decoder, a conversion unit, and a display (master monitor).

[0182] The wireless camera system includes an imaging device 50, a terminal device 40, a 5G network, and an AF (Application Function). The 5G network includes a base station 30 and a management device 20. In the wireless camera system, the imaging device 50 is wirelessly connected to the information processing device 10 via the 5G network. In the example of FIG. 17 , the imaging device 50 is connected to the 5G network via the terminal device 40. However, if the imaging device 50 has a wireless communication function, the imaging device 50 may be directly connected to the 5G network. Furthermore, if some of the camera's functions (e.g., an encoder) are provided as a separate device from the imaging device 50, the imaging device 50 may be connected to the 5G network via the separate device in addition to the terminal device 40.

[0183] The 5G network is not limited to a 5G network constructed as SA (Stand Alone), and may be, for example, a 5G network constructed as NSA (Non-Stand Alone).

[0184] The wired camera system includes an image capture device 50, a camera control unit (CCU), a network switch, and an AF. In the wired camera system, the image capture device 50 is connected to the information processing device 10 by wire via the camera control unit (CCU) and the network switch.

[0185] The video captured by the imaging device 50 is input to the conversion unit via a decoder. The video signal decoded by the decoder is converted by the conversion unit and output to a display (a master monitor in the example of FIG. 17).

[0186] The information processing device 10 (a switcher and a camera selector in the example of FIG. 17 ) controls one or more wired imaging devices 50 and one or more wirelessly connected imaging devices 50 via an integrated control unit. For example, the information processing device 10 transmits a tally signal to one or more wired or wirelessly connected imaging devices 50. The tally signal may be transmitted via a UPF included in the core network of the 5G network. The information processing device 10 transmits information for priority control of wireless resources (tally information) to the AF via the integrated control unit. The AF performs priority control of wireless resources via an NEF included in the core network of the 5G network. For example, the AF sets a 5QI (5G QoS Identifier).

[0187] <3-2. Configuration Example 2> Figure 18 is a diagram showing the configuration of an imaging system 1 according to Configuration Example 2. The imaging system 1 according to Configuration Example 2 includes an imaging device 50, a terminal device 40, a 5G network, an AF (Application Function), an information processing device 10 (switcher and camera selector), a decoder, a conversion unit, and a display (master monitor). The 5G network includes a base station 30 and a management device 20. Note that in Configuration Example 2, the imaging system 1 does not include a wired camera system or an integrated control unit. However, like the imaging system 1 according to Configuration Example 1, the imaging system 1 according to Configuration Example 2 may also include a wired camera system and an integrated control unit.

[0188] In the example of FIG. 18, the AF and the 5G network are connected via a common API (Application Programming Interface). The common API is an interface that enables functions to be used without differences due to implementation dependency. The common API may be implemented in the core network. The common API may also be built on a server (e.g., a multi-access edge computing (MEC) server) or a cloud platform that can be connected to the core network. The common API may also be referred to as shared API software, service API, service API software, format conversion unit, or the like.

[0189] <3-3. Configuration Example 3> Figure 19 is a diagram showing the configuration of an imaging system 1 according to Configuration Example 3. The imaging system 1 according to Configuration Example 3 includes an imaging device 50, a terminal device 40, a 4G network, an AF, an information processing device 10 (switcher and camera selector), a decoder, a conversion unit, and a display (master monitor). Note that in Configuration Example 3, the imaging system 1 does not include a wired camera system or an integrated control unit. However, like the imaging system 1 according to Configuration Example 1, the imaging system 1 according to Configuration Example 3 may also include a wired camera system and an integrated control unit.

[0190] The 4G network may be a pure 4G network or a 5G network built as a non-stand alone (NSA). In the 4G network, the core network is a network terminated not by a UPF but by a Packet Data Network Gateway (PGW) / Serving Gateway (SGW). In the 4G network, the NEF is a Service Capability Exposure Function (SCEF). The control target of the AF is not 5QI but QCI (QoS Class Identifier).

[0191] <3-4. Configuration Example 4> Figure 20 is a diagram showing the configuration of an imaging system 1 according to Configuration Example 4. The imaging system 1 according to Configuration Example 4 includes an imaging device 50, a terminal device 40, a 5G network, an AF (Application Function), an information processing device 10 (switcher and camera selector), a decoder, a conversion unit, and a display (master monitor). Note that in Configuration Example 4, the imaging system 1 does not include a wired camera system or an integrated control unit. However, like the imaging system 1 according to Configuration Example 1, the imaging system 1 according to Configuration Example 4 may also include a wired camera system and an integrated control unit.

[0192] In configuration example 4, multiple slices (in the example of Figure 20, slice A and slice B) are constructed between a device such as the terminal device 40 and the UPF (or N6 (see Figure 14) which is the terminal of the DN (Data Network)). Slice A is a slice for the imaging system 1 (e.g., for a video transmission system). Slice B is a slice for general users (e.g., users other than users of the imaging system 1). The imaging device 50 (or the terminal device 40) uses slice A to transmit imaging data. Devices of general users (e.g., users other than the imaging system 1) use slice B to connect to networks (e.g., the Internet or a public network) according to their respective purposes. In configuration example 4, the control target of the information processing device 10 (or AF) is slice A.

[0193] The slices to be controlled are not limited to slices for the video transmission system. For example, the slices to be controlled may be video slices. Furthermore, slices with different characteristics may be prepared for each traffic type required by the imaging system 1.

[0194] 21 is a diagram showing the configuration of an imaging system 1 according to configuration example 5. The imaging system 1 according to configuration example 5 includes an imaging device 50, a terminal device 40, a 4G network, an AF (Application Function), an information processing device 10 (switcher and camera selector), a decoder, a conversion unit, and a display (master monitor). Note that in configuration example 5, the imaging system 1 does not include a wired camera system or an integrated control unit. However, like the imaging system 1 according to configuration example 1, the imaging system 1 according to configuration example 5 may also include a wired camera system and an integrated control unit.

[0195] If the cellular network is a 4G network, multiple logical networks may be constructed using DECORE (Dedicated Core Networks). In configuration example 5, multiple logical networks (logical network A and logical network B in the example of FIG. 21 ) are constructed between devices such as the terminal device 40 and the PGW. Logical network A is a logical network for the imaging system 1 (e.g., for a video transmission system). Logical network B is a logical network for general users (e.g., users other than users of the imaging system 1). The imaging device 50 (or the terminal device 40) transmits imaging data using logical network A. Devices of general users (e.g., users other than the imaging system 1) use logical network B to connect to networks (e.g., the Internet or a public network) according to their respective purposes. In configuration example 5, the control target of the information processing device 10 (or AF) is logical network A.

[0196] <<4. Operation of the Imaging System>> Based on the above, we will now describe the operation of the imaging system 1. In the following description, it is assumed that the information processing device 10 is a switcher and a camera selector, but the information processing device 10 is not limited to a switcher and a camera selector.

[0197] 22 is a diagram for explaining the operation of the photographing system 1 according to this embodiment. In this embodiment, the photographing device 50 designated as a camera related to a predetermined process by a tally signal is １ (or imaging device 50 １ Terminal device 40 connected to １ ) and the imaging device 50 that is not designated as a camera related to a predetermined process by the tally signal. ２ (or imaging device 50 ２ Terminal device 40 connected to ２ ) and are present in the same cell. The process according to this embodiment can be applied not only to a single-cell environment but also to a multi-cell environment. In this case, the process according to the embodiment shown below can be applied to each cell.

[0198] The imaging device 50 may be directly connected to the wireless network, or may be indirectly connected to the wireless network, for example, via a terminal device 40. In the following description, the terminal device 40 that is directly or indirectly connected to the imaging device 50 and transmits captured data to another device via the wireless network may also be referred to as the imaging device 50. In the following description, the term "imaging device 50" may be replaced with "terminal device 40" or "imaging device 50 or terminal device 40 connected to the imaging device 50." Similarly, "imaging device 50" Ｘ " means "terminal device 40 Ｘ " or "imaging device 50 Ｘ or imaging device 50 Ｘ Terminal device 40 connected to Ｘ " where X is any integer (1, 2, 3, ...).

[0199] <Transmission of Tally Signal> First, the first transmitter 131 of the information processing device 10 transmits a tally signal to the imaging device 50. The tally signal is a control signal transmitted from the information processing device 10 to the imaging device 50. For example, the tally signal is a control signal including information (first control information) for designating one or more of the two or more imaging devices 50 as cameras for a predetermined process. Alternatively, the tally signal is a control signal assigned the role of the first control information. The tally signal may be regarded as the first control information itself. Generally, the tally signal is a signal including information indicating whether a tally lamp is on or off and / or information regarding the color of the tally lamp. The TSL UMD protocol is generally used to transmit the tally signal. Note that, although a tally signal generally does not include camera identification information, the tally signal of this embodiment may include identification information of the imaging device 50. The information processing device 10 may transmit text information to a display and / or other broadcasting / distribution equipment (server) so that the display can identify which imaging device 50 the video is from. By transmitting a tally signal, the information processing device 10 designates, for example, one or more of the two or more imaging devices 50 as cameras related to a specified process (for example, cameras that capture video to be broadcast / distributed).

[0200] Depending on the format of the tally signal, multiple types of tally signals may be provided. For example, depending on the format, multiple types of tally signals that cause the tally lamp to light up in different colors may be provided. For example, the tally signals may include a first tally signal that causes the tally lamp to light up in a first color (e.g., red) and a second tally signal that causes the tally lamp to light up in a second color (e.g., green). Note that the types of tally signals are not limited to these two. For example, the tally signals may include a third tally signal that causes the tally lamp to light up in a third color (e.g., yellow). Of course, there may be four or more types of tally signals. Furthermore, the multiple types of tally signals may include a signal that specifies that the tally lamp should not be turned on.

[0201] The association between the type of tally signal and the role of the image capture device 50 can be determined arbitrarily by the user / developer. For example, the image capture device 50 that has transmitted a first tally signal (e.g., a red tally signal) may be assigned the role of capturing program-out video (e.g., high-quality, low-latency video). The image capture device 50 that has transmitted a second tally signal (e.g., a green tally signal) may be assigned another role (e.g., the role of capturing video for at least one of editing, recording, analysis, and 3D data generation).

[0202] In addition, the imaging device 50 that transmits the first tally signal (e.g., red tally signal) may be assigned the highest priority (first priority), the imaging device 50 that transmits the second tally signal (e.g., green tally) may be assigned the next highest priority (second priority), and the imaging device 50 that transmits the third tally signal (e.g., yellow tally) may be assigned the next highest priority (third priority).

[0203] <Transmission of Tally Information> The second transmission unit 132 of the information processing device 10 transmits tally information (second control information) to an AF (Application Function). The content of the second control information may be the same as the content of the first control information. The information processing device 10 may transmit the second control information together with the first control information as a tally signal to the network device. Furthermore, the information processing device 10 may transmit the second control information to the network device separately from the tally signal.

[0204] A network device is a device that performs processing related to the allocation of wireless resources. For example, a network device is a device that constitutes a wireless network. For example, a network device may be a device that constitutes a core network (e.g., a management device 20) or a device that constitutes a wireless access network (e.g., a base station 30). A network device may be a device that has a function as an AF (e.g., a management device 20 or another information processing device 10).

[0205] The tally information (second control information) is linked to the tally signal (first control information). That is, the information processing device 10 designates the imaging device 50, which has been designated with a predetermined priority in the first control information, as the imaging device 50 related to the priority control of wireless resources.

[0206] The information processing device 10 includes an imaging device 50 １ is designated as the imaging device 50 with the first priority, and ２ In this case, the information processing device 10 selects the imaging device 50 as the imaging device with the second priority. １ The image capturing device 50 generates tally information (second control information) for preferentially allocating wireless resources to the image capturing device 50. １ and the imaging device 50 ２ and exist in the same cell, the imaging device 50 ２ Priority is given to the imaging device 50 １ The information processing device 10 may transmit the generated tally information (second control information) to a network device (for example, an AF).

[0207] <Identification of Image Capturing Device Subject to Priority Control> When transmitting a tally signal / tally information, the information processing device 10 needs to identify which device on the network is the image capturing device 50 that is subject to priority control.

[0208] Therefore, the information processing device 10 may retain information for associating the identification information of the imaging device 50 on the system (hereinafter referred to as first identification information) with the identification information of the imaging device 50 on the network (hereinafter referred to as second identification information). Here, the first identification information is, for example, an ID that is the destination of the tally signal. The second identification information is, for example, the identification information of the imaging device 50 on the cellular network. For example, the second identification information is the identification information of the UE / SIM. The information processing device 10 may identify the imaging device 50 that is to be the target of priority control based on this association information.

[0209] 23 is a diagram showing an example of association information that associates first identification information with second identification information. In the figure, a camera ID is the first identification information, and an IMSI is the second identification information. The IMSI (International Mobile Subscription Identity) is identification information stored in the SIM (Subscriber Identity Module) of the imaging device 50 or the terminal device 40.

[0210] The first identification information does not necessarily have to be a camera ID. The information processing device 10 may use an ID corresponding to the connection environment, such as a session ID, to transmit a tally signal. The second identification information is not limited to an IMSI. The second identification information may be an IMEI (International Mobile Equipment Identifier) ​​held by the imaging device 50 or the terminal device 40, or a MAC (Media Access Control) address. The second identification information may also be an IP address used for connecting to a cellular network.

[0211] The information processing device 10 does not necessarily have to store association information between the first identification information and the second identification information. For example, the information processing device 10 may acquire information about the cells to which each image capture device 50 is connected from an AF (Application Function). The information processing device 10 may identify the image capture device 50 to be subject to priority control based on the information acquired from the AF.

[0212] Furthermore, the identification of the imaging device to be the priority control target may be shared between the AF and the information processing device 10. For example, the AF may hold association information between the first identification information and the second identification information. Then, the information processing device 10 may transmit the first identification information (for example, the camera ID shown in FIG. 23 ) to the AF as tally information. The AF may identify the imaging device 50 to be the priority control target based on the first identification information acquired from the information processing device 10.

[0213] <Priority Control> Next, priority control by a network device will be described. In the following description, it is assumed that the network device to which the tally information (second control information) is transmitted is an AF. Note that the network device is not limited to an AF.

[0214] The AF determines the priority of the image capture device 50 on a cell-by-cell basis based on tally information (second control information) provided from the switcher and camera selector. In the example of FIG. 22, the image capture device 50 with the red lamp lit １ and the imaging device 50 whose tally lamp is not lit. ２ and are located in the same cell. １ is the imaging device 50 designated by the tally signal as a camera related to a predetermined process (for example, a camera for capturing video related to broadcasting / distribution), and the imaging device 50 ２ is an imaging device 50 designated as a camera related to other roles (for example, the role of capturing video for at least one of editing, recording, analysis, and 3D data generation).

[0215] In this case, the AF is performed by the imaging device 50 １ The priority of the image capture device 50 ２The information processing device 10 (switcher and camera selector) may determine the priority as higher than the priority of the imaging device 50. In this case, the information processing device 10 transmits the tally information (second control information) to the AF. １ The information may be information requesting that radio resources be preferentially allocated to the

[0216] The AF performs priority control so that an imaging device 50 with a higher priority can transmit image data in preference to an imaging device 50 with a lower priority. For example, if an imaging device 50 with a tally lamp lit in the same cell １ and the imaging device 50 with the tally lamp not lit. ２ If there is a difference, the AF is １ is the imaging device 50 ２ QoS control is performed so that the captured image data can be transmitted with priority over the AF function. Note that the information processing device 10 may have an AF function and perform priority control (e.g., QoS control). Note that the QoS control may be QoD (Quality of Demand) control.

[0217] The priority control performed by the AF may be either of the following priority control example 1 and priority control example 2. Of course, the priority control performed by the AF is not limited to the following priority control example 1 and priority control example 2.

[0218] (Priority Control Example 1) The AF sets a priority to the core network CN via the NEF using AFsessionWithQoS. For example, the AF sets a priority to an image capture device 50 with a high priority (for example, an image capture device 50 with a tally lamp lit). １ ) is assigned a QoS reference ID associated with 5QI=3. On the other hand, an image capture device 50 with a high priority (for example, an image capture device 50 with a red tally lamp lit) is assigned a QoS reference ID associated with 5QI=3. １), the AF specifies a QoS Reference ID associated with 5QI=7. Note that the 5QI value shown here is merely an example. The AF may specify another value as the 5QI. In addition, in the case of 4G and 5G NSA (Non Stand Alone), the AF may set the priority in ASsessionWithQoS via SCEF (Service Capability Exposure Function), or may perform priority control using other APIs, etc.

[0219] The AF may set the priority using a priority level or ARP (Allocation and Retention Priority) instead of the 5QI value. If the core network is a 4G core network, the AF may set the QCI value.

[0220] In addition, the AF is performed by the imaging device 50 according to the priority currently set in the imaging device 50. １ Should we increase the priority of the image capture device 50? ２ The AF may then perform priority control (for example, QoS control) based on the determination result.

[0221] (Priority Control Example 2) When the wireless access network of the photography system 1 is constructed in accordance with the above-described O-RAN architecture, the AF transmits information about the prioritized image capture device 50 to the Non-RT RIC in the SMO based on the tally information (second control information). This information may be the priority of the image capture device 50 or identification information of the prioritized image capture device 50. The Non-RT RIC that receives the information from the AF may execute at least one of the processes shown in (A1) to (A5) below.

[0222] (A1) Processing Example 1 The non-RT RIC may notify the O-DU of priority information of the imaging device 50 via the O1 interface. The O-DU may identify the imaging devices 50 on a cell-by-cell basis and allocate radio resources to the imaging device 50 that should be prioritized. In addition, the non-RT RIC may also notify the O-CU of the priority information. The O-CU may then perform at least one of the following controls: suppression of handover of the imaging device 50 that should be prioritized; suppression of handover of other imaging devices 50 to the corresponding cell; and offloading of other imaging devices 50 to other cells. The O-CU may also utilize this information in call processing of the cell in which the imaging device 50 is located, such as rejecting new calls (calls from non-priority imaging devices 50). This maximizes the Tput of the imaging device 50 and reduces the impact on jitter / round-trip time (RTT).

[0223] (A2) Processing Example 2 The Non-RT RIC may notify the Near-RT RIC of priority information for the imaging device 50 via the A1 interface. The Near-RT RIC may identify the imaging device 50 on a cell-by-cell basis and allocate radio resources to the imaging device 50 that should be prioritized. By implementing an algorithm (e.g., ML Model) in the xApp of the Near-RT RIC, data collection / control in close cooperation with the CU / DU becomes possible. As a result, RAN resource control and call processing can be performed in a shorter cycle than when performed solely by the Non-RT RIC. Furthermore, if necessary, the Non-RT RIC may set a policy to the Near-RT RIC. This allows information on the imaging device 50 that should be prioritized to be used in radio resource control by the Near-RT RIC.

[0224] (A3) Processing Example 3 The SMO may have a network function that manages domains other than the RAN (e.g., a core network and transport). In this case, the Non-RT RIC may perform resource management of the core network and / or transport using information about the imaging device 50 that should be prioritized.

[0225] (A4) Processing Example 4 The SMO may have a network function that controls the O-Cloud. In this case, the Non-RT RIC may control resource allocation in the O-Cloud using information about a prioritized imaging device 50. For example, the Non-RT RIC may identify a container on the O-Cloud that processes the CU / DU that contains the cell of the prioritized imaging device 50, based on the information about the prioritized imaging device 50. Then, the Non-RT RIC may increase the resources (e.g., the number of CPUs and / or memory capacity) allocated to the container.

[0226] (A5) Processing Example 5 The Non-RT RIC may combine the processing shown in (A3) and the processing shown in (A4) to perform priority control of cloud resources of other domains, for example, as in MANO (Management and Network Orchestration).

[0227] <Example of Distribution of Wireless Leases> The network device may distribute wireless resources to the imaging device 50 as follows. Here, the network device may be a device constituting a wireless access network (e.g., the base station 30), a device constituting a core network (e.g., the management device 20), or a device having an AF function. The device that determines the distribution amount of wireless resources is not limited to the network device. The device that determines the distribution amount of wireless resources may be the information processing device 10.

[0228] An example of distribution of wireless resources to one or more imaging devices 50 whose priority is higher than a predetermined threshold and one or more imaging devices 50 whose priority is equal to or lower than the predetermined threshold will be described below.

[0229] (Distribution example 1) The total amount of radio resources is RB total RB H (i) The number of low-priority imaging devices 50 is N L Here, i is 1≦i≦N H Satisfy. N Ｈ is the number of imaging devices 50 with high priority.

[0230] At this time, the network device may set the amount of wireless resources that can be used by one imaging device 50 with a low priority to the amount calculated by the following formula (1): {RB total -ΣRB H (i) / N L …(1)

[0231] (Distribution example 2) The total amount of radio resources is RB total , the minimum wireless resource allocation amount for each of the imaging devices 50 with high priority is RB H_min (i) The minimum wireless resource allocation amount for each imaging device 50 with low priority is RB L_min (j), where i is 1≦i≦N H and j is 1≦j≦N L Satisfy N L is the number of imaging devices 50 with low priority.

[0232] In addition, the amount of wireless resources used by all the imaging devices 50 with high priority is ΣRB H_min (i) where Σ is 1≦i≦N H In addition, the amount of wireless resources used by all the imaging devices 50 with low priorities is ΣRB L_min (j), where Σ is 1≦j≦N L This is the sum of the cases where

[0233] At this time, if the result of subtracting the minimum amount of wireless resources allocated from the total amount of wireless resources is greater than 0 (i.e., if the following formula (2) is satisfied), the network device allocates wireless resources to the imaging device 50 with a relatively high priority. total -ΣRB H_min (i)-ΣRB L_min (j)>0 … (2)

[0234] <Transmission of image capture data> Fig. 24 is a diagram for explaining the control of allocation of wireless resources. More specifically, Fig. 24 is a diagram for explaining the control of allocation of wireless resources when the camera related to a predetermined process is switched to another image capture device 50.

[0235] The receiving unit 531 of the imaging device 50 receives a tally signal (first control information) from the information processing device 10. Then, the imaging device 50 turns on the tally lamp based on the received tally signal. １ and the imaging device 50 ２ Among these, the imaging device 50 １ The imaging device 50 with the first priority is the imaging device 50 ２ is designated as the imaging device 50 with the second priority. In this case, the network device (for example, the management device 20 and / or the base station 30) ２ The imaging device 50 takes priority over １ The radio resource is allocated to the imaging device 50. １ is the imaging device 50 １ The radio resource allocated to the camera is used to transmit the captured image data.

[0236] In addition, the imaging device 50 located in the same cell １ and the imaging device 50 ２ and the imaging device 50 ３ Among these, the imaging device 50 １ The imaging device 50 with the first priority is the imaging device 50 ２ The imaging device 50 with the second priority, the imaging device 50 ３ is designated as the imaging device 50 with the lowest priority. In this case, the network device (for example, the management device 20 and / or the base station 30) ３ The imaging device 50 takes priority over １ and imaging device 50 ２ The radio resource is allocated to the imaging device 50. １ and imaging device 50 ２ is the imaging device 50 １ and imaging device 50 ２ The radio resource allocated to the camera is used to transmit the captured image data.

[0237] As a result, the imaging device 50 ３ Even if the wireless resources used in the entire network increase as a result of the imaging device 50 leaving the cell, １ and imaging device 50 ２ can transmit the captured data stably.

[0238] <Switching of imaging device> When an operator performs an operation to switch cameras, the information processing device 10 transmits a tally signal (first control information) to the imaging device 50 to which the camera is switched, and also transmits tally information (second control information) linked to the tally signal (first control information) to the AF.

[0239] The camera involved in the predetermined processing is the imaging device 50 １ from the imaging device 50 ２ When the image capturing device 50 is switched to the image capturing device 50, the information processing device 10 １ Priority is given to the imaging device 50 ２ For example, when the image capture device 50 with the first priority is the image capture device 50, the image capture device 50 transmits control information for allocating wireless resources to the image capture device 50 as tally information (second control information) to the AF. １ from the imaging device 50 ２ In this case, the information processing device 10 changes the image capture device 50 １ Priority is given to the imaging device 50 ２ The network device (e.g., AF) transmits tally information (second control information) for allocating wireless resources to the AF. When the network device detects a change in priority from the tally information (second control information), the network device changes the priority through QoS control.

[0240] <<5. Example of Sequence>> The operation of the photography system 1 has been described above. Next, an example of a sequence of processing executed by the photography system 1 will be described.

[0241] As described above, the terminal device 40 that is directly or indirectly connected to the imaging device 50 and transmits captured image data to other devices via a wireless network may also be referred to as the imaging device 50. In this sequence example, the term "imaging device 50" may also be replaced with "terminal device 40" or "imaging device 50 or terminal device 40 connected to the imaging device 50."

[0242] In the following description, a priority equal to or higher than a predetermined threshold value may be referred to as a high priority, and a priority lower than the predetermined threshold value may be referred to as a low priority. For example, a high priority may be a first priority, and a low priority may be another priority (e.g., a second priority, or a second and third priority). A low priority may be the lowest priority, and a high priority may be an imaging device 50 with another priority (e.g., a first and second priority, or a first to third priority).

[0243] <5-1. Camera Priority Setting Process> An example sequence of the camera priority setting process will be described. The camera priority setting process is a process for setting the priority of a camera related to a predetermined process (for example, an imaging device 50 that captures video related to broadcasting / distribution). The camera priority setting process is also a process for setting the priority of a camera related to a predetermined process (for example, an imaging device 50 that captures video related to image quality adjustment of camera video).

[0244] 25 is a sequence diagram showing an example of camera priority setting processing. In the figure, UE is the terminal device 40, and CAM is the imaging device 50. In the following explanation, it is assumed that two terminal devices 40 / imaging devices 50 (UE / CAM A and UE / CAM B) are located in the same cell. The camera priority setting processing will be explained below with reference to FIG. 25. Here, the camera priority setting processing S100 is performed by an operator, and the camera priority setting processing S200 is performed by an engineer.

[0245] The switcher as the information processing device 10 receives a camera switching request from an operator (step S101). Then, the information processing device 10 transmits a tally and camera information to the AF (step S102). In the example of Fig. 25, the camera information includes control information that designates CAM A as the imaging device 50 with a high priority.

[0246] The AF transmits a tally and camera information to the RAN / core network. The AF may transmit control information based on the first control information to the RAN / core network (step S103). For example, if the core network is 5GC, the AF may transmit priority setting information regarding the wireless communication of each of multiple wireless devices located in the same cell via the NEF. For example, the AF may transmit control information via the NEF to set a high priority 5QI for the wireless communication of UE / CAM A. The AF may also transmit the control information to the RAN / core network via API Wrap. Furthermore, if the AF does not have information about other imaging devices 50 in the same cell, the AF may inquire of the RAN / 5GC.

[0247] The RAN / core network sets priority control for wireless communication of the imaging device 50 based on the control information (step S104). That is, CAM A is set as the imaging device 50 with a high priority so that wireless resources for CAM A are secured. When the setting is complete, the RAN / core network notifies the AF of completion (step S105). Furthermore, the AF transmits a completion notification to the information processing device 10 (step S106).

[0248] The information processing device 10 transmits a tally signal to the imaging device 50 that has been assigned a high priority (CAM A in the example of FIG. 25 ) (step S107). For example, the information processing device 10 may transmit a tally signal to CAM A to turn on a tally lamp in red. Note that the information processing device 10 may transmit a tally signal to another imaging device 50 to turn off a tally lamp or to change the color of a tally lamp. The imaging device 50 turns on / off the tally lamp in accordance with the tally signal. Alternatively, the imaging device 50 changes the color of the tally lamp in accordance with the tally signal.

[0249] The information processing device 10 may transmit the tally information in step S102 after transmitting the tally signal in step S107. That is, the processes of steps S102 to S107 may be executed after the process of step S107. Furthermore, the information processing device 10 may simultaneously transmit the tally signal in step S107 and the initial information in step S102.

[0250] Once the transmission of the tally signal is complete, the information processing device 10 performs a process of switching the camera related to the predetermined process (step S108). For example, the information processing device 10 controls the broadcasting / distribution equipment to switch the video to be on-air (live distributed) to the video captured by CAM B. Once the switching is complete, the information processing device 10 notifies the operator of the completion (step S109).

[0251] On the other hand, the camera selector as the information processing device 10 receives a camera selection request from an engineer (step S201). Then, the information processing device 10 transmits camera information to the AF (step S202). In the example of Fig. 25, the camera information includes control information that designates CAM B as the imaging device 50 with the second highest priority after CAM A.

[0252] The AF transmits camera information to the RAN / core network. The AF may transmit control information based on the first control information to the RAN / core network (step S203). For example, if the core network is 5GC, the AF may transmit priority setting information regarding the wireless communication of each of multiple wireless devices located in the same cell via the NEF. For example, the AF may transmit control information via the NEF to set a high priority 5QI for the wireless communication of UE / CAM B. The AF may also transmit the control information to the RAN / core network via API Wrap. Furthermore, if the AF does not have information on other imaging devices 50 in the same cell, the AF may inquire of the RAN / 5GC.

[0253] The RAN / core network sets priority control for wireless communication of the imaging device 50 based on the control information (step S204). That is, CAM B is set as the imaging device 50 with the second highest priority after CAM A so that wireless resources for CAM B are secured. When the setting is complete, the RAN / core network notifies the AF of completion (step S205). Furthermore, the AF transmits a completion notification to the information processing device 10 (step S206). Then, the information processing device 10 transmits a selection completion notification to the engineer (step S207).

[0254] The engineer uses CAM B to preview the video and adjust the image quality (adjust the camera parameters) (step S208). When the engineer completes the image quality adjustment of CAM B, the engineer transmits an image quality adjustment signal to the information processing device 10 (step S209). The information processing device 10 transmits the image quality adjustment signal to CAM B (step S210). Every time the engineer performs image quality adjustment (adjustment of the camera parameters) using CAM B, the engineer transmits an image quality adjustment signal to the information processing device 10 (step S211), and the information processing device 10 transmits the image quality adjustment signal to CAM B (step S212).

[0255] 26 is a sequence diagram showing an example of the camera priority cancellation process, in which the camera priority cancellation process S300 is performed by an engineer.

[0256] The camera selector as the information processing device 10 receives a camera deselection request from an engineer (step S301). Then, the information processing device 10 transmits camera information to the AF (step S302). In the example of Fig. 26, the camera information includes control information for canceling the designation of CAM B as the image capture device 50 with the second highest priority after CAM A.

[0257] The AF transmits camera information to the RAN / core network. The AF may transmit control information based on the first control information to the RAN / core network (step S303). For example, if the core network is 5GC, the AF may transmit priority setting information regarding the wireless communication of each of multiple wireless devices located in the same cell via the NEF. For example, the AF may transmit control information via the NEF to cancel the setting of a high-priority 5QI for the wireless communication of UE / CAM B. The AF may also transmit the control information to the RAN / core network via API Wrap. Furthermore, if the AF does not have information on other imaging devices 50 in the same cell, the AF may inquire of the RAN / 5GC.

[0258] The RAN / core network cancels the setting of priority control related to wireless communication of the imaging device 50 based on the control information (step S304). That is, the setting of CAM B as the imaging device 50 with the second highest priority after CAM A is canceled so that wireless resources for CAM B do not need to be reserved. When the cancellation is complete, the RAN / core network notifies the AF of the completion (step S305). Furthermore, the AF transmits a completion notification to the information processing device 10 (step S306). Then, the information processing device 10 transmits a selection cancellation completion notification to the engineer (step S307).

[0259] <5-3. Camera Selection Processing> FIG. 27 is a flowchart showing an example of a switching process during camera selection. In step S11, the AF receives a camera selection signal from the switcher or camera selector. In step S12, the AF checks the database to see if the target camera has already been set to high priority. If the AF determines that the target camera has not yet been set to high priority (No), it updates the status of the database in step S13 and records trigger information (switcher or camera selector) for the target camera. Then, in step S14, it executes priority control for the target camera. On the other hand, if the AF determines that the target camera has already been set to high priority (Yes) in step S12, it updates the status of the database and records trigger information (switcher or camera selector) for the target camera in step S15. In this case, the AF determines that additional priority control is unnecessary and does not execute it.

[0260] 5-4. Camera Selection Cancellation Processing> FIG. 28 is a flowchart showing an example of the cancellation processing when a camera is selected. In step S21, the AF receives a camera selection cancellation signal from the switcher or the camera selector. In step S22, the AF checks the database to see if the target camera has already been set to a high priority due to another trigger. That is, when the AF receives a camera selection cancellation signal from the switcher, it checks whether the high priority setting due to a trigger from the camera selector has occurred, in addition to the high priority setting due to a trigger from the switcher. Furthermore, when the AF receives a camera selection cancellation signal from the camera selector, it checks whether the high priority setting due to a trigger from the switcher has occurred, in addition to the high priority setting due to the camera selector.

[0261] If the AF determines that the target camera is not set to high priority due to another trigger (No), it updates the status of the database and cancels the high priority setting of the target camera in step S23. Then, in step S24, it executes priority control (initial value) for the target camera. On the other hand, if the AF determines that the target camera is set to high priority due to another trigger (Yes) in step S22, it updates the status of the database and records trigger information (switcher or camera selector) for the target camera in step S25. In this case, the AF determines that additional priority control is unnecessary and does not execute it.

[0262] 5-5. Variation 1 of Camera Priority Setting Process The information processing device 10 may control changing the resolution or frame rate of the imaging device 50 instead of the priority of the imaging device 50. The switcher or camera selector serving as the information processing device 10 may control changing of parameters other than the priority, such as the resolution or frame rate, taking into account the usage status of wireless resources and prediction information. Three or more types of resolutions and frame rates may also be set. For example, 4K (3840 x 2160), Full HD (1920 x 1080), 1280 x 720, 720 x 480, etc. may be used as the resolution.

[0263] Also, available frame rates include 120 fps, 60 fps, 50 fps, and 30 fps, and a required combination may be selected from these depending on the wireless resource situation. For example, when there are sufficient allocatable wireless resources, a resolution of 1920 x 1080 and a frame rate of 60 fps may be selected, while when there are few allocatable wireless resources, a resolution of 1280 x 720 and a frame rate of 30 fps may be selected. Furthermore, by lowering the video resolution or the frame rate, the bandwidth required for transmission may be reduced, thereby preventing degradation of video quality. The frame rate and resolution may be set based on defined information, or may be specified by an operator or engineer each time.

[0264] 29 is a sequence diagram showing another example of the camera priority setting process. Step S600 is a sequence in which an engineer performs the camera priority setting process. The camera selector as the information processing device 10 acquires a camera designation and a request to change the resolution and frame rate from the engineer (step S601). Then, the information processing device 10 transmits the request to change the resolution and frame rate to the RAN / core network (step S602).

[0265] The RAN / core network changes the resolution and frame rate of the imaging device 50 based on the resolution and frame rate change request (step S603). That is, the resolution and frame rate of CAM B are changed. When the setting is complete, the imaging device 50 transmits a completion notification to the information processing device 10 via the RAN / core network (step S604). Then, the information processing device 10 transmits a change completion notification to the engineer (step S605). The imaging device 50 also transmits the video after the resolution and frame rate change to the information processing device 10 via the RAN / core network (step S606). The engineer previews the video of the imaging device 50 (CAM B) and adjusts the image quality (camera parameter adjustment) (step S607).

[0266] Step S650 is a sequence in which the camera selector performs camera priority setting processing. The camera selector as the information processing device 10 acquires wireless situation and forecast information (wireless resources) from the AF (steps S651 and S652). The information processing device 10 also acquires a camera designation and a resolution and frame rate change request from the engineer (step S653). The information processing device 10 determines the resolution and frame rate based on the wireless situation and forecast information from the AF and the camera designation and resolution and frame rate change request from the engineer (step S654). The information processing device 10 then transmits the resolution and frame rate change request to the RAN / core network (step S655).

[0267] The RAN / core network changes the resolution and frame rate of the imaging device 50 based on the resolution and frame rate change request (step S656). That is, the resolution and frame rate of CAM B are changed. When the setting is complete, the imaging device 50 transmits a completion notification to the information processing device 10 via the RAN / core network (step S657). Then, the information processing device 10 transmits a change completion notification to the engineer (step S658). The imaging device 50 also transmits the video after the resolution and frame rate change to the information processing device 10 via the RAN / core network (step S659). The engineer previews the video of the imaging device 50 (CAM B) and adjusts the image quality (camera parameter adjustment) (step S660).

[0268] <5-6. Modification Example 2 of Camera Priority Setting Processing> Regarding priority control of image quality adjustment signals in the imaging device 50 performed by an engineer, priority setting of Uplink Flow data is necessary so that the engineer can check the image quality displayed in the preview. Furthermore, in addition to priority setting of Uplink Flow data, a command must be sent from the camera selector to the camera using Downlink Flow to control image quality. Therefore, by setting priority of Downlink Flow in addition to Uplink Flow, it becomes possible to perform image quality adjustment without any problems. Note that when selecting a camera using the camera selector, the engineer may be able to select whether to set priority of Downlink Flow at the same time or each time. Furthermore, the camera selector or AF may take into account the current wireless conditions to determine whether to set priority of Downlink Flow. Furthermore, the determination may be made based not only on the current wireless conditions but also on prediction results.

[0269] In this case, when the camera selector or AF performs flow-level priority control, it may consider not only the uplink video transmission flow and the downlink camera parameter adjustment command flow, but also the downlink tally signal flow, the uplink and downlink intercom (voice call) signal flow, the downlink return feed flow, and the uplink audio flow. Priorities may be predefined according to the data transmitted in each flow, and the priorities may be set based on these. For example, for the uplink, high: video transmission, audio, medium: intercom signal, while for the downlink, high: tally, medium: intercom, return feed, low: camera parameter adjustment command. Furthermore, engineers or operators may specify these priorities on an individual basis. Furthermore, the priority of the flow to be set may be determined based on information held by the audio management system. However, the return feed does not necessarily mean only the downlink signal; it also exists in the uplink. In other words, although the downlink is the main return feed flow, both the downlink and uplink flows may be prioritized.

[0270] FIG. 30 is a sequence diagram showing another example of camera priority setting processing, which is a sequence of image quality adjustment processing by flow-level control. Step S400 is a sequence for performing priority setting on both the uplink flow for video transmission and the downlink flow for transmitting image quality adjustment commands to the imaging device 50. The camera selector as the information processing device 10 receives a camera selection request from an engineer (step S401). Then, the information processing device 10 transmits camera information to the AF (step S402). In the example of FIG. 30, the camera information includes control information for setting high priority on both the uplink and downlink of CAM B.

[0271] The AF transmits camera information (control information) to the RAN / core network (step S403). The RAN / core network configures priority control for wireless communication of the imaging device 50 based on the control information (step S404). That is, the RAN / core network assigns a high priority to the uplink of CAM B so that wireless resources for the uplink of CAM B are secured. Once the configuration is complete, the RAN / core network notifies the AF of the completion (step S405). The AF also transmits camera information (control information) to the RAN / core network (step S406). The RAN / core network configures priority control for wireless communication of the imaging device 50 based on the control information (step S407). That is, the RAN / core network assigns a high priority to the downlink of CAM B so that wireless resources for the downlink of CAM B are secured. Once the configuration is complete, the RAN / core network notifies the AF of the completion (step S408).

[0272] When the AF completes the process of setting high priority to both the uplink and downlink of CAM B, it transmits a completion notice to the information processing device 10 (step S409).Then, the information processing device 10 transmits a setting completion notice to the engineer (step S410).

[0273] Step S500 is a sequence in which an engineer adjusts camera parameters using the prioritized Downlink Flow. The engineer previews video and adjusts image quality (camera parameter adjustment) for the image capture device 50 (CAM B) (step S501). The camera selector serving as the information processing device 10 acquires an image quality adjustment signal (CAM B) from the engineer (steps S502 and S504). The information processing device 10 then transmits the image quality adjustment signal to the Downlink of CAM B (steps S503 and S505).

[0274] 31 and 32 are sequence diagrams showing another example of the camera priority setting process, which are sequences of the image quality adjustment process by flow-based priority control (priority rule presetting).

[0275] <5-7. Flow-Based Priority Control 1 Based on Priority Rules> Step S700 is a sequence for carrying out flow-based priority control based on priority rules preset in the camera selector as the information processing device 10.

[0276] An engineer sets priority rules in advance and stores them in a database (step S701). The camera selector as the information processing device 10 acquires a camera selection request from the engineer (step S702). The information processing device 10 reads out the priority rules stored in the database based on the acquired camera selection request information (step S703). The information processing device 10 then transmits camera priority (high) setting information to the AF (step S704). In the example of Fig. 31, the camera priority (high) setting information includes control information for setting a high priority to the uplink of CAM B.

[0277] The AF transmits high priority NEF control information for the camera video transmission Flow as camera priority (high) setting information (control information) to the RAN / core network (step S705). The RAN / core network sets priority control for wireless communication of the imaging device 50 based on the control information (step S706). That is, the RAN / core network sets high priority for the uplink video transmission wireless resource of CAM B so that the uplink video transmission wireless resource of CAM B is secured. When the setting is complete, the RAN / core network notifies the AF of the completion (step S707).

[0278] The AF also transmits NEF control information with a (low) priority for the camera parameter adjustment flow as camera information (control information) to the RAN / core network (step S708). The RAN / core network sets priority control for wireless communication of the imaging device 50 based on the control information (step S709). That is, the RAN / core network sets a low priority for the downlink camera parameter adjustment resource of CAM B so that the downlink camera parameter adjustment resource of CAM B is secured. When the setting is complete, the RAN / core network notifies the AF of the completion (step S710).

[0279] When the AF completes the process of setting the priority for the uplink and downlink of CAM B, it transmits a completion notice to the information processing device 10 (step S711). Then, the information processing device 10 transmits a setting completion notice to the engineer (step S712).

[0280] <5-8. Flow-Based Priority Control 2 Based on Priority Rules> Step S750 is a sequence for implementing flow-based priority control for cameras, such as on-air cameras, based on priority rules preset by an operator. The switcher, which functions as the information processing device 10, acquires a camera selection request from the operator (step S751). The switcher transmits the acquired camera selection request information to the camera selector, which functions as the information processing device 10 (step S752). The camera selector reads the priority rule stored in the database based on the acquired camera selection request information (step S753). The information processing device 10 then transmits camera priority (high) setting information to the AF (step S754). In the example of FIG. 31 , the camera priority (high) setting information includes control information for setting a high priority for the uplink of CAM B.

[0281] The AF transmits high priority NEF control information for the camera video transmission Flow to the RAN / core network as camera priority (high) setting information (control information) (step S755). The RAN / core network sets priority control for wireless communication of the imaging device 50 based on the control information (step S756). That is, the RAN / core network sets a high priority for the uplink video transmission wireless resource of CAM B so that the uplink video transmission wireless resource of CAM B is secured. Once the setting is complete, the RAN / core network notifies the AF of completion (step S757). Once the AF has completed the process of setting the priority for the uplink of CAM B, it transmits a completion notification to the information processing device 10 (step S758).

[0282] <5-9. Flow-Based Priority Control 3 Based on Priority Rules> Step S800 is a sequence for implementing flow-based priority control of return feeds based on priority rules preset by an operator. The switcher, which functions as the information processing device 10, acquires a return feed priority request from the operator (step S801). The switcher transmits the acquired return feed priority request information to the camera selector, which functions as the information processing device 10 (step S802). The camera selector reads the priority rule stored in the database based on the acquired return feed priority request information (step S803). The information processing device 10 then transmits return feed priority (medium) setting information to the AF (step S804). In the example of FIG. 31 , the return feed priority (medium) setting information includes control information for setting a priority (medium) for the downlink of CAM B.

[0283] The AF transmits return feed Flow priority (medium) NEF control information as return feed priority (medium) setting information (control information) to the RAN / core network (step S805). The RAN / core network sets priority control for wireless communication of the imaging device 50 based on the control information (step S806). That is, the RAN / core network sets the return feed radio resource for the downlink of CAM B to a medium priority so that the return feed radio resource for the downlink of CAM B is secured. Once the setting is complete, the RAN / core network notifies the AF of completion (step S807). Once the AF completes the process of setting the priority for the downlink of CAM B, it transmits a completion notification to the information processing device 10 (step S808).

[0284] <5-10. Flow-Based Priority Control 4 Based on Priority Rules> Step S850 is a sequence for implementing flow-based priority control of audio selected by an audio engineer based on priority rules preset in the camera selector. The camera selector, which functions as the information processing device 10, receives an audio selection request from the audio engineer (step S851). The camera selector reads out priority rules stored in the database based on the information in the received audio selection request (step S852). The information processing device 10 then transmits audio priority (high) setting information to the AF (step S853). In the example of FIG. 32, the audio priority (high) setting information includes control information for setting a high priority for the uplink of CAM B.

[0285] The AF transmits high priority NEF control information for the audio Flow as high audio priority setting information (control information) to the RAN / core network (step S854). The RAN / core network sets priority control for wireless communication of the imaging device 50 based on the control information (step S855). That is, the RAN / core network sets high priority for the uplink audio radio resource of CAM B so that the uplink audio radio resource of CAM B is secured. Once the setting is complete, the RAN / core network notifies the AF of completion (step S856). Once the AF has completed the process of setting the priority for the uplink of CAM B, it transmits a completion notification to the information processing device 10 (step S857).

[0286] The information processing device 10 transmits an audio transmission request to the Uplink of CAM B (step S858). The Uplink of CAM B transmits an audio transmission request completion notification to the information processing device 10 (step S859). The information processing device 10 transmits an audio selection completion notification to the audio engineer (step S860). Furthermore, the Uplink of CAM B transmits audio data to the information processing device 10 (step S861).

[0287] <5-11. Flow-Based Priority Control 5 Based on Priority Rules> Step S900 is a sequence for carrying out flow-based priority control of the intercom selected by the audio engineer based on the priority rules preset in the camera selector.

[0288] The camera selector as the information processing device 10 acquires an intercom priority request from an audio engineer (step S901). The camera selector reads out a priority rule stored in a database based on the acquired intercom priority request information (step S902). The information processing device 10 then transmits intercom priority (medium) setting information to the AF (step S903). In the example of Fig. 32, the intercom priority (medium) setting information includes control information for setting the intercom priority (medium) in the uplink of CAM A.

[0289] The AF transmits to the RAN / core network, as the intercom information (control information), the NEF control information indicating the priority (medium) of the intercom Flow (step S904). The RAN / core network sets priority control for the intercom wireless communication based on the control information (step S905). That is, the intercom downlink intercom radio resource is set to a medium priority so that the intercom downlink intercom radio resource is secured. When the setting is complete, the RAN / core network notifies the AF of the completion (step S906).

[0290] The AF also transmits NEF control information indicating a (medium) priority for the intercom Flow as intercom information (control information) to the RAN / core network (step S907). The RAN / core network sets priority control for wireless communication of the imaging device 50 based on the control information (step S908). That is, the intercom radio resource for the intercom uplink is set to a medium priority so that the intercom radio resource for the intercom uplink is secured. Once the setting is complete, the RAN / core network notifies the AF of completion (step S909). Once the AF has completed the process of setting the priority for the intercom, it transmits a completion notification to the information processing device 10 (step S910).

[0291] <5-12. Flow-Based Priority Control 6 Based on Priority Rules> Fig. 33 is a sequence diagram showing another example of the camera priority setting process. Step S600 is a sequence in which an engineer performs the camera priority setting process. The sequence of step S600 is the same as that described in 5-5. Modification 1 of the camera priority setting process (Fig. 29), and therefore a description thereof will be omitted.

[0292] Furthermore, step S950 is a sequence for performing processing to avoid frame drops of the selected video in a situation where it is not possible to increase the priority of the video from the selected imaging device 50, by lowering the frame rate or resolution in order to lower the transmission rate from the imaging device 50. Here, a situation where it is not possible to increase the priority of the video from the selected imaging device 50 is, for example, a situation where the current wireless situation or predicted information results in a shortage of wireless resources, or where it is difficult to stabilize the video quality due to deterioration of wireless quality.

[0293] The camera selector as the information processing device 10 acquires wireless status and prediction information (wireless resources) from the AF (steps S951 and S952). The camera selector as the information processing device 10 also acquires a camera specification from the engineer (step S953). The information processing device 10 determines the resolution and frame rate based on the wireless status and prediction information from the AF, the camera specification from the engineer, and the resolution and frame rate change information (step S954). That is, in a situation where the priority of the video selected by the engineer cannot be increased (e.g., the current or predicted wireless status is a situation where video quality is difficult due to a lack of resources or deterioration of wireless quality), the frame rate and resolution are reduced to lower the transmission rate from the imaging device 50, thereby reducing the wireless resources used and avoiding quality degradation of the selected video. Then, in a situation where the priority of the video from the selected imaging device 50 cannot be increased, the information processing device 10 transmits a resolution and frame rate change request to the RAN / core network (step S955).

[0294] The RAN / core network changes the resolution and frame rate of the imaging device 50 based on the resolution and frame rate change request (step S956). That is, the resolution and frame rate of CAM B are changed. When the setting is complete, the imaging device 50 transmits a completion notification to the information processing device 10 via the RAN / core network (step S957). Then, the information processing device 10 transmits a change completion notification to the engineer (step S958). The imaging device 50 also transmits the video after the resolution and frame rate have been changed to the information processing device 10 via the RAN / core network (step S959). The engineer previews the video of the imaging device 50 (CAM B) and adjusts the image quality (camera parameter adjustment) (step S960).

[0295] Note that the sequence of step S950 has been described as lowering the transmission rate by changing the resolution and frame rate of the image of the imaging device 50, but similar processing can also be applied to the processing of lowering the rate (audio encoding rate, return feed resolution and frame rate, etc.) in flow-based control of audio, return feed, etc.

[0296] <<6. Modifications>> The above-described embodiment is merely an example, and various modifications and applications are possible.

[0297] For example, in the above-described embodiment, the first control information is a tally signal or control information included in the tally signal. However, the first control information is not limited to this. For example, the first control information may be a control signal generated by a dedicated switch for control device priority control such as a switcher, or control information included in the control signal. Alternatively, the first control information may be a control signal for switching a prioritized video, or control information included in the control signal. The information processing device 10 may include second control information in this control signal.

[0298] In the above-described embodiment, the information processing device 10 sets the priority (transmits the second control information) on a cell-by-cell basis. However, the priority setting is not limited to a cell-by-cell basis. For example, the information processing device 10 may set the priority (transmit the second control information) on a logical network basis, such as a slice. The logical network is not limited to a slice, and may be, for example, a 4G logical network (e.g., a logical network configured using DECORE (Dedicated Core Networks)). Furthermore, the information processing device 10 may set the priority (transmit the second control information) on a radio access technology (RAT) basis, such as 4G (LTE), 5G (NR), or wireless LAN (WiFi). The information processing device 10 may set the priority (transmit the second control information) on an entire wireless network (e.g., a cellular network) basis.

[0299] It should be noted that the number of high-priority imaging devices 50 (for example, imaging devices with a first priority) is not limited to one. There may be multiple high-priority imaging devices 50. When a predetermined number or more of imaging devices 50 are assigned high priorities, the information processing device 10 or the network device may automatically change the priorities of the imaging devices 50 to lower priorities in order, starting with the imaging device 50 that changed to a high priority the earliest.

[0300] Furthermore, in the above-described embodiment, the camera (imaging device 50) involved in the predetermined processing is, for example, a camera (imaging device 50) that captures video to be broadcast / distributed. However, the camera involved in the predetermined processing is not limited to a camera that captures video to be broadcast / distributed. For example, the camera involved in the predetermined processing may be a camera that captures next video or a camera that captures video for editing. Furthermore, the camera involved in the predetermined processing may be a camera that captures wipe video (for example, sub-video that is superimposed on the main video).

[0301] The control device that controls the information processing device 10, management device 20, base station 30, terminal device 40, or imaging device 50 of this embodiment may be realized by a dedicated computer system or a general-purpose computer system.

[0302] For example, a program for executing the above-described operations is stored in a computer-readable recording medium such as an optical disk, a semiconductor memory, a magnetic tape, or a flexible disk and distributed. Then, for example, the program is installed on a computer and the above-described processing is executed to configure a control device. In this case, the control device may be a device (e.g., a personal computer) external to the information processing device 10, the management device 20, the base station 30, the terminal device 40, or the imaging device 50. Furthermore, the control device may be a device (e.g., a control unit 13, a control unit 23, a control unit 33, a control unit 43, or a control unit 53) internal to the information processing device 10, the management device 20, the base station 30, or the terminal device 40.

[0303] The communication program may also be stored in a disk device provided in a server device on a network such as the Internet, and may be downloaded to a computer. The above-described functions may also be realized by a combination of an operating system (OS) and application software. In this case, the components other than the OS may be stored on a medium and distributed, or may be stored in a server device and downloaded to a computer.

[0304] Furthermore, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using a known method. In addition, the information including the processing procedures, specific names, various data, and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.

[0305] Furthermore, the components of each device shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

[0306] The above-described embodiments can be combined as appropriate within the scope of the present invention without causing any inconsistency in the processing content. The order of the steps shown in the sequence diagrams or flowcharts of the present embodiment can be changed as appropriate.

[0307] Furthermore, for example, the present embodiment can also be implemented as any configuration that constitutes an apparatus or system, such as a processor as a system LSI (Large Scale Integration), a module using multiple processors, a unit using multiple modules, a set in which other functions are added to a unit, or the like (i.e., a configuration of a part of an apparatus).

[0308] The system LSI may also be referred to as an SOC (System on Chip). In other words, each of the above-described or later-described devices (e.g., the information processing device 10, the management device 20, the base station 30, the terminal device 40, and the imaging device 50) may be interpreted as a processor (e.g., a CPU) serving as a system LSI (e.g., SoC), or as a module using or constituting the processor. Additionally or alternatively, the present embodiment may be implemented by any configuration constituting a device or system, such as a modem chip (baseband chip), an RF (Radio Frequency) unit, or a combination thereof. The RF unit includes at least one of an RF circuit or an RF front-end. In other words, each of the above-described or later-described devices may be interpreted as a modem chip (baseband chip), an RF unit, or a combination thereof. Additionally or alternatively, each of the above-described or later-described devices may be interpreted as a module using or constituting a modem chip or an RF unit.

[0309] The modem chip performs signal processing for communications within a device (including the devices described above or below). The modem chip may have at least the function of a modulator or demodulator. The RF unit may have the function of at least one of an RF transceiver (RF upconverter, RF downconverter), a power amplifier, and a low-noise amplifier. The RF transceiver converts between baseband signals and RF frequencies. The power amplifier amplifies signals for transmission from an antenna. The low-noise amplifier amplifies weak signals received from the antenna. Additionally or alternatively, the RF unit (particularly, the RF front-end) may include at least one of the above-mentioned power amplifier, low-noise amplifier, envelope tracker, filter, duplexer, multiplexer, antenna switch, and antenna tuner.

[0310] The combination of the modem chip and the RF unit may be referred to as a modem-RF system. At least a portion of the modem chip, the RF unit, or a combination thereof may be included in a system LSI (e.g., SoC). For example, at least a portion of the MAC layer processing / PHY layer processing performed by at least a portion of the modem chip, the RF unit, or a combination thereof may be realized by the system LSI. The MAC layer processing or PHY layer processing here may be at least a portion of the processing performed by the devices (e.g., the information processing device 10, the management device 20, the base station 30, the terminal device 40, and the imaging device 50) in the above-described or below-described embodiments.

[0311] In this embodiment, a system refers to a collection of multiple components (devices, modules (components), etc.), regardless of whether all of the components are in the same housing. For example, multiple devices housed in separate housings and connected via a network, etc., and a single device in which multiple modules are housed in a single housing are both systems.

[0312] Furthermore, for example, this embodiment can have a cloud computing configuration in which one function is shared and processed jointly by a plurality of devices via a network.

[0313] <<7. Effects of information processing device, imaging device, and information processing method according to the present disclosure>> As described above, according to the present embodiment, the information processing device 10, when designating one or more of the two or more imaging devices 50 as imaging devices 50 related to a predetermined process, includes transmitters 131, 132 that transmit control information for preferentially allocating wireless resources to the designated imaging device 50 or a wireless communication terminal connected to the designated imaging device 50, to a network device that performs processing related to allocation of wireless resources, and the transmitters 131, 132 transmit the plurality of pieces of control information to the network device in control flow units.

[0314] This allows multiple pieces of control information to be sent to the network device in control flow units, making it possible to perform good image quality adjustments for the imaging device 50, and as a result, it is possible to suppress disturbances in broadcast / distributed video.

[0315] Furthermore, the information processing device 10 has a first transmitter 131 that transmits first control information for designating the imaging device 50 as the imaging device 50 related to a predetermined process, and a second transmitter 132 that transmits second control information for preferentially allocating wireless resources. This allows the designated imaging device 50 (or terminal device 40) to stably wirelessly transmit captured data related to broadcast / distribution to the broadcast / distribution facility (e.g., the information processing device 10), thereby suppressing disturbances in the broadcast / distribution video.

[0316] Furthermore, in the information processing device 10, the transmission units 131 and 132 transmit, in units of control flows, control information corresponding to the uplink and downlink of the designated imaging device 50 or the wireless communication terminal connected to the designated imaging device 50. This allows for good image quality adjustment for the imaging device 50.

[0317] Furthermore, in the information processing device 10, the transmitters 131 and 132 transmit, via the uplink, at least one of a video transmission signal, an audio signal, an intercom signal, a tally signal, a return ford signal, and a parameter adjustment signal from the imaging device 50. This allows priorities to be set for each of the video transmission signal, audio signal, and intercom signal, enabling favorable image quality adjustment for the imaging device 50.

[0318] Furthermore, in the information processing device 10, the transmitters 131 and 132 transmit, via the downlink, at least one of a tally signal, an intercom signal, a return ford signal, and a parameter adjustment signal from the imaging device 50. This allows priorities to be set for each of the tally signal, intercom signal, return ford signal, and parameter adjustment signal, enabling favorable image quality adjustment for the imaging device 50.

[0319] Furthermore, the information processing device 10 transmits control flows with attached priorities for the transmission units 131 and 132 to preferentially allocate wireless resources to the control flows, thereby enabling the priorities to be set in detail.

[0320] Furthermore, the information processing device 10 stores the priority of each control flow in a database in advance, thereby allowing the priority to be set in advance.

[0321] Furthermore, in the information processing device 10, the transmitters 131 and 132 determine whether to transmit control information based on the current wireless situation or predicted information about the wireless situation, thereby enabling the priority to be appropriately set based on the current wireless situation or predicted information.

[0322] Furthermore, the information processing device 10 is provided with, as imaging devices 50 related to a predetermined process, a first imaging device 50 that captures video to be broadcasted or distributed and a second imaging device 50 that captures video to be used for preview or image quality adjustment, and the transmitters 131 and 132 transmit, in units of control flows, control information on the priority of wireless resources for the second imaging device 50. This makes it possible to ensure appropriate image quality not only for video to be broadcasted or distributed, but also for video to be used for preview or image quality adjustment.

[0323] Furthermore, when the second imaging device 50 has difficulty transmitting video of a predetermined quality using the wireless resources allocated by the network device, the information processing device 10 transmits control information to lower the data rate of the second imaging device 50. As a result, for example, the imaging device 50 lowers the data rate to a level at which video transmission of a predetermined quality can be achieved. This allows the second imaging device 50 to stably transmit captured data wirelessly.

[0324] Furthermore, the information processing device 10 is provided with, as imaging devices 50 related to a predetermined process, a first imaging device 50 that captures video to be broadcasted or distributed and a second imaging device 50 that captures video to be used for previewing or image quality adjustment, and the transmission units 131 and 132 transmit control information that makes the priority of wireless resources for the first imaging device 50 higher than the priority of wireless resources for the second imaging device 50. This makes it possible to ensure appropriate image quality for the video to be broadcasted or distributed.

[0325] Furthermore, in the information processing device 10, the transmitters 131 and 132 transmit, as control information, control information for allocating wireless resources to the first imaging device 50 or the first wireless communication terminal connected to the first imaging device 50, in preference to the second imaging device 50 or the second wireless communication terminal connected to the second imaging device 50, when the first imaging device 50 and the second imaging device 50 exist in the same cell. This also makes it possible to ensure appropriate image quality for the video to be broadcast or distributed.

[0326] The information processing device 10 also has a switcher that switches the first imaging device 50 that captures the video to be broadcast or distributed based on an instruction from an operator, and a camera selector that switches the second imaging device 50 that captures the video used for preview or image quality adjustment based on an instruction from an engineer. This makes it possible to ensure appropriate image quality not only for the video to be broadcast or distributed, but also for the video used for preview or image quality adjustment.

[0327] Furthermore, when priority setting instruction information is input from the switcher or camera selector, if the priority of the image capture device 50 for which priority is to be set has not yet been set, the information processing device 10 updates the priority information stored in the database and then transmits control information, thereby enabling the switcher and camera selector to appropriately set the priority.

[0328] Furthermore, when the priority of the image capture device 50 for which priority is to be set has already been set, the information processing device 10 does not transmit control information, thereby enabling the switcher and camera selector to appropriately set the priority.

[0329] Furthermore, when priority cancellation instruction information is input from a switcher or a camera selector, if the priority of the imaging device 50 has not yet been set based on the cancellation instruction information from the input source, the information processing device 10 updates the priority information stored in the database and then transmits control information, thereby enabling the switcher and camera selector to appropriately cancel the priority.

[0330] Furthermore, when the priority of the image capture device 50 has already been set based on the release instruction information from the input source, the information processing device 10 does not transmit the control information, thereby enabling the switcher and camera selector to appropriately release the priority.

[0331] Furthermore, in the information processing device 10, the first control information is a tally signal, and the second control information is control information linked to the tally signal, thereby enabling the priority of the image capturing device 50 to be set appropriately.

[0332] Furthermore, the imaging device 50 includes a receiving unit 531 that receives control information for preferentially allocating wireless resources from a network device that performs processing related to the allocation of wireless resources when one or more of the two or more imaging devices 50 are designated as imaging devices 50 related to a predetermined process, and the receiving unit 531 receives the plurality of pieces of control information from the network device in units of control flows. This allows the imaging device 50 to perform good image quality adjustment, and as a result, it is possible to suppress disturbances in broadcast / distributed video.

[0333] Furthermore, in the information processing method, when one or more of the two or more imaging devices 50 are designated as imaging devices 50 related to a predetermined process, control information for preferentially allocating wireless resources to the designated imaging device 50 or a wireless communication terminal connected to the designated imaging device 50 is transmitted to a network device that performs processing related to the allocation of wireless resources, and multiple pieces of control information are transmitted to the network device in units of control flows. This allows for good image quality adjustment for the imaging device 50, and as a result, it is possible to suppress disturbances in broadcast / distributed video.

[0334] Although the embodiments of the present disclosure have been described above, the technical scope of the present disclosure is not limited to the above-described embodiments, and various modifications are possible within the scope of the gist of the present disclosure. Furthermore, components of different embodiments and modifications may be combined as appropriate.

[0335] Furthermore, the effects of each embodiment described in this specification are merely examples and are not intended to be limiting, and other effects may also be obtained.

[0336] <<8. Hardware Configuration>> FIG. 34 is a hardware configuration diagram showing an example of a computer that realizes the functions of the imaging system 1.

[0337] Information devices such as the imaging system 1 according to the embodiment described above are realized by, for example, a computer 1000 configured as shown in Fig. 34. The imaging system 1 according to the embodiment will be described below as an example. The computer 1000 has a CPU 1100, a RAM 1200, a ROM (Read Only Memory) 1300, a HDD (Hard Disk Drive) 1400, a communication interface 1500, and an input / output interface 1600. The components of the computer 1000 are connected by a bus 1050.

[0338] The CPU 1100 operates and controls each component based on programs stored in the ROM 1300 or the HDD 1400. For example, the CPU 1100 loads the programs stored in the ROM 1300 or the HDD 1400 into the RAM 1200 and executes processing corresponding to the various programs.

[0339] The ROM 1300 stores boot programs such as a Basic Input Output System (BIOS) that is executed by the CPU 1100 when the computer 1000 is started, and programs that depend on the hardware of the computer 1000 .

[0340] HDD 1400 is a computer-readable recording medium that non-temporarily records programs executed by CPU 1100 and data used by such programs. Specifically, HDD 1400 is a recording medium that records a program according to the present disclosure, which is an example of program data 1450.

[0341] The communication interface 1500 is an interface for connecting the computer 1000 to an external network 1550 (e.g., the Internet). For example, the CPU 1100 receives data from other devices and transmits data generated by the CPU 1100 to other devices via the communication interface 1500.

[0342] The input / output interface 1600 is an interface for connecting the input / output device 1650 and the computer 1000. For example, the CPU 1100 receives data from an input device such as a keyboard or a mouse via the input / output interface 1600. The CPU 1100 also transmits data to an output device such as a display, a speaker, or a printer via the input / output interface 1600. The input / output interface 1600 may also function as a media interface for reading programs and the like recorded on a predetermined recording medium. Examples of media include optical recording media such as a DVD (Digital Versatile Disc) or a PD (Phase Change Rewritable Disc), magneto-optical recording media such as an MO (Magneto-Optical Disk), tape media, magnetic recording media, and semiconductor memories.

[0343] For example, when the computer 1000 functions as the imaging system 1 according to the embodiment, the CPU 1100 of the computer 1000 executes a program loaded onto the RAM 1200 to realize functions such as a control unit. The HDD 1400 stores programs according to the present disclosure and data stored in the storage unit. The CPU 1100 reads and executes program data 1450 from the HDD 1400. Alternatively, the CPU 1100 may acquire these programs from another device via an external network 1550.

[0344] Note that the present technology can also be configured as follows. (1) An information processing device including a transmitter that, when designating one or more imaging devices among two or more imaging devices as imaging devices related to a predetermined process, transmits control information for preferentially allocating wireless resources to the designated imaging device or a wireless communication terminal connected to the designated imaging device to a network device that performs processing related to the allocation of the wireless resources, wherein the transmitter transmits the plurality of pieces of control information to the network device in units of control flows. (2) The information processing device according to (1), wherein the transmitter includes a first transmitter that transmits first control information for designating the imaging device as the imaging device related to the predetermined process, and a second transmitter that transmits second control information for preferentially allocating the wireless resources. (3) The information processing device according to (1), wherein the transmitter transmits the control information corresponding to uplinks and downlinks of the designated imaging device or a wireless communication terminal connected to the designated imaging device in units of control flows. (4) The information processing device according to (3), wherein the transmission unit transmits, over the uplink, at least one of a video transmission signal, an audio signal, an intercom signal, a tally signal, a return Ford signal, and a parameter adjustment signal from the imaging device. (5) The information processing device according to (3) or (4), wherein the transmission unit transmits, over the downlink, at least one of a tally signal, an intercom signal, a return Ford signal, and a parameter adjustment signal from the imaging device. (6) The information processing device according to any one of (1) to (5), wherein the transmission unit transmits the control flow accompanied by a priority for preferentially allocating wireless resources to the control flow. (7) The information processing device according to (6), wherein the priority for the control flow is stored in a database in advance. (8) The information processing device according to any one of (1) to (7), wherein the transmission unit determines to transmit the control information based on a current wireless situation or predicted wireless situation information.(9) The information processing device according to any one of (1) to (8), wherein the imaging device related to the predetermined processing includes a first imaging device that captures video to be broadcasted or distributed, and a second imaging device that captures video used for previewing or image quality adjustment, and the transmission unit transmits the control information of wireless resource priority for the second imaging device on a control flow basis. (10) The information processing device according to (9), wherein, when it is difficult for the second imaging device to transmit video of a predetermined quality using wireless resources allocated from the network device, the second imaging device transmits the control information to lower the data rate of the second imaging device. (11) The information processing device according to any one of (1) to (10), wherein the imaging device related to the predetermined processing includes a first imaging device that captures video to be broadcasted or distributed, and a second imaging device that captures video used for previewing or image quality adjustment, and the transmission unit transmits control information that makes the priority of wireless resources for the first imaging device higher than the priority of wireless resources for the second imaging device. (12) The information processing device according to (11), wherein the transmitter transmits, as the control information, control information for allocating wireless resources to the first imaging device or a first wireless communication terminal connected to the first imaging device, in preference to the second imaging device or a second wireless communication terminal connected to the second imaging device when the first imaging device and the second imaging device exist in the same cell. (13) The information processing device according to (11) or (12), further comprising: a switcher that switches the first imaging device that captures video to be broadcast or distributed based on an instruction from an operator, and a camera selector that switches the second imaging device that captures video used for previewing or image quality adjustment based on an instruction from an engineer. (14) The information processing device according to (13), wherein, when priority setting instruction information is input from the switcher or the camera selector, if the priority of the imaging device to be prioritized has not been set, the information processing device transmits the control information after updating priority information stored in a database. (15) The information processing device according to (14), wherein the control information is not transmitted when the priority of the imaging device to be prioritized has already been set.(16) The information processing device according to any one of (13) to (15), wherein, when priority release instruction information is input from the switcher or the camera selector, if the priority of the imaging device has not been set according to the release instruction information from the input source, the information processing device updates priority information stored in a database and then transmits the control information. (17) The information processing device according to (16), which does not transmit the control information if the priority of the imaging device has already been set according to the release instruction information from the input source. (18) The information processing device according to (2), wherein the first control information is a tally signal, and the second control information is control information linked to the tally signal. (19) An imaging device comprising: a receiving unit that receives control information for preferentially allocating wireless resources from a network device that performs processing related to allocation of the wireless resources when designating one or more imaging devices of two or more imaging devices as imaging devices related to a predetermined process, and the receiving unit receives the control information from the network device in units of control flows. (20) An information processing method, comprising: when designating one or more of two or more imaging devices as imaging devices related to a predetermined process, transmitting control information for preferentially allocating wireless resources to the designated imaging device or a wireless communication terminal connected to the designated imaging device to a network device that performs processing related to the allocation of the wireless resources, the method transmitting a plurality of pieces of the control information to the network device in units of control flows.

[0345] 1 Imaging system 10, 10 １ , 10 ２ Information processing device 20, 20 １ , 20 ２ Management device 30, 30 １ , 30 ２ , 30 ３ Base station 40, 40 １ , 40 ２ , 40 ３ , 40 Ｘ Terminal devices 50, 50 １ , 50 ２ , 50 ３ , 50 ＸImaging device 11, 21 Communication unit 31, 41, 51 Wireless communication unit 12, 22, 32, 42, 52 Storage unit 13, 23, 33, 43, 53 Control unit 54 Network communication unit 55 Imaging unit 311, 411 Transmission processing unit 312, 412 Reception processing unit 313, 413 Antenna 131 First transmission unit 132 Second transmission unit 133 Notification unit 134 Request unit 431, 531 Reception unit 432, 532 Transmission unit 630 RAN / AN 620 User plane function group 621 UPF 622 DN 640 Control plane function group 641 AMF 642 SMF 643 AUSF 644 NSSF 645 NEF 646 NRF 647 PCF 648 UDM 649 AF CN Core Network

Claims

1. An information processing device comprising: a transmission unit that, when one or more of two or more imaging devices are designated as imaging devices related to a predetermined process, transmits control information for preferentially allocating wireless resources to the designated imaging device or a wireless communication terminal connected to the designated imaging device to a network device that performs processing related to the allocation of the wireless resources, and the transmission unit transmits multiple pieces of control information to the network device in control flow units.

2. The information processing device according to claim 1, wherein the transmitting unit has a first transmitting unit that transmits first control information for designating the imaging device as an imaging device related to a predetermined process, and a second transmitting unit that transmits second control information for preferentially allocating the wireless resources.

3. The information processing device according to claim 1, wherein the transmission unit transmits the control information corresponding to the uplink and downlink of the designated imaging device or a wireless communication terminal connected to the designated imaging device in units of control flow.

4. The information processing device according to claim 3, wherein the transmitting unit transmits at least one of a video transmission signal from the imaging device, an audio signal, an intercom signal, a tally signal, a return signal, and a parameter adjustment signal to the uplink.

5. The information processing device according to claim 3, wherein the transmission unit transmits at least one of a tally signal, an intercom signal, a return ford signal, and a parameter adjustment signal from the imaging device over the downlink.

6. The information processing device according to claim 1, wherein the transmitting unit transmits the control flow with a priority attached thereto for preferentially allocating wireless resources to the control flow.

7. The information processing device according to claim 6, wherein the priority for the control flow is stored in advance in a database.

8. The information processing device according to claim 1, wherein the transmitting unit determines whether to transmit the control information based on current wireless conditions or predicted wireless conditions.

9. The information processing device of claim 1, wherein the imaging device involved in the specified processing includes a first imaging device that captures video to be broadcast or distributed and a second imaging device that captures video to be used for preview or image quality adjustment, and the transmission unit transmits the control information regarding the priority of wireless resources for the second imaging device on a control flow basis.

10. The information processing device according to claim 9, wherein when the second imaging device has difficulty transmitting video of a predetermined quality using the wireless resources allocated by the network device, the information processing device transmits the control information indicating that the data rate of the second imaging device is to be reduced.

11. The information processing device of claim 1, wherein the imaging device involved in the specified processing comprises a first imaging device that captures video to be broadcast or distributed and a second imaging device that captures video to be used for preview or image quality adjustment, and the transmitting unit transmits control information that makes the priority of wireless resources for the first imaging device higher than the priority of wireless resources for the second imaging device.

12. The information processing device described in claim 11, wherein the transmitting unit transmits, as the control information, control information for allocating wireless resources to the first imaging device or a first wireless communication terminal connected to the first imaging device in preference to the second imaging device or a second wireless communication terminal connected to the second imaging device when the first imaging device and the second imaging device are present in the same cell.

13. An information processing device as described in claim 11, comprising a switcher that switches the first imaging device that captures video to be broadcast or distributed based on instructions from an operator, and a camera selector that switches the second imaging device that captures video used for previewing or image quality adjustment based on instructions from an engineer.

14. An information processing device as described in claim 13, wherein when priority setting instruction information is input from the switcher or the camera selector, if the priority of the imaging device for which priority is to be set has not been set, the information processing device updates the priority information stored in a database before transmitting the control information.

15. The information processing device according to claim 14, wherein when the priority of the imaging device for which priority is to be set has already been set, the control information is not transmitted.

16. An information processing device according to claim 13, wherein when priority cancellation instruction information is input from the switcher or the camera selector, if the priority of the imaging device based on the cancellation instruction information from the input source has not been set, the information processing device updates the priority information stored in a database before transmitting the control information.

17. The information processing device according to claim 16, wherein when the priority of the imaging device has already been set according to the release instruction information from the input source, the control information is not transmitted.

18. The information processing device according to claim 2, wherein the first control information is a tally signal, and the second control information is control information associated with the tally signal.

19. An imaging device comprising: a receiving unit that receives control information for preferentially allocating wireless resources from a network device that performs processing related to the allocation of wireless resources when one or more of two or more imaging devices are designated as imaging devices related to a predetermined process, and the receiving unit receives multiple pieces of control information from the network device in control flow units.

20. An information processing method, comprising: designating one or more of two or more imaging devices as imaging devices related to a predetermined process; transmitting control information for preferentially allocating wireless resources to the designated imaging device or a wireless communication terminal connected to the designated imaging device to a network device that performs processing related to the allocation of the wireless resources; and transmitting a plurality of pieces of control information to the network device in units of control flows.

Images