Communication device, communication method, and communication system

Abstract

A communication device (40) relays communication between an information processing device (10) and a plurality of apparatuses (50). The communication device (40) comprises: a setting unit (442); and a communication unit (410). The setting unit (442) sets the priority level of communication between the information processing device (10) and the apparatuses (50) on the basis of information transmitted from the information processing device (10) to at least one of the apparatuses (50). The communication unit (410) relays communication between the information processing device (10) and the apparatuses (50) in accordance with the priority level.

Description

[Technical Field]

[0001] The present disclosure relates to a communication device, a communication method, and a communication system. [Background technology]

[0002] QoS (Quality of Service) technology is known as a technology for ensuring stable use of services on a network. For example, typical communication control methods (QoS control) in QoS technology include priority control (a control method for transmitting high-priority data first) and bandwidth control (a control method for specifying the available bandwidth for a specific communication).

[0003] For example, QoS control is generally implemented in routers, but the QoS control implemented here is control (hereinafter also referred to as static QoS control) that is performed according to pre-set rules (for example, prioritizing communications related to a specific service, prioritizing communications with a specific device, etc.). This type of static QoS control cannot respond to dynamically changing network conditions. Therefore, it is desirable to perform dynamic QoS control that can respond to dynamically changing network conditions.

[0004] As a technique for performing dynamic QoS control, for example, a technique for performing dynamic QoS control depending on a service is known. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2006-262379 [Patent Document 2] Japanese Patent Application Laid-Open No. 2013-179678 [Patent Document 3] Japanese Patent Application Laid-Open No. 2007-180889 [Patent Document 4] Japanese Patent Application Laid-Open No. 2006-13891 [Patent Document 5] International Publication No. 2012 / 081170 [Non-patent literature]

[0006] [Non-Patent Document 1] NETGEAR, “Dynamic QoS (Quality of Service) Prioritization Technology | NETGEAR Nighthawk WiFi Routers”, [online], October 2, 2015, [Searched on May 24, 2021], Internet<URL:https: / / www.youtube.com / watch?v=fpGnk_ZfL5E> [Non-patent document 2] Daisuke Tujino, "A Receiving Bandwidth Control Method Based on Dynamic Priority of Multiple Video Multicast Streams", [online], February 15, 2000, [Retrieved May 24, 2021], Internet<URL:http: / / www.mm.media.kyoto-u.ac.jp / old / research / thesis / 1999 / b / tsujino / tsujino.pdf> Summary of the Invention [Problem to be solved by the invention]

[0007] However, the above-mentioned technology performs dynamic QoS control for each service. Therefore, even if a single service includes multiple devices providing the service, it is not possible to perform QoS control for each of the multiple devices. In this way, when a single service includes multiple devices providing the service, a technology that can perform QoS control for each device is desired.

[0008] Therefore, the present disclosure proposes a mechanism that enables dynamic QoS control within, for example, one service.

[0009] It should be noted that the above problem or object is merely one of multiple problems or objects that can be solved or achieved by multiple embodiments disclosed in this specification. [Means for solving the problem]

[0010] According to the present disclosure, a communication device is provided. The communication device relays communication between an information processing device and multiple devices. The communication device includes a setting unit and a communication unit. The setting unit sets a priority of the communication between the information processing device and the multiple devices based on information transmitted from the information processing device to at least one of the multiple devices. The communication unit relays the communication between the information processing device and the multiple devices according to the priority. [Brief explanation of the drawings]

[0011] [Figure 1] FIG. 1 is a diagram illustrating a configuration example of a communication system according to an embodiment of the present disclosure. [Figure 2] FIG. 1 is a block diagram illustrating a configuration example of an information processing device according to an embodiment of the present disclosure. [Figure 3] FIG. 1 is a block diagram illustrating a configuration example of a base station according to an embodiment of the present disclosure. [Figure 4] FIG. 1 is a block diagram illustrating a configuration example of a communication device according to an embodiment of the present disclosure. [Figure 5] FIG. 1 is a block diagram illustrating an example configuration of a device according to an embodiment of the present disclosure. [Figure 6] FIG. 10 is a diagram illustrating an example of information transmitted by an information processing device according to an embodiment of the present disclosure. [Figure 7] 10 is a flowchart illustrating an example of a relay process executed by a communication device according to an embodiment of the present disclosure. [Figure 8] FIG. 10 is a diagram illustrating a configuration example of a communication system according to a modified example of an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In this specification and drawings, components having substantially the same functional configurations are designated by the same reference numerals, and redundant description will be omitted.

[0013] Furthermore, in this specification and drawings, multiple components having substantially the same functional configuration may be distinguished by adding different letters after the same reference numeral. For example, multiple components having substantially the same functional configuration may be distinguished as necessary, such as devices 50A, 50B, and 50C. However, if there is no need to particularly distinguish between multiple components having substantially the same functional configuration, only the same reference numeral may be used. For example, if there is no need to particularly distinguish between devices 50A, 50B, and 50C, they will simply be referred to as device 50.

[0014] One or more embodiments (including examples and modifications) described below can be implemented independently. However, at least a portion of the embodiments described below may be implemented in appropriate combination with at least a portion of another embodiment. These embodiments may include novel features that are different from one another. Therefore, these embodiments may contribute to solving different purposes or problems and may produce different effects.

[0015] <<1. Introduction>> <1.1.Background> As mentioned above, QoS control is known as a technology that enables users to stably use services provided on a network. Generally, routers installed on a network perform static QoS control based on predetermined rules.

[0016] The communication conditions of the network over which the service is provided change dynamically depending on the number of users connected to the network, the amount of data exchanged over the network, etc. The static QoS control described above has the problem of being unable to respond to such dynamically changing network conditions.

[0017] In response to this, for example, Patent Document 1 describes a network QoS control system that dynamically allocates end-to-end communication quality guaranteed paths to communication devices having multiple communication interfaces and guarantees QoS.

[0018] Furthermore, for example, in the technology disclosed in Patent Document 2, a router monitors the traffic volume of multiple services with the same priority and restricts the traffic volume of services that exceed a predetermined volume, thereby realizing dynamic QoS control.

[0019] Furthermore, for example, the technology disclosed in Patent Document 3 monitors and aggregates service content to realize dynamic QoS control according to the service.

[0020] Furthermore, for example, the technology disclosed in Patent Document 4 realizes dynamic QoS control by dynamically setting QoS for each user using a priority control function supported by a router.

[0021] Furthermore, for example, the technology disclosed in Non-Patent Document 1 realizes dynamic QoS control by automatically recognizing applications (e.g., video, browser, etc.) and terminals (TV, PC, mobile terminal, etc.) and automatically assigning optimal priorities and bandwidths to each.

[0022] As described above, in conventional dynamic QoS control, QoS control is mainly performed on a service-by-service basis. In contrast, when a single service includes multiple devices and the multiple devices communicate with the user, such as when presenting images captured by multiple cameras to a user, it is desirable to perform dynamic QoS control for each of the multiple devices. For example, when presenting images captured by multiple cameras to a user, it is desirable to present to the user the image that the user is looking at with priority over images captured by other cameras.

[0023] As such, a technology for transmitting multiple videos based on dynamic priority is described in, for example, Non-Patent Document 2. This technology allocates bandwidth to each video data stream based on the dynamic priority of the video from the sender, thereby ensuring stable reception by the receiver.

[0024] Furthermore, the technology disclosed in Patent Document 5 achieves dynamic QoS control in the transmission of multiple contents by dividing multiple contents into main contents and standby contents, and allocating a high-quality line to the main content and a low-quality line to the standby content.

[0025] However, in the techniques disclosed in Non-Patent Document 2 and Patent Document 5, either the transmitting side or the receiving side must set a priority, and the other side must control communication in accordance with the priority. As described above, in the conventional techniques, communication control must be performed on both the transmitting side and the receiving side in order to achieve dynamic QoS control, which poses a problem of complicating control processing for the entire system.

[0026] <1.2. Overview of proposed technology> Therefore, in the proposed technology of the present disclosure, a communication device that relays communication between multiple devices that provide a service and an information processing device that receives the service is placed on a communication path of a network that connects the devices and the information processing device.

[0027] The communication device sets a priority of communication between the information processing device and the plurality of devices based on information transmitted from the information processing device to at least one of the plurality of devices, and relays the communication between the information processing device and the plurality of devices according to the set priority.

[0028] For example, the multiple devices are cameras, and the images captured by each camera are provided to an information processing device. The information processing device transmits instruction information to the cameras based on, for example, an instruction from a user. Here, for example, it is assumed that the information processing device transmits an instruction from the user to switch from camera A to camera B.

[0029] The communication device acquires instruction information to switch from camera A to camera B. Based on the instruction information, the communication device detects the user's behavior, in this case, that the camera the user is focusing on has been switched, and sets the priority of camera B higher than the priority of camera A, for example. Based on the set priority, the communication device relays captured images sent from camera B to the information processing device with priority over captured images sent from camera A to the information processing device.

[0030] In this way, a communication device that is disposed between multiple devices that provide one service and an information processing device and that relays communications between the multiple devices and the information processing device sets communication priorities based on information transmitted from the information processing device to the device. The communication device relays communications between the multiple devices and the information processing device based on the set priorities.

[0031] This eliminates the need for special control by multiple devices and information processing devices, and enables the communication device to dynamically change the priority of communication between multiple devices that provide a single service and the information processing device.

[0032] <<2. Example of communication system configuration>> <2.1. Example of overall configuration of communication system> Fig. 1 is a diagram illustrating a configuration example of a communication system 1 according to an embodiment of the present disclosure. In the example illustrated in Fig. 1, the communication system 1 includes an information processing device 10, multiple routers 20A and 20B, a base station 30, a communication device 40, and multiple devices 50A to 50D. Fig. 1 illustrates an example in which a service is provided in which videos captured by multiple devices 50A to 50D placed in a stadium are transmitted to the information processing device 10.

[0033] [Information processing device 10] The information processing device 10 is a device that receives services provided by the communication system 1. The information processing device 10 is, for example, a device such as a PC or a tablet terminal. The information processing device 10 presents the services to be provided to a user and receives instructions regarding the services from the user.

[0034] For example, the information processing device 10 is placed in a location such as a broadcasting station or an office, away from the stadium where the device 50 is placed. The information processing device 10 receives video captured by the device 50. The information processing device 10 also controls the device 50 from a remote location by performing operations such as changing the shooting direction and zooming, and switching the device 50 to be operated, in accordance with instructions from the user.

[0035] [Router 20A] The router 20A is a communication device that relays communication between the information processing device 10 and a network (the Internet in FIG. 1). The router 20A relays information transmitted by the information processing device 10 to the device 50 via the Internet. The router 20A also relays video transmitted by the device 50 to the information processing device 10 via the Internet.

[0036] [Base station 30] The base station 30 performs, for example, wireless communication with the communication device 40. The base station 30 transmits information received from the information processing device 10 via the Internet to the communication device 40. The base station 30 transmits video of the device 50 received from the communication device 40 to the information processing device 10 via the Internet.

[0037] [Communication device 40] The communication device 40 is a relay device that relays communication between the device 50 and the information processing device 10. Here, so-called tethering technology is known as a technology that enables access to the Internet by relaying communication by another device as a relay station. The communication device 40 shown in FIG. 1 serves as a parent device in tethering (hereinafter also referred to as a tethering parent device) and relays communication of the device 50. The communication device 40 may be any device that has a tethering function, and may be, for example, an information processing device such as a smartphone or a tablet terminal.

[0038] [Router 20B] The router 20B is a communication device that relays communication between the communication device 40 and the device 50. The router 20B receives information transmitted by the information processing device 10 from the communication device 40 and relays the information to the device 50. The router 20B also relays video transmitted by the device 50 to the communication device 40.

[0039] Note that the router 20B may be omitted if the communication device 40 can be directly connected to multiple devices 50. Also, instead of the router 20B, a relay device without a routing function (for example, a communication hub) may be placed between the device 50 and the communication device 40.

[0040] [Equipment 50] The device 50 is a device that provides a service to a user via the information processing device 10. A plurality of devices 50A to 50D are provided for one service. In the example of FIG. 1, the device 50 is, for example, a camera that captures video of the stadium in which the device 50 is installed and transmits the video to the information processing device 10.

[0041] <2.2. Configuration example of information processing device> Fig. 2 is a block diagram showing an example configuration of an information processing device 10 according to an embodiment of the present disclosure. The information processing device 10 shown in Fig. 2 includes a network communication unit 110, a storage unit 120, and a control unit 130. Note that the configuration shown in Fig. 2 is a functional configuration, and the hardware configuration may be different. Furthermore, the functions of the information processing device 10 may be distributed and implemented in multiple physically separated configurations. For example, the information processing device 10 may be configured by multiple server devices.

[0042] The network communication unit 110 is a communication interface for communicating with other devices. The network communication unit 110 may be a network interface or a device connection interface. For example, the network communication unit 110 may include a LAN (Local Area Network) interface such as a NIC (Network Interface Card), or a USB (Universal Serial Bus) interface configured by a USB host controller, a USB port, etc. The network communication unit 110 may be a wired interface or a wireless interface. The network communication unit 110 functions as a communication means of the information processing device 10. The network communication unit 110 connects to the Internet via the router 20A under the control of the control unit 130.

[0043] The storage unit 120 is a data readable / writable storage device such as a dynamic random access memory (DRAM), a static random access memory (SRAM), a flash memory, a hard disk, etc. The storage unit 120 functions as a storage means of the information processing device 10.

[0044] The control unit 130 is a controller that controls each unit of the information processing device 10. The control unit 130 is realized by a processor such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). For example, the control unit 130 is realized by the processor executing various programs stored in a storage device inside the information processing device 10 using a RAM (Random Access Memory) or the like as a working area. Note that the control unit 130 may also be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The CPU, MPU, ASIC, and FPGA can all be considered as controllers.

[0045] The control unit 130 presents data (e.g., video data) received from the device 50 via the network communication unit 110 to the user by displaying the data on a display unit (not shown). The control unit 130 also generates information to be transmitted to the device 50 based on, for example, an operation received from the user via an input unit (not shown), and transmits the information via the network communication unit 110.

[0046] <2.3. Example of base station configuration> 3 is a block diagram showing an example configuration of a base station 30 according to an embodiment of the present disclosure. The base station 30 includes a wireless communication unit 310, a storage unit 320, a network communication unit 330, and a control unit 340. Note that the configuration shown in FIG. 3 is a functional configuration, and the hardware configuration may be different. Furthermore, the functions of the base station 30 may be distributed and implemented in multiple physically separated units.

[0047] The wireless communication unit 310 is a wireless communication interface that wirelessly communicates with other wireless communication devices (e.g., communication device 40). The wireless communication unit 310 operates under the control of the control unit 340. The wireless communication unit 310 may support multiple wireless access methods. For example, the wireless communication unit 310 may support both NR and LTE. The wireless communication unit 310 may also support W-CDMA or cdma2000 in addition to NR and LTE. Of course, the wireless communication unit 310 may also support wireless access methods other than NR, LTE, W-CDMA, and cdma2000.

[0048] The wireless communication unit 310 includes a reception processing unit 311, a transmission processing unit 312, and an antenna 313. The wireless communication unit 310 may include a plurality of reception processing units 311, a plurality of transmission processing units 312, and a plurality of antennas 313. Note that when the wireless communication unit 310 supports a plurality of wireless access methods, each unit of the wireless communication unit 310 may be configured separately for each wireless access method. For example, the reception processing unit 311 and the transmission processing unit 312 may be configured separately for LTE and NR.

[0049] The reception processing unit 311 processes an uplink signal received via the antenna 313. The reception processing unit 311 includes a radio reception unit 311a, a demultiplexing unit 311b, a demodulation unit 311c, and a decoding unit 311d.

[0050] The radio receiving unit 311a performs down-conversion, removal of unnecessary frequency components, control of amplification level, quadrature demodulation, conversion to a digital signal, removal of guard intervals, extraction of frequency domain signals by fast Fourier transform, etc. on the uplink signal. The demultiplexing unit 311b separates uplink channels such as PUSCH (Physical Uplink Shared Channel) and PUCCH (Physical Uplink Control Channel) and uplink reference signals from the signal output from the radio receiving unit 311a. The demodulating unit 311c demodulates the received signal using a modulation method such as BPSK (Binary Phase Shift Keying) or QPSK (Quadrature Phase Shift Keying) for the modulation symbols of the uplink channel. The modulation method used by the demodulating unit 311c may be 16QAM (Quadrature Amplitude Modulation), 64QAM, or 256QAM. The decoding unit 311d performs decoding processing on the coded bits of the demodulated uplink channel. The decoded uplink data and uplink control information are output to the control unit 264.

[0051] The transmission processing unit 312 performs transmission processing of the downlink control information and downlink data, and includes an encoding unit 312a, a modulation unit 312b, a multiplexing unit 312c, and a radio transmission unit 312d.

[0052] The encoder 312a encodes the downlink control information and downlink data input from the controller 264 using a coding method such as block coding, convolutional coding, turbo coding, or LDPC (Low Density Parity Check) coding. The modulator 312b modulates the coded bits output from the encoder 312a using a predetermined modulation method such as BPSK, QPSK, 16QAM, 64QAM, or 256QAM. The multiplexer 312c multiplexes the modulation symbols of each channel and the downlink reference signal and allocates the multiplexed signals to predetermined resource elements. The radio transmitter 312d performs various signal processing on the signal from the multiplexer 312c. For example, the radio transmitter 312d performs processing such as conversion to the time domain using a fast Fourier transform, addition of a guard interval, generation of a baseband digital signal, conversion to an analog signal, quadrature modulation, up-conversion, removal of unnecessary frequency components, and power amplification. The signal generated by the transmission processor 312 is transmitted from the antenna 313.

[0053] The storage unit 320 is a data readable / writable storage device such as a DRAM, an SRAM, a flash memory, a hard disk, etc. The storage unit 320 functions as a storage means of the base station 30.

[0054] The network communication unit 330 is a communication interface for communicating with other devices. For example, the network communication unit 330 includes a LAN interface such as a NIC. The network communication unit 330 may be a wired interface or a wireless interface. The network communication unit 330 functions as a network communication means of the base station 30. The network communication unit 330 communicates with other devices under the control of the control unit 340. The configuration of the network communication unit 330 may be the same as that of the network communication unit 110 of the information processing device 10.

[0055] The control unit 340 is a controller that controls each unit of the base station 30. The control unit 340 is realized by a processor such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). For example, the control unit 340 is realized by a processor executing various programs stored in a storage device inside the base station 30 using a RAM (Random Access Memory) or the like as a working area. Note that the control unit 340 may also be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The CPU, MPU, ASIC, and FPGA can all be considered as controllers.

[0056] <2.4. Example of communication device configuration> Fig. 4 is a block diagram showing an example configuration of a communication device 40 according to an embodiment of the present disclosure. The communication device 40 includes a wireless communication unit 410, a storage unit 420, a network communication unit 430, and a control unit 440. Note that the configuration shown in Fig. 4 is a functional configuration, and the hardware configuration may be different from this. Furthermore, the functions of the communication device 40 may be distributed and implemented in multiple physically separated configurations.

[0057] The wireless communication unit 410 is a wireless communication interface that performs wireless communication with other communication devices (for example, the base station 30). The wireless communication unit 410 operates under the control of the control unit 440. The wireless communication unit 410 supports one or more wireless access methods. For example, the wireless communication unit 410 supports both NR and LTE. The wireless communication unit 31 may also support other wireless access methods such as W-CDMA and cdma2000.

[0058] The wireless communication unit 410 includes a reception processing unit 411, a transmission processing unit 412, and an antenna 413. The wireless communication unit 410 may include a plurality of reception processing units 411, a plurality of transmission processing units 412, and a plurality of antennas 413. When the wireless communication unit 410 supports a plurality of wireless access methods, each unit of the wireless communication unit 410 may be configured separately for each wireless access method. For example, the reception processing unit 411 and the transmission processing unit 412 may be configured separately for LTE and NR. The configurations of the reception processing unit 411 and the transmission processing unit 412 are the same as those of the reception processing unit 311 and the transmission processing unit 312 of the base station 30.

[0059] The storage unit 420 is a data readable / writable storage device such as a DRAM, an SRAM, a flash memory, a hard disk, etc. The storage unit 420 functions as a storage means of the communication device 40.

[0060] The network communication unit 430 is a communication interface for communicating with other devices. For example, the network communication unit 430 includes a LAN interface such as a NIC. The network communication unit 430 may be a wired interface or a wireless interface. The network communication unit 430 functions as a network communication means of the communication device 40. The network communication unit 430 communicates with other devices under the control of the control unit 440. The configuration of the network communication unit 430 may be the same as that of the network communication unit 110 of the information processing device 10.

[0061] The control unit 440 is a controller that controls each unit of the communication device 40. The control unit 440 is realized by a processor such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). For example, the control unit 440 is realized by a processor executing various programs stored in a storage device inside the communication device 40 using a RAM (Random Access Memory) or the like as a working area. Note that the control unit 440 may also be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The CPU, MPU, ASIC, and FPGA can all be considered as controllers.

[0062] As shown in FIG. 4, the control unit 440 includes an acquisition unit 441, a setting unit 442, and a communication control unit 443. Each block (acquisition unit 441 to communication control unit 443) constituting the control unit 440 is a functional block indicating a function of the control unit 440. These functional blocks may be software blocks or hardware blocks. For example, each of the above-mentioned functional blocks may be a software module realized by software (including a microprogram), or may be a circuit block on a semiconductor chip (die). Of course, each functional block may be a processor or an integrated circuit. The functional blocks may be configured in any manner. The control unit 440 may be configured by functional units different from the above-mentioned functional blocks.

[0063] (Acquisition section 441) The acquisition unit 441 acquires information transmitted from the information processing device 10 to the device 50. For example, the acquisition unit 441 monitors data relayed from the information processing device 10 to the device 50, and if the monitored data includes control information including a control command for the device 50, acquires the control information. The acquisition unit 441 notifies the setting unit 442 of the acquired information.

[0064] (Setting unit 442) The setting unit 442 sets priorities of communication between the multiple devices 50 and the information processing device 10 based on the information acquired by the acquisition unit 441. For example, the setting unit 442 estimates (detects) user behavior based on the information and sets priorities based on the detection results. The setting unit 442 estimates user behavior by applying, for example, machine learning or an expert system as a behavior prediction algorithm that predicts user behavior.

[0065] The setting unit 442 estimates, for example, the user's behavior (for example, the device 50 of interest) and sets the priority of the device 50 of interest to the user higher than the priorities of the other devices 50.

[0066] When there are a plurality of the above-described other devices 50, the setting unit 442 may set different priorities among the plurality of other devices 50. That is, the setting unit 442 may set, for example, two levels of priority, such as "high" and "low," or may set three or four or more levels of priority, such as "high," "medium," and "low."

[0067] For example, the setting unit 442 may set three or more levels of priority based on information (e.g., control commands) obtained from the information processing device 10 over a certain period of time in the past. More specifically, the setting unit 442 sets the priority according to the user's behavior over a certain period of time in the past. That is, the setting unit 442 sets the priority of the device 50 that is estimated to be currently attracting the user's attention the highest (e.g., priority "high"). Furthermore, the setting unit 442 sets the priority of the device 50 that has attracted the user's attention with a frequency equal to or greater than a predetermined value over a certain period of time in the past to the next highest (e.g., priority "medium"). The setting unit 442 sets the priority of the remaining devices 50, i.e., devices 50 that have not been attracted the user's attention (or the frequency of attention is less than a predetermined value) over the current or past certain period of time to a low level (e.g., priority "low").

[0068] (Communication control unit 443) The communication control unit 443 relays communication between the device 50 and the information processing device 10 based on the priority set by the setting unit 442. For example, the communication control unit 443 controls the wireless communication unit 410 according to the priority and relays communication between the device 50 and the information processing device 10.

[0069] More specifically, the communication control unit 443 controls the order in which data is relayed so that data (e.g., video data) transmitted from a device 50 with a higher priority arrives earlier at the information processing device 10. In other words, the communication control unit 443 relays communication between the device 50 and the information processing device 10 in an order according to the priority.

[0070] For example, when receiving video data from device 50A with a "high" priority and device 50B with a "low" priority, the communication control unit 443 transmits the video data received from device 50A to the base station 30 earlier than the video data received from device 50B.

[0071] Alternatively, the communication control unit 443 relays communication between the device 50 and the information processing device 10 with a delay according to the priority so that the delay is smaller for data transmitted from a device 50 with a higher priority.

[0072] For example, when receiving video data from device 50A with a "high" priority and device 50B with a "low" priority, the communication control unit 443 sets the allowable delay amount of the video data received from device 50A to be smaller than the allowable delay amount of the video data received from device 50B.

[0073] Alternatively, the communication control unit 443 uses larger resources to relay data transmitted from a device 50 with a higher priority. For example, the communication control unit 443 relays communication between the device 50 and the information processing device 10 using a bandwidth according to the priority.

[0074] For example, the communication control unit 443 uses wider frequency resources (bandwidth) among the uplink frequency resources allocated by the base station 30 to relay data of a device 50 with a higher priority to the base station 30. For example, when receiving video data from a device 50A with a "high" priority and a device 50B with a "low" priority, the communication control unit 443 transmits the video data received from the device 50A to the base station 30 using a wider bandwidth than the video data received from the device 50B.

[0075] Here, it has been described that the communication control unit 443 sets communication parameters such as the transmission order (relay order) and the bandwidth to be used in accordance with the priority set by the setting unit 442, but this is not limiting. For example, the setting unit 442 may set communication parameters in accordance with the priority. In this case, the communication control unit 443 controls the wireless communication unit 410 so that communication is performed using the communication parameters set by the setting unit 442.

[0076] <2.5. Equipment configuration example> FIG. 5 is a block diagram showing an example configuration of a device 50 according to an embodiment of the present disclosure. FIG. 5 illustrates a case where the device 50 is a camera (imaging device) with a photographing function. The device 50 includes a network communication unit 510, a storage unit 520, an imaging unit 530, and a control unit 540. Note that the configuration shown in FIG. 5 is a functional configuration, and the hardware configuration may be different. Furthermore, the functions of the device 50 may be distributed and implemented in multiple physically separated configurations.

[0077] The network communication unit 510 is a communication interface for communicating with other devices. The network communication unit 510 may be a network interface or a device connection interface. For example, the network communication unit 510 may include a LAN (Local Area Network) interface such as a NIC (Network Interface Card), or a USB (Universal Serial Bus) interface configured with a USB host controller, a USB port, etc. The network communication unit 510 may be a wired interface or a wireless interface. The network communication unit 510 functions as a communication means of the device 50. The network communication unit 510 connects to the communication device 40 via the router 20B under the control of the control unit 540. The configuration of the network communication unit 510 may be the same as that of the network communication unit 110 of the information processing device 10.

[0078] The storage unit 520 is a data readable / writable storage device such as a dynamic random access memory (DRAM), a static random access memory (SRAM), a flash memory, a hard disk, etc. The storage unit 520 functions as a storage means of the device 50.

[0079] The imaging unit 530 is a camera including at least a lens and an image sensor (CMOS, CCD, etc.) The imaging unit 530 captures moving images or still images under the control of the control unit 540, and generates captured data.

[0080] The control unit 540 is a controller that controls each unit of the device 50. The control unit 540 is realized by a processor such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). For example, the control unit 540 is realized by a processor executing various programs stored in a storage device inside the device 50 using a RAM (Random Access Memory) or the like as a working area. Note that the control unit 540 may also be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). The CPU, MPU, ASIC, and FPGA can all be considered as controllers.

[0081] <<3. Information transmitted from information processing device>> An example of information transmitted from the information processing device 10 to the device 50 will now be described with reference to Fig. 6. Fig. 6 is a diagram for describing an example of information transmitted by the information processing device 10 according to an embodiment of the present disclosure.

[0082] For example, while the device 50 is shooting, the video captured by the device 50 is displayed on the display unit of the information processing device 10. At this time, as shown in Fig. 6, the main video that a user, for example, a cameraman, is trying to shoot is displayed large on the display unit. On the other hand, the sub-video that the user is not paying attention to is displayed small compared to the main video on the display unit. Note that in Fig. 6, the video captured by the devices 50A to 50D (see Fig. 1) is denoted by the symbols of the devices 50A to 50D.

[0083] Assume that at the start of shooting, the user selects device 50A as the camera that will shoot the main video. In this case, as shown in the left diagram of Fig. 6, the image shot by device 50A is displayed large on the display unit as the main video, and the images shot by the other devices 50B to 50D are displayed small on the display unit as sub-videos.

[0084] Next, suppose that the user switches the camera that captures the main video (hereinafter also referred to as the main device) from device 50A to device 50B. In this case, information processing device 10 generates a switching control command (an example of information) for switching the main device and transmits it to devices 50A and 50B.

[0085] The communication device 40 relays the switching control command to the devices 50A and 50B, lowers the priority of the device 50A, and raises the priority of the device 50B. For example, suppose the priority of the device 50A is set to "high" and the priority of the device 50B is set to "low," and the communication device 40 receives a switching control command to switch the main device from 50A to 50B. In this case, the communication device 40 changes the priority of the device 50A from "high" to "low," and changes the priority of the device 50B from "low" to "high." Note that, if multiple levels of priority can be set, the communication device 40 may change the priority of the device 50A, which was set to "high," to "medium." In this way, when lowering the priority, the communication device 40 may lower it to the next lower priority.

[0086] The communication device 40 relays the video from the device 50 to the information processing device 10 with the priority changed in accordance with the switching control command. For example, the communication device 40 relays the video data of the device 50B, whose priority has been switched to "high," with priority over the video data of the other devices 50A, 50C, and 50D.

[0087] The information processing device 10, which has received the video data via the communication device 40, displays the main video larger than the sub-video on the display unit. In the example on the right side of Fig. 6, the information processing device 10 displays the main video of the main device 50B large on the display unit, and displays the sub-videos of the other devices 50A, 50C, and 50D small on the display unit.

[0088] Note that the information transmitted from the information processing device 10 to the device 50 is not limited to the switching control command described above. The information may include various information other than the switching control command, such as an angle switching command for switching the angle of the device 50, a zoom switching command for switching the zoom, a focus command for adjusting the focus, and a setting command for changing the settings of the device 50.

[0089] <<4. Relay Processing>> FIG. 7 is a flowchart showing an example of a relay process executed by the communication device 40 according to an embodiment of the present disclosure.

[0090] 7, the communication device 40 resets the priority settings of the devices 50 and starts communication (step S101). For example, the communication device 40 assigns the same priority to all the devices 50 and relays communication between the devices 50 and the information processing device 10. More specifically, the communication device 40 assigns equal bandwidth (frequency resources) to all the devices 50 and relays communication between the devices 50 and the information processing device 10, for example.

[0091] Next, the communication device 40 acquires a control command (an example of information) transmitted from the information processing device 10 (step S102). The communication device 40 estimates the user's behavior based on the acquired control command, and determines whether to change the priority (step S103).

[0092] For example, if it is estimated based on the control command that the device 50 that the user focuses on has not changed, the communication device 40 determines not to change the priority (step S103; No) and returns to step S102. On the other hand, if it is estimated based on the control command that the device 50 that the user focuses on has changed, the communication device 40 determines to change the priority (step S103; Yes) and sets the priority of the device 50 based on the estimation result (step S104).

[0093] The communication device 40 relays communication between the device 50 and the information processing device 10 according to the set priority (step S105). The communication device 40 determines whether or not the image capturing has finished (step S106).

[0094] If the communication device 40 determines that the image capturing has not ended (step S106; No), it returns to step S102, and if it determines that the image capturing has ended (step S106; Yes), it ends the process.

[0095] As described above, the communication device 40 according to the embodiment of the present disclosure monitors information (e.g., service control commands) transmitted from the information processing device 10, and automatically recognizes (estimates) the behavior of the user receiving the service based on the monitored control commands. The communication device 40 sets a priority order (priority) for the communication to be relayed (e.g., transmission packets including video data) based on the automatically recognized user behavior. The communication device 40 executes communication control such as bandwidth control according to the set priority order.

[0096] In this way, the communication device 40 sets the priority of the device 50 based on the information acquired from the information processing device 10, and relays communication between the information processing device 10 and the device 50 based on the set priority.

[0097] As a result, the communication system 1 can realize dynamic QoS control of the plurality of devices 50 in one service including the plurality of devices 50.

[0098] Furthermore, the communication system 1 can realize dynamic QoS control based on user behavior without requiring the user to perform any special operations, such as setting priorities for the devices 50 in the information processing device 10. Furthermore, the communication system 1 can realize dynamic QoS control based on user behavior without requiring the information processing device 10 and the device 50 to perform processes for dynamic QoS control. In this way, the communication system 1 can more easily realize dynamic QoS control.

[0099] <<5. Modifications>> In the above-described embodiment, the device 50 is connected to the communication device 40 via a wired connection via the router 20B, but this is not limiting. For example, the device 50 may be connected to the communication device 40 wirelessly. FIG. 8 is a diagram illustrating a configuration example of a communication system 1A according to a modified example of an embodiment of the present disclosure. FIG. 8 illustrates a case where the device 50 is an air vehicle such as a drone.

[0100] 8, the devices 50E to 50H are placed in, for example, a factory, and fly and capture images according to instructions from the information processing device 10. For example, the devices 50E and 50H capture bird's-eye images from above the factory, and the devices 50F and 50G patrol the factory and capture images. A user can remotely monitor and guard the factory by checking the images captured by the devices 50E to 50H, for example.

[0101] 8 is similar to the communication system 1 shown in Fig. 1, except that the devices 50E to 50H are flying objects and that the devices 50E to 50H perform wireless communication with the communication device 40. Although Fig. 8 shows a case where there are four devices 50, the number of devices 50 may be three or less or five or more.

[0102] As in the above-described embodiment, the communication device 40 estimates the behavior of a user (e.g., a security officer) (a device 50 of interest) based on information (e.g., a control command for the device 50) transmitted by the information processing device 10. Based on the estimated behavior, the communication device 40 increases the priority of the video data of the device 50 of interest and transmits it to the information processing device 10.

[0103] The communication device 40 of this modified example can perform priority control (dynamic QoS control) based on user behavior not only in uplink communication for transmitting video data to the base station 30, but also in downlink communication for receiving data from the information processing device 10 via the base station 30.

[0104] For example, the communication device 40 may relay to the device 50 a control command for the device 50 that the user is paying attention to, with a higher priority than control commands for other devices 50. Here, the control command for the device 50 may include, for example, a control command related to shooting by the device 50, such as angle switching, as well as a command related to flight control, such as an instruction to move the device 50.

[0105] Furthermore, the communication device 40 may control the priority of communication between the communication device 40 and the device 50, in addition to the priority control of communication between the communication device 40 and the base station 30. The communication device 40 sets the priority of communication between the communication device 40 and the device 50 according to the user's behavior estimated based on information (e.g., a control command, etc.) from the information processing device 10. The communication device 40 communicates with the device 50 based on the set priority.

[0106] For example, assume that the information processing device 10 transmits a switching command to the devices 50E and 50G to switch the video of interest from the video captured by the device 50E to the video captured by the device 50G. In this case, the communication device 40 estimates, based on the switching command, that the device 50 of the user's interest has switched from the device 50E to the device 50G.

[0107] The communication device 40 sets the priority of the device 50 according to the user's behavior (switching of the focused device). For example, the communication device 40 lowers the priority of the device 50E and raises the priority of the device 50G. The communication device 40 communicates with the device 50 according to the priority. For example, the communication device 40 performs communication by using a wider bandwidth for communication with the device 50G than for communication with the device 50E. Note that the communication device 40 may perform priority control in uplink communication from the device 50, or may perform priority control in both uplink communication from the device 50 and downlink communication to the device 50.

[0108] In this way, even when the device 50 and the communication device 40 perform wireless communication, the communication system 1A can perform dynamic QoS control according to the user's behavior, similar to the communication system 1.

[0109] <<6. Other embodiments>> The above-described embodiment and each modified example are merely examples, and various modifications and applications are possible.

[0110] For example, in the above-described embodiment and modified example, the multiple devices 50 arranged in the communication system 1, 1A are connected to the communication device 40 either wirelessly or wired, but this is not limited thereto. The multiple devices 50 may be connected to the communication device 40 in different ways, such as some of the multiple devices 50 being connected wirelessly to the communication device 40 and the rest being connected wired. For example, when a game is filmed in a stadium using a fixed camera and a drone equipped with a camera, the device 50 that is the fixed camera may be connected to the communication device 40 wired, and the device 50 that is the drone may be connected to the communication device 40 wirelessly.

[0111] Furthermore, the number of services provided by one communication system 1 (1A) is not limited to one. For example, one communication system 1 (1A) may provide a plurality of different services, such as relay and security.

[0112] For example, a relay service may be provided to user A by a camera installed in a stadium, and security and monitoring services may be provided to user B by a drone installed in the same stadium. In this case, user A receiving the relay service and user B receiving the security and monitoring services may be the same user or different users.

[0113] Furthermore, the multiple services provided by one communication system 1 (1A) may be services provided from the same location or from different locations. For example, as described above, if one communication system 1 (1A) provides a relay service and a security service, the location where the relay is performed (e.g., a stadium) and the location where security is performed (e.g., a factory) may be different locations.

[0114] Furthermore, in the above-described embodiment and modified example, the communication device 40 sets the priority of communication between the plurality of devices 50 and the information processing device 10, but this is not limiting. Any device that relays communication between the plurality of devices 50 and the information processing device 10 may set the priority. For example, the routers 20A and 20B (see FIGS. 1 and 8) may set the priority based on information transmitted by the information processing device 10.

[0115] For example, the control device that controls the information processing device 10, the communication device 40, and the device 50 of the present embodiment may be realized by a dedicated computer system or a general-purpose computer system.

[0116] For example, a communication program for executing the above-described operations is stored in a computer-readable recording medium such as an optical disk, a semiconductor memory, a magnetic tape, or a flexible disk and distributed. Then, for example, the program is installed in a computer and the above-described processing is executed to configure a control device. In this case, the control device may be a device (e.g., a personal computer) external to the information processing device 10, the communication device 40, and the device 50. Alternatively, the control device may be a device (e.g., a control unit 130, 440, 540) internal to the information processing device 10, the communication device 40, and the device 50.

[0117] The communication program may also be stored in a disk device provided in a server device on a network such as the Internet, and may be downloaded to a computer. The above-mentioned functions may also be realized by cooperation between an OS (Operating System) and application software. In this case, the parts other than the OS may be stored on a medium and distributed, or may be stored in a server device and downloaded to a computer.

[0118] Furthermore, among the processes described in the above embodiments, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using a known method. In addition, the information including the processing procedures, specific names, various data, and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.

[0119] Furthermore, the components of each device shown in the figure are conceptual functional units and do not necessarily have to be physically configured as shown. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads and usage conditions. This distribution and integration configuration may also be performed dynamically.

[0120] The above-described embodiments can be combined as appropriate within the scope of the present invention without causing any inconsistency in the processing content. The order of the steps shown in the flowcharts of the above-described embodiments can be changed as appropriate.

[0121] Furthermore, for example, this embodiment can also be implemented as any configuration that constitutes an apparatus or system, such as a processor as a system LSI (Large Scale Integration), a module using multiple processors, a unit using multiple modules, a set in which other functions are added to a unit, etc. (i.e., a configuration of a part of an apparatus).

[0122] In this embodiment, a system refers to a collection of multiple components (devices, modules (components), etc.), regardless of whether all the components are in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device in which multiple modules are housed in a single housing, are both systems.

[0123] Furthermore, for example, this embodiment can be configured as a cloud computing system in which one function is shared and processed jointly by a plurality of devices via a network.

[0124] <<7. Conclusion>> Although the embodiments of the present disclosure have been described above, the technical scope of the present disclosure is not limited to the above-described embodiments, and various modifications are possible within the scope of the gist of the present disclosure. Furthermore, components of different embodiments and modifications may be combined as appropriate.

[0125] Furthermore, the effects of each embodiment described in this specification are merely examples and are not intended to be limiting, and other effects may also be obtained.

[0126] The present technology can also be configured as follows. (1) A communication device that relays communication between an information processing device and a plurality of devices, a setting unit that sets a priority of the communication between the information processing device and the plurality of devices based on information transmitted by the information processing device to at least one of the plurality of devices; a communication unit that relays the communication between the information processing device and the plurality of devices according to the priority; A communication device comprising: (2) The communication device according to (1), wherein the communication unit relays the communication from the plurality of devices to the information processing device according to the priority. (3) The communication device according to (1) or (2), wherein the communication unit relays the communication from the information processing device to the plurality of devices according to the priority. (4) The communication device according to any one of (1) to (3), wherein the setting unit estimates the behavior of a user who operates the plurality of devices via the information processing device based on the information, and sets the priority according to the estimation result. (5) The communication device according to any one of (1) to (4), wherein the information includes control information for controlling at least one of the plurality of devices. (6) The communication device according to any one of (1) to (5), wherein the communication unit relays the communication using a bandwidth according to the priority. (7) The communication device according to any one of (1) to (6), wherein the communication unit relays the communication in an order according to the priority. (8) The communication device according to any one of (1) to (7), wherein the communication unit relays the communication with a delay time according to the priority. (9) The communication device according to any one of (1) to (8), wherein the setting unit sets the priority in three or more stages based on the information received within a certain period in the past. (10) The communication device according to any one of (1) to (9), wherein the communication unit performs communication according to the priority in the communication with the information processing device via a base station between the device itself and the base station. (11) The communication device according to any one of (1) to (10), wherein the communication unit performs communication between the device itself and the plurality of devices according to the priority. (12) A communication method for relaying communication between an information processing device and a plurality of devices, comprising: setting a priority of the communication between the information processing device and the plurality of devices based on information transmitted by the information processing device to at least one of the plurality of devices; relaying the communication between the information processing device and the plurality of devices according to the priority; A communication method including: (13) an information processing device; a plurality of devices that communicate with the information processing device; a communication device that relays the communication between the information processing device and the plurality of devices; The communication device comprises: a setting unit that sets a priority of the communication between the information processing device and the plurality of devices based on information transmitted by the information processing device to at least one of the plurality of devices; a communication unit that relays the communication between the information processing device and the plurality of devices according to the priority; A communication system comprising: [Explanation of symbols]

[0127] 1. Communication Systems 10. Information processing equipment 20 Router 30 base station 40 Communication equipment 50 equipment 110, 330, 430, 510 Network Communications Department 120, 320, 420, 520 storage section 130, 340, 440, 540 Control unit 310, 410 Radio Communication Department 530 Imaging unit

Claims

1. A communication device that relays communication between an information processing device and a plurality of devices, a setting unit that sets a priority of the communication between the information processing device and the plurality of devices based on information transmitted by the information processing device to at least one of the plurality of devices; a communication unit that relays the communication between the information processing device and the plurality of devices according to the priority; Equipped with the communication unit performs communication between the information processing device and the base station according to the priority in the communication with the information processing device via the base station; Communication equipment.

2. The communication device according to claim 1 , wherein the communication unit relays the communication from the plurality of devices to the information processing device according to the priority.

3. The communication device according to claim 1 , wherein the communication unit relays the communication from the information processing device to the plurality of devices according to the priority.

4. The communication device according to claim 1 , wherein the setting unit estimates an action of a user who operates the plurality of devices via the information processing device based on the information, and sets the priority according to an estimation result.

5. The communication device according to claim 1 , wherein the information includes control information for controlling at least one of the plurality of devices.

6. The communication device according to claim 1 , wherein the communication unit relays the communication using a bandwidth according to the priority.

7. The communication device according to claim 1 , wherein the communication unit relays the communication in an order according to the priority.

8. The communication device according to claim 1 , wherein the communication unit relays the communication with a delay time according to the priority.

9. The communication device according to claim 1 , wherein the setting unit sets the priority to three or more levels based on the information received within a certain period of time in the past.

10. The communication device according to claim 1 , wherein the communication unit performs communication between the device itself and the plurality of devices according to the priority.

11. A communication method for relaying communication between an information processing device and a plurality of devices, comprising: setting a priority of the communication between the information processing device and the plurality of devices based on information transmitted by the information processing device to at least one of the plurality of devices; relaying the communication between the information processing device and the plurality of devices according to the priority; In the communication with the information processing device via a base station, performing communication according to the priority in communication between the device itself and the base station; A communication method including:

12. an information processing device; a plurality of devices that communicate with the information processing device; a communication device that relays the communication between the information processing device and the plurality of devices; The communication device comprises: a setting unit that sets a priority of the communication between the information processing device and the plurality of devices based on information transmitted by the information processing device to at least one of the plurality of devices; a communication unit that relays the communication between the information processing device and the plurality of devices according to the priority; Equipped with the communication unit performs communication between the information processing device and the base station according to the priority in the communication with the information processing device via the base station; Communication system.

Images