Base station device

By using cycle information from XR traffic to set DRX and reconfigure SPS/CG settings, the base station device ensures synchronized video delivery, addressing the challenge of latency and reliability in real-time video content for VR applications.

JP2025090702AActive Publication Date: 2025-06-17SONY GROUP CORP
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2025037447
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2020-07-10
Filing Date
2025-03-10
Publication Date
2025-06-17
Estimated Expiration
2041-06-30

AI Technical Summary

Technical Problem

Existing technologies face challenges in delivering stable real-time video content, particularly in scenarios requiring low latency and high reliability, such as VR applications on wearable devices, due to discrepancies between video reception and display timing.

Method used

A base station device acquires cycle information of XR traffic from a core network and uses this information to set Discontinuous Reception (DRX) settings, ensuring synchronized video delivery by reconfiguring Semi-Persistent Scheduling (SPS) and Configured Grant (CG) settings based on the difference between reception and display timing.

Benefits of technology

This approach ensures stable and synchronized video delivery, reducing Motion-to-photon latency and preventing VR sickness by aligning video reception and display timings, thereby enhancing the overall user experience in VR and AR applications.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025090702000001_ABST
    Figure 2025090702000001_ABST
Patent Text Reader

Abstract

To provide a technology that is to contribute to the realization of stable video content distribution.SOLUTION: A base station device obtains periodicity information of XR traffic from a core network. The periodicity information of XR traffic is indicated by information related to the traffic. The periodicity information of XR traffic is used to set DRX (Discontinuous Reception).SELECTED DRAWING: Figure 13
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to a base station apparatus.

Background Art

[0002] Wireless access methods and wireless networks for cellular mobile communications (hereinafter also referred to as “Long Term Evolution (LTE)”, “LTE-Advanced (LTE-A)”, “LTE-Advanced Pro (LTE-A Pro)”, “New Radio (NR)”, “New Radio Access Technology (NRAT)”, “Evolved Universal Terrestrial Radio Access (EUTRA)”, or “Further EUTRA (FEUTRA)”) are being studied in the 3rd Generation Partnership Project (3GPP (registered trademark)). In the following description, LTE includes LTE-A, LTE-A Pro, and EUTRA, and NR includes NRAT and FEUTRA. In LTE, the base station apparatus (base station, communication apparatus) is an eNodeB (evolved NodeB), in NR, the base station apparatus (base station, communication apparatus) is a gNodeB, and in LTE and NR, the terminal apparatus (mobile station, mobile station apparatus, terminal, communication apparatus) is also referred to as a UE (User Equipment). LTE and NR are cellular communication systems in which a plurality of areas covered by base station apparatuses are arranged in a cell shape. A single base station apparatus may manage a plurality of cells.

[0003] NR has the characteristics of ultra-high speed, low latency, high reliability, and a large number of simultaneous connections. As one of the use cases of NR that takes advantage of such characteristics, for example, the utilization in services using Augmented Reality (AR) and Virtual Reality (VR) is being considered. For example, in the case of AR technology, it is possible to present various forms of virtual content such as text, icons, or animations to the user by superimposing them on real objects captured in the image of the real space. Non-Patent Document 1 and Non-Patent Document 2 disclose the use cases and (potential) requirements of services using Augmented Reality (AR) and Virtual Reality (VR) (e.g., AR / VR games).

Prior Art Documents

Non-Patent Documents

[0004]

Non-Patent Document 1

Non-Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] Due to its characteristics of ultra-high speed, low latency and high reliability, and the ability to support a large number of simultaneous connections, NR is expected to be used for transmitting 4K and 8K videos. In addition, as a post-smartphone technology, the popularization of wearable devices is also anticipated. Among the use cases of wearable devices, there are use cases that require not only the aspect of ultra-high speed but also the aspects of low latency and high reliability. For example, in a case where VR content is displayed on an HMD (Head Mounted Display) via wireless, it is important to keep the Motion-to-photon latency within a certain value to avoid causing VR sickness. Thus, it is required to deliver real-time video content stably so that it can be displayed without interruption.

[0006] Therefore, the present disclosure proposes a technology that contributes to the realization of stable video content delivery.

[0007] Note that the above problems or objectives are only one of the multiple problems or objectives that can be solved or achieved by the multiple embodiments disclosed in this specification.

Means for Solving the Problems

[0008] According to the present disclosure, a base station device is provided. The base station device acquires cycle information of XR traffic from a core network. The cycle information of the XR traffic is indicated by information related to the traffic. The cycle information of the XR traffic is used for the setting of DRX (Discontinuous Reception).

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Figure 22

Figure 23

Figure 24

Figure 25

Figure 26

[0010] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In the present specification and drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted.

[0011] In the present specification and drawings, similar components of the embodiments may be distinguished by attaching different alphabets after the same reference numerals. However, when it is not necessary to particularly distinguish each of the similar components, only the same reference numeral is attached.

[0012] One or more of the embodiments (including examples and variations) described below can each be implemented independently. On the other hand, at least some of the multiple embodiments described below may be implemented in appropriate combination with at least some of other embodiments. These multiple embodiments may include different novel features from each other. Therefore, these multiple embodiments can contribute to solving different objectives or problems from each other and can exhibit different effects from each other.

[0013] Note that the description will be given in the following order. 1. Configuration example of content distribution system 1.1. Overall configuration example of content distribution system 1.2. Configuration example of information processing device 1.3. Configuration example of base station device 1.4. Configuration example of terminal device 1.5. Configuration example of network architecture 2. Information processing example of content distribution system 2.1. Content distribution processing example 2.2. Rendering processing example 2.3. Communication processing example 3. Technical problems 4. Technical features 4.1. Reconfiguration of SPS 4.2. Multiple SPS settings 4.3. Reconfiguration of CG 4.4. Change of time warp 4.5. Priority setting 5. Other embodiments 6. Application examples 7. Conclusion

[0014] <<1. Configuration example of content distribution system>> <1.1. Overall configuration example of content distribution system> FIG. 1 is a diagram showing a configuration example of a content distribution system 100 according to an embodiment of the present disclosure. The content distribution system 100 is a system that distributes video content to a terminal device 110 via a wireless access network. Here, the wireless access network may be an E-UTRAN (Evolved Universal Terrestrial Radio Access Network) or an NG-RAN (Next Generation Radio Access Network).

[0015] The content distribution system 100 includes a terminal device 110, a base station device 130, and an information processing device 150. In the content distribution system 100, video content is distributed from the information processing device 150 to the terminal device 110 via the base station device 130.

[0016] The terminal device 110 and the base station device 130 are connected via the above-described wireless access network. The base station device 130 and the information processing device 150 may be connected via a wireless or wired access network.

[0017] Note that the devices in the figure may be considered as devices in a logical sense. That is, a part of the devices in the figure may be realized by a virtual machine (VM), a container, Docker, etc., and they may be physically implemented on the same hardware.

[0018] Note that an LTE base station may sometimes be referred to as an eNodeB (Evolved Node B) or an eNB. Also, an NR base station may sometimes be referred to as an NGRAN Node (Next Generation RAN node), a gNodeB, or a gNB. Also, in LTE and NR, a terminal device (also referred to as a mobile station, a mobile station device, or a terminal) may sometimes be referred to as a UE (User Equipment). Note that the terminal device is a type of communication device and is also referred to as a mobile station, a mobile station device, or a terminal.

[0019] In this embodiment, the concept of a communication device includes not only portable mobile devices (terminal devices) such as mobile phones, but also devices installed in structures or mobile bodies. The structure or mobile body itself may be regarded as a communication device. Further, the concept of a communication device includes not only terminal devices, but also base station devices. A communication device is a type of processing device and information processing device. Also, a communication device can be rephrased as a transmitting device or a receiving device.

[0020] [Information processing device] The information processing device 150 is a content management device that manages video content for the terminal device 110. The information processing device 150 is, for example, a personal computer, a workstation, or a game device. Also, the information processing device 150 may be a device collectively referred to as a cloud server or an edge server.

[0021] [Base station device] The base station device 130 is a wireless communication device that wirelessly communicates with the terminal device 110. The base station device 130 is a type of communication device. Also, the base station device 130 is a type of information processing device.

[0022] The base station device 130 may be composed of a collection of a plurality of physical or logical devices. For example, in an embodiment of the present disclosure, the base station device 130 may be divided into a plurality of devices such as a BBU (Baseband Unit) and an RU (Radio Unit), and may be interpreted as an aggregate of these plurality of devices. Further or alternatively, in an embodiment of the present disclosure, the base station device 130 may be either or both of the BBU and the RU. The BBU and the RU may be connected by a predetermined interface (for example, eCPRI). Further or alternatively, the RU may be referred to as a Remote Radio Unit (RRU) or a Radio DoT (RD). Further or alternatively, the RU may correspond to the gNB-DU described later. Further or alternatively, the BBU may correspond to the gNB-CU described later. Further or alternatively, the RU may be a device integrally formed with an antenna. The antenna (for example, an antenna integrally formed with the RU) included in the base station device 130 may employ an Advanced Antenna System and support MIMO (for example, FD-MIMO) or beamforming. The Advanced Antenna System may be such that the antenna (for example, an antenna integrally formed with the RU) included in the base station device 130 may include, for example, 64 transmit antenna ports and 64 receive antenna ports. Also, the antenna mounted on the RU may be an antenna panel composed of one or more antenna elements, and the RU may mount one or more antenna panels. For example, the RU may mount two types of antenna panels, an antenna panel for horizontal polarization and an antenna panel for vertical polarization, or two types of antenna panels, an antenna panel for right-hand circular polarization and an antenna panel for left-hand circular polarization. Also, the RU may form and control independent beams for each antenna panel.

[0023] Also, a plurality of base station apparatuses 130 may be connected to each other. One or more base station apparatuses 130 may be included in a Radio Access Network (RAN). That is, the base station apparatus 130 may simply be referred to as a RAN, a RAN node, an AN (Access Network), or an AN node. The RAN in LTE is called EUTRAN (Enhanced Universal Terrestrial RAN). The RAN in NR is called NGRAN. The RAN in W-CDMA (UMTS) is called UTRAN. The base station apparatus 130 of LTE is referred to as an eNodeB (Evolved Node B) or eNB. That is, EUTRAN includes one or more eNodeBs (eNBs). Also, the base station apparatus 130 of NR is referred to as a gNodeB or gNB. That is, NGRAN includes one or more gNBs. Furthermore, EUTRAN may include a gNB (en-gNB) connected to a core network (EPC) in an LTE communication system (EPS). Similarly, NGRAN may include an ng-eNB connected to a core network 5GC in a 5G communication system (5GS). Further or alternatively, when the base station apparatus 130 is an eNB, gNB, etc., it may be referred to as 3GPP Access. Further or alternatively, when the base station apparatus 130 is a wireless access point, it may be referred to as Non-3GPP Access. Further or alternatively, the base station apparatus 130 may be an optical extension device called a Remote Radio Head (RRH). Further or alternatively, when the base station apparatus 130 is a gNB, the base station apparatus 130 may be referred to as a combination of the aforementioned gNB CU (Central Unit) and gNB DU (Distributed Unit) or either of them. The gNB CU (Central Unit) hosts a plurality of upper layers (e.g., RRC, SDAP, PDCP) among the Access Stratum for communication with the UE. On the other hand, the gNB-DU hosts a plurality of lower layers (e.g., RLC, MAC, PHY) among the Access Stratum.That is, among the messages and information described below, RRC signalling (for example, various SIBs including MIB and SIB1, RRCSetup message, RRCReconfiguration message) is generated by the gNB CU, while DCI and various Physical Channels (for example, PDCCH, PBCH) described below may be generated by the gNB-DU. Alternatively, among the RRC signalling, for some configurations such as IE:cellGroupConfig, etc., they may be generated by the gNB-DU, and the remaining configurations may be generated by the gNB-CU. These configurations may be transmitted and received through the F1 interface described below. The base station device 130 may be configured to be communicable with other base station devices 130. For example, when a plurality of base station devices 130 are a combination of eNBs or a combination of an eNB and an en-gNB, the base station devices 130 may be connected through the X2 interface. Further alternatively, when a plurality of base station devices 130 are a combination of gNBs or a combination of a gn-eNB and a gNB, the devices may be connected through the Xn interface. Further alternatively, when a plurality of base station devices 130 are a combination of a gNB CU (Central Unit) and a gNB DU (Distributed Unit), the devices may be connected through the aforementioned F1 interface. The messages and information (information included in RRC signalling or DCI) described below may be communicated between a plurality of base station devices 130 (for example, via the X2, Xn, F1 interfaces).

[0024] Furthermore, as described above, the base station apparatus 130 may be configured to manage a plurality of cells. The cell provided by the base station apparatus 130 is called a Serving cell. The Serving cell includes a PCell (Primary Cell) and an SCell (Secondary Cell). When Dual Connectivity (e.g., EUTRA-EUTRA Dual Connectivity, EUTRA-NR Dual Connectivity (ENDC), EUTRA-NR Dual Connectivity with 5GC, NR-EUTRA Dual Connectivity (NEDC), NR-NR Dual Connectivity) is provided to a UE (e.g., the terminal device 110), the PCell and zero or one or more SCell(s) provided by the MN (Master Node) are called a Master Cell Group. Furthermore, the Serving cell may include a PSCell (Primary Secondary Cell or Primary SCG Cell). That is, when Dual Connectivity is provided to the UE, the PSCell and zero or one or more SCell(s) provided by the SN (Secondary Node) are called a Secondary Cell Group (SCG). Unless a special setting (e.g., PUCCH on SCell) is made, the Physical Uplink Control Channel (PUCCH) is transmitted on the PCell and the PSCell, but not on the SCell. Also, Radio Link Failure is detected on the PCell and the PSCell, but not (not required to be detected) on the SCell. Thus, since the PCell and the PSCell have a special role among the Serving Cell(s), they are also called Special Cell (SpCell). One cell may be associated with one Downlink Component Carrier and one Uplink Component Carrier. Also, the system bandwidth corresponding to one cell may be divided into a plurality of Bandwidth Parts.In this case, one or more Bandwidth Parts (BWPs) may be configured for the UE, and one Bandwidth Part may be used as the Active BWP for the UE. Also, for each cell, for each component carrier, or for each BWP, the radio resources (e.g., frequency band, numerology (subcarrier spacing), slot format) available for the terminal device 110 may be different.

[0025] [Terminal device] The terminal device 110 is a wireless communication device that communicates wirelessly with the base station device 130. The terminal device 110 is, for example, a mobile phone, a smart device (smartphone or tablet), a PDA (Personal Digital Assistant), or a personal computer. The terminal device 110 may also be a head-mounted display (Head Mounted Display) or a VR goggle that has the function of transmitting and receiving data wirelessly.

[0026] Also, the terminal device 110 may be capable of sidelink communication with another terminal device 110. When performing sidelink communication, the terminal device 110 may be able to use automatic retransmission techniques such as HARQ (Hybrid Automatic Repeat reQuest). The terminal device 110 may be capable of NOMA (Non Orthogonal Multiple Access) communication with the base station device 130. Note that the terminal device 110 may also be capable of NOMA communication in communication (sidelink) with another terminal device 110. Also, the terminal device 110 may be capable of LPWA (Low Power Wide Area) communication with other communication devices (e.g., the base station device 130 and another terminal device 110). Additionally, the wireless communication used by the terminal device 110 may be wireless communication using millimeter waves. Note that the wireless communication used by the terminal device 110 (including sidelink communication) may be wireless communication using radio waves, or may be wireless communication (optical wireless) using infrared rays or visible light.

[0027] The terminal device 110 may simultaneously connect to a plurality of base station devices or a plurality of cells to perform communication. For example, when one base station device can provide a plurality of cells, the terminal device 110 can execute carrier aggregation by using a certain cell as a pCell and other cells as sCells. Also, when a plurality of base station devices 130 can each provide one or more cells, the terminal device 110 can use one or more cells managed by one base station device (MN (e.g., MeNB or MgNB)) as a pCell, or as a pCell and sCells(s), and use one or more cells managed by the other base station device (SN (e.g., SeNB or SgNB)) as a pCell (PSCell), or as a pCell (PSCell) and sCells(s) to realize DC (Dual Connectivity). DC may also be referred to as MC (Multi Connectivity).

[0028] Note that when supporting a communication area via cells of different base station devices 130 (a plurality of cells having different cell identifiers or the same cell identifier), by means of carrier aggregation (CA) technology, dual connectivity (DC) technology, or multi-connectivity (MC) technology, it is possible to bundle these plurality of cells and communicate between the base station device 130 and the terminal device 110. Alternatively, it is also possible for the terminal device 110 to communicate with these plurality of base station devices 130 by means of coordinated multi-point transmission and reception (CoMP) technology via cells of different base station devices 130.

[0029] Hereinafter, the configurations of each device constituting the content distribution system 100 will be specifically described. Note that the configurations of each device shown below are merely examples. The configurations of each device may be different from the following configurations.

[0030] <1.2. Configuration Example of Information Processing Device> FIG. 2 is a diagram showing a configuration example of the information processing apparatus 150 according to an embodiment of the present disclosure. The information processing apparatus 150 is, for example, an apparatus that manages or generates video content. The information processing apparatus 150 includes a communication unit 151, a storage unit 152, and a control unit 153. Note that the configuration shown in FIG. 2 is a functional configuration, and the hardware configuration may be different from this. Also, the functions of the information processing apparatus 150 may be implemented in a distributed manner in a plurality of physically separated configurations. For example, the information processing apparatus 150 may be configured by a plurality of server apparatuses.

[0031] The communication unit 151 is a communication interface for communicating with other apparatuses. The communication unit 151 may be a network interface or a device connection interface. For example, the communication unit 151 may be a LAN (Local Area Network) interface such as a NIC (Network Interface Card), or may be a USB (Universal Serial Bus) interface configured by a USB host controller, a USB port, or the like. Also, the communication unit 151 may be a wired interface or a wireless interface. The communication unit 151 functions as a communication means of the information processing apparatus 150. The communication unit 151 communicates with the base station apparatus 130 according to the control of the control unit 153.

[0032] The storage unit 152 is a data-readable and writable storage device such as a DRAM (Dynamic Random Access Memory), an SRAM (Static Random Access Memory), a flash memory, or a hard disk. The storage unit 152 functions as a storage means of the information processing apparatus 150. The storage unit 152 stores, for example, video content.

[0033] The control unit 153 is a controller that controls each part of the information processing apparatus 150. The control unit 153 is realized by a processor such as a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or a GPU (Graphics Processing Unit), for example. For example, the control unit 153 is realized by the processor executing various programs stored in a storage device inside the information processing apparatus 150, with the RAM (Random Access Memory) or the like as a work area. Note that the control unit 153 may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). Any of the CPU, MPU, GPU, ASIC, and FPGA can be regarded as a controller.

[0034] The control unit 153 includes an inertial measurement information acquisition unit 1531, a video data generation unit 1532, and a radio resource allocation request unit 1533. Each block (inertial measurement information acquisition unit 1531 to radio resource allocation request unit 1533) constituting the control unit 153 is a functional block indicating the function of the control unit 153. These functional blocks may be software blocks or hardware blocks. For example, each of the above-described functional blocks may be one software module realized by software (including a microprogram), or may be one circuit block on a semiconductor chip (die). Of course, each functional block may be one processor or one integrated circuit. The method of configuring the functional blocks is arbitrary. Note that the control unit 153 may be configured with functional units different from the above-described functional blocks.

[0035] The inertial measurement information acquisition unit 1531 acquires inertial measurement information from the terminal device 110 via the base station device 130. The inertial measurement information is information related to inertia, and is, for example, information such as acceleration information or angular velocity information of the terminal device 110, or information on a detection result (for example, the direction of the user's line of sight) detected by a sensor mounted on the terminal device 110. The inertial measurement information is, for example, information indicating the state of the user (for example, the direction of the head or line of sight, etc.) using the terminal device 110. As a more specific example, the information related to inertia may be the amount of change in each component in the yaw direction, pitch direction, and roll direction as the movement of the user's head. These components may be detected by sensors (acceleration sensors and angular velocity sensors (gyro sensors)) mounted on the terminal device 110.

[0036] The video data generation unit 1532 determines the area of the video based on the acquired inertial measurement information, and generates video data to be distributed to the terminal device 110. The video data generation unit 1532 determines a video area for distributing the video in the direction the user is looking based on the inertial measurement information, and generates video data.

[0037] The radio resource allocation request unit 1533 requests the base station device 130 to allocate radio resources to be used for transmitting the video data.

[0038] Note that the control unit 153 may acquire information related to an operation input by the user from the terminal device 110 via the base station device 130, determine the area of the video based on the information related to this operation, and generate video data to be distributed to the terminal device 110. Here, the operation input by the user is, for example, an operation in a game, remotely controlling a device, or an operation for driving.

[0039] <1.3. Configuration Example of Base Station Device> Next, the configuration of the base station device 130 will be described. FIG. 3 is a diagram showing a configuration example of the base station device 130 according to an embodiment of the present disclosure.

[0040] The base station device 130 includes a communication unit 131, a memory unit 132, a network communication unit 133, and a control unit 134. Note that the configuration shown in FIG. 3 is a functional configuration, and the hardware configuration may be different from this. Also, the functions of the base station device 130 may be implemented in a distributed manner in a plurality of physically separated configurations.

[0041] The communication unit 131 is a signal processing unit for performing wireless communication with other wireless communication devices (for example, the terminal device 110 and other base station devices 130). The communication unit 131 operates according to the control of the control unit 134. When the other wireless communication device is the terminal device 110, the communication unit 131 may be a wireless transceiver corresponding to one or more wireless access methods. For example, the communication unit 131 supports both NR and LTE. In addition to NR and LTE, the communication unit 131 may support W-CDMA and cdma2000. Also, the communication unit 131 may support communication using NOMA. When the other wireless communication device is another base station device 130, the communication unit 131 may be an X2 interface, an Xn interface, or an F1 interface.

[0042] The communication unit 131 includes a reception processing unit 1311, a transmission processing unit 1312, and an antenna 1314. The communication unit 131 may include a plurality of reception processing units 1311, transmission processing units 1312, and antennas 1314, respectively. When the communication unit 131 supports a plurality of wireless access methods, each part of the communication unit 131 may be individually configured for each wireless access method. For example, the reception processing unit 1311 and the transmission processing unit 1312 may be individually configured for LTE and NR.

[0043] The reception processing unit 1311 processes the uplink signal received via the antenna 1314. The reception processing unit 1311 operates as a reception unit that receives the reception signal. The reception processing unit 1311 includes a wireless reception unit 1311a, a multiplexing separation unit 1311b, a demodulation unit 1311c, and a decoding unit 1311d.

[0044] The wireless receiving unit 1311a performs operations such as down-conversion, removal of unnecessary frequency components, control of amplification level, quadrature demodulation, conversion to digital signals, removal of guard intervals (cyclic prefixes), and extraction of frequency-domain signals by fast Fourier transform on the uplink signal. The multiplexing separation unit 1311b separates uplink channels such as PUSCH (Physical Uplink Shared Channel) and PUCCH (Physical Uplink Control Channel) and uplink reference signals from the signal output from the wireless receiving unit 1311a.

[0045] The demodulation unit 1311c demodulates the received signal using modulation methods such as BPSK (Binary Phase Shift Keying) and QPSK (Quadrature Phase shift Keying) for the modulation symbols of the uplink channel. The modulation method used by the demodulation unit 1311c may be 16QAM (Quadrature Amplitude Modulation), 64QAM, or 256QAM. In this case, the signal points on the constellation do not necessarily have to be equidistant. The constellation may be a non-uniform constellation (NUC: Non Uniform Constellation).

[0046] The decoding unit 1311d performs decoding processing on the encoded bits of the demodulated uplink channel. The decoded uplink data and uplink control information are output to the control unit 134.

[0047] The transmission processing unit 1312 performs transmission processing of downlink control information and downlink data. Thus, the transmission processing unit 1312 is an acquisition unit that acquires a bit sequence such as downlink control information and downlink data from the control unit 134, for example. The transmission processing unit 1312 includes an encoding unit 1312a, a modulation unit 1312b, a multiplexing unit 1312c, and a wireless transmission unit 1312d.

[0048] The symbolization unit 1312a encodes the downlink control information and downlink data input from the control unit 134 using an encoding method such as block coding, convolutional coding, or turbo coding. Note that the symbolization unit 1312a may perform encoding using a Polar code or a Low Density Parity Check Code (LDPC code).

[0049] The modulation unit 1312b modulates the encoded bits output from the symbolization unit 1312a using a predetermined modulation method such as BPSK, QPSK, 16QAM, 64QAM, or 256QAM. In this case, the signal points on the constellation do not necessarily have to be equidistant. The constellation may be a non-uniform constellation.

[0050] The multiplexing unit 1312c multiplexes the modulation symbols of each channel and the downlink reference signal and arranges them in a predetermined resource element. The wireless transmission unit 1312d performs various signal processes on the signal from the multiplexing unit 1312c. For example, the wireless transmission unit 1312d performs processes such as conversion from the time domain to the frequency domain by fast Fourier transform, addition of a guard interval (cyclic prefix), generation of a baseband digital signal, conversion to an analog signal, orthogonal modulation, up-conversion, removal of extra frequency components, and amplification of power. The signal generated by the transmission processing unit 1312 is transmitted from the antenna 1314.

[0051] The storage unit 132 is a storage device capable of reading and writing data, such as a DRAM, SRAM, flash memory, or hard disk. The storage unit 132 functions as a storage means of the base station apparatus 130.

[0052] The network communication unit 133 is a communication interface for communicating with nodes (for example, the information processing apparatus 150) located higher up on the network. For example, the network communication unit 133 may be a LAN interface such as a NIC. Further or alternatively, the network communication unit 133 may be an S1 interface or an NG interface for connecting to a core network node. The network communication unit 133 may be a wired interface or a wireless interface. The network communication unit 133 functions as the network communication means of the base station apparatus 130.

[0053] The control unit 134 is a controller that controls each part of the base station apparatus 130. The control unit 134 is realized, for example, by a processor (hardware processor) such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). For example, the control unit 134 is realized by the processor executing various programs stored in a storage device inside the base station apparatus 130, using a RAM (Random Access Memory) or the like as a work area. Note that the control unit 134 may be realized by an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array). Any of the CPU, MPU, ASIC, and FPGA can be regarded as a controller.

[0054] The control unit 134 includes a radio resource allocation setting unit 1341. The block (radio resource allocation setting unit 1341) that constitutes the control unit 134 is a functional block indicating the function of the control unit 134. The functional block may be a software block or a hardware block. For example, the above-described functional block may be one software module realized by software (including a microprogram), or may be one circuit block on a semiconductor chip (die). Of course, the functional block may be one processor or one integrated circuit. The method of configuring the functional block is arbitrary. Note that the control unit 134 may be configured with functional units different from the above-described functional blocks.

[0055] The radio resource allocation setting unit 1341, for example, executes radio resource allocation in response to a request from the information processing device 150. The radio resource allocation setting unit 1341 may be a function called a scheduler, for example.

[0056] <1.4. Configuration Example of Terminal Device> Next, the configuration of the terminal device 110 will be described. FIG. 4 is a diagram showing a configuration example of the terminal device 110 according to an embodiment of the present disclosure.

[0057] The terminal device 110 includes a communication unit 111, a storage unit 112, an inertial measurement device 114, a control unit 115, and a display unit 116. Note that the configuration shown in FIG. 4 is a functional configuration, and the hardware configuration may be different from this. Also, the functions of the terminal device 110 may be implemented in a distributed manner in a plurality of physically separated configurations.

[0058] The communication unit 111 is a signal processing unit for wireless communication with other wireless communication devices (for example, the base station device 130 and other terminal devices 110). The communication unit 111 operates according to the control of the control unit 115. The communication unit 111 may be a wireless transceiver corresponding to one or more wireless access methods. For example, the communication unit 41 supports both NR and LTE. In addition to NR and LTE, the communication unit 111 may support W-CDMA and cdma2000. Also, the communication unit 111 may support communication using NOMA.

[0059] The communication unit 111 includes a reception processing unit 1111, a transmission processing unit 1112, a network communication unit 113, and an antenna 1114. The communication unit 111 may include a plurality of reception processing units 1111, transmission processing units 1112, and antennas 1114 respectively. The configurations of the communication unit 111, the reception processing unit 1111, the transmission processing unit 1112, and the antenna 1114 are the same as those of the communication unit 131, the reception processing unit 1311, the transmission processing unit 1312, and the antenna 1314 of the base station device 130.

[0060] The storage unit 112 is a data-readable and writable storage device such as a DRAM, SRAM, flash memory, or hard disk. The storage unit 112 functions as the storage means of the terminal device 110.

[0061] The network communication unit 113 is a communication interface for communicating with other devices connected via a network. For example, the network communication unit 113 is a LAN interface such as a NIC. The network communication unit 113 may be a wired interface or a wireless interface. The network communication unit 113 functions as the network communication means of the terminal device 110. The network communication unit 113 communicates with other devices according to the control of the control unit 115. Other devices are, for example, controllers for a user to input information related to operations.

[0062] The inertial measurement device 114, also known as an IMU (Inertial Measurement Unit), is a device that detects the angular velocity and acceleration in three axes. The inertial measurement device 114 includes, for example, an acceleration sensor and a gyro sensor. The inertial measurement device 114 may be equipped with a magnetic field sensor, an air pressure sensor, a temperature sensor, etc. to improve reliability.

[0063] The acceleration information and angular velocity information detected by the inertial measurement device 114 are transmitted to the information processing device 150 as information related to inertia (an example of inertial measurement information and information about the user).

[0064] Alternatively, based on the acceleration information and angular velocity information detected by the inertial measurement device 114, the control unit 115 may calculate the state of the user (such as the direction of the head or line of sight, etc.) and transmit the state of the user to the information processing device 150. The state of the user is information generally referred to as, for example, Pose Information.

[0065] The control unit 115 is a controller that controls each part of the terminal device 110. The control unit 115 is realized by, for example, a processor such as a CPU, MPU, or GPU. For example, the control unit 115 is realized by the processor executing various programs stored in the storage device inside the terminal device 110 with the RAM or the like as a working area. Note that the control unit 115 may be realized by an integrated circuit such as an ASIC or FPGA. Any of the CPU, MPU, GPU, ASIC, and FPGA can be regarded as a controller.

[0066] The control unit 115 includes a video application control unit 1151, a display area specifying unit 1152, and a rendering unit 1153. Each block (video application control unit 1151 to rendering unit 1153) constituting the control unit 115 is a functional block indicating the function of the control unit 115. These functional blocks may be software blocks or hardware blocks. For example, each of the above-mentioned functional blocks may be one software module realized by software (including microprogram), or one circuit block on a semiconductor chip (die). Of course, each functional block may be one processor or one integrated circuit. The configuration method of the functional blocks is arbitrary. Note that the control unit 45 may be configured with functional units different from the above-mentioned functional blocks.

[0067] The video application control unit 1151 is a control unit that controls a video application for playing back video content and the like. The video application control unit 1151 activates the video application, for example, in response to an instruction from the user.

[0068] The display area specifying unit 1152 estimates the user's viewpoint using information related to inertia, and specifies a display area to be displayed on the display unit 116 from the acquired video data.

[0069] Based on the video data acquired from the information processing apparatus 150, the rendering unit 1153 generates an image to be displayed in each frame in accordance with the display area specified by the display area specifying unit 1152, and edits the video.

[0070] The display unit 116 is a display device such as a display, and displays various information such as the image generated by the rendering unit 1153. The display unit 116 is, for example, a non-transmissive type, a video see-through type, or an optical see-through type display. The display unit 116 plays back the video edited by the rendering unit 1153 by displaying the image at a predetermined frame rate.

[0071] <1.5. Configuration Example of Network Architecture> Here, as an example of a communication system applied to the content delivery system 100 according to an embodiment of the present disclosure, the architecture of the fifth-generation mobile communication system (5G) will be described. FIG. 5 is a diagram showing an example of the 5G architecture. The 5G architecture includes a UE (User Equipment) 10, a RAN (Radio Access Network) / AN (Access Network) 230, an NGC (Next Generation Core) / 5GC (5G Core) 20, and a DN (Data Network) 240.

[0072] The 5GC / NGC 20 is also called a 5G core network. The 5GC / NGC 20 is connected to the UE 10 via the RAN / AN 230.

[0073] The RAN 230 is a base station device that provides a wireless interface, and the AN 230 is, for example, an access point or a router that provides a wired interface. The RAN / AN 230 includes a base station device called a gNB or an ng-eNB.

[0074] The 5GC / NGC 20 is configured to include a control plane function group 21 and a UPF (User Plane Function) 220.

[0075] The control plane function group 21 includes an AUSF (Authentication Server Function) 201, a NEF (Network Exposure Function) 202, an NRF (Network Repository Function) 203, an NSSF (Network Slice Selection Function) 204, a PCF (Policy Control Function) 205, an SMF (Session Management Function) 206, a UDM (Unified Data Management) 207, an AF (Application Function) 208, and an AMF (Access Management Function) 209.

[0076] The UDM 207 has functions for generating 3GPP AKA authentication information and processing user IDs. The UDM 207 includes a UDR (Unified Data Repository) that holds and manages subscriber information and a FE (Front End) part that processes subscriber information.

[0077] Also, the AMF 209 has functions such as UE 10 registration processing, connection management, and mobility management.

[0078] The SMF 206 has functions such as session management and IP allocation and management for the UE 10. The AUSF 201 has an authentication function. The NSSF 204 has a function related to network slice selection. The NEF 202 has a function of providing network function capabilities and events to third parties, the AF 208, and edge computing functions.

[0079] The NRF 203 has functions for discovering network functions and holding network function profiles. The PCF 205 has a policy control function. The AF 208 has a function of interacting with the core network to provide services.

[0080] Also, the UPF (User Plane Function) 220 has the function of user plane processing. The DN 240 is an entity that provides a connection to an operator-specific service such as an MNO (Mobile Network Operator), an entity that provides an Internet connection, or an entity that provides a connection to a third-party service.

[0081] Here, Namf is a service-based interface provided by the AMF 209, and Nsmf is a service-based interface provided by the SMF 206. Also, Nnef is a service-based interface provided by the NEF 202, and Npcf is a service-based interface provided by the PCF 205. Nudm is a service-based interface provided by the UDM 207, and Naf is a service-based interface provided by the AF 208. Nnrf is a service-based interface provided by the NRF 203, and Nnssf is a service-based interface provided by the NSSF 204. Nausf is a service-based interface provided by the AUSF 201. Each of these NFs (Network Functions) exchanges information with other NFs via each service-based interface.

[0082] Also, N1 is a reference point between the UE 10 and the AMF 209, and N2 is a reference point between the RAN / AN 230 and the AMF 209. N4 is a reference point between the SMF 206 and the UPF 220, and information is exchanged mutually between these NFs (Network Functions).

[0083] An example of the UE 10 is the terminal device 110 of this embodiment. An example of the RAN / AN 230 is the base station device 130 of this embodiment.

[0084] Alternatively, the information processing apparatus 150 may be an edge server installed within (or in the vicinity of) the 5GC / NGC 20, or a cloud server (not shown), or a cloud server installed within the Internet.

[0085] Alternatively, the information processing apparatus 150 may be composed of, for example, a plurality of devices including the 5GC. In this case, the inertial measurement information acquisition unit 1531 may be implemented in the AF 208, and the radio resource allocation request unit 1533 may be implemented as a function of the AMF 209 or the SMF 206. The video data generation unit 1532 corresponds to an edge server installed within the 5GC / NGC 20, or a cloud server (not shown), or a cloud server (not shown) installed within the Internet. Also, the video data generation unit 1532 may be implemented in the AF 208.

[0086] <<2. Information Processing Example of Content Delivery System>> Next, an example of the information processing executed by the content delivery system 100 will be described. <2.1. Content Delivery Processing Example> FIG. 6 is a sequence diagram showing an example of content delivery processing according to an embodiment of the present disclosure.

[0087] First, the terminal device 110 activates a video application in response to, for example, a user's instruction (step S101), and requests the information processing apparatus 150 to deliver video content specified by the video application via the base station device 130 (step S102).

[0088] The terminal device 110 measures information related to inertia (step S103), and transmits the measured information related to inertia to the information processing apparatus 150 via the base station device 130 (step S104). Note that the processes of step S103 and step S104 are executed according to a fixed or variable period, or an event.

[0089] The information processing apparatus 150 determines the area of the video to be transmitted to the terminal device 110 based on the acquired information related to inertia (step S105), and generates video data for the determined area (step S106).

[0090] The information processing apparatus 150 transmits the generated video data to the terminal device 110 via the base station apparatus 130 (step S107).

[0091] The terminal device 110 determines the display area of the video data acquired based on the latest measured information related to inertia (step S108). The terminal device 110 generates an image to be displayed in each frame according to the determined display area from the acquired video data, edits the video, and then displays it on the display unit 116 (step S109).

[0092] <2.2. Rendering Processing Example> Subsequently, with reference to FIG. 7, an example of the rendering process executed by the terminal device 110 will be described. FIG. 7 is a diagram for explaining an example of the rendering process according to an embodiment of the present disclosure. The rendering process described here is executed, for example, in step S109 of FIG. 6.

[0093] FIG. 7 shows the display timing of an image (hereinafter also referred to as a frame image) generated by the terminal device 110, in other words, the timing for displaying the frame image.

[0094] The terminal device 110 displays a video on the display unit 116 by updating (generating) a frame image, which is a still image, at a period corresponding to the frame rate.

[0095] For example, when the frame rate is K [fps], K frame images #n (n is an integer from 1 to (K + 1)) are generated and displayed on the display unit 116 per second. In this case, the update period of the frame image is 1 / K seconds.

[0096] Next, with reference to FIG. 8, another example of the rendering process executed by the terminal device 110 will be described. FIG. 8 is a diagram for explaining another example of the rendering process according to the embodiment of the present disclosure. The rendering process described here is executed, for example, in step S109 of FIG. 6.

[0097] When performing the rendering process of the frame image, the drawing of the frame image may be performed using a technique called Timewarp. Timewarp is a technique for generating an image of a display area predicted based on acquired video data and information related to the latest inertia in order to keep the Motion-to-photon latency within a certain value. As one application example of this Timewarp, the rendering unit 1153 sets the frame rate to be displayed on the display unit 116 to m times (m>1) the frame rate of the video data acquired from the information processing device 150.

[0098] Further, the rendering unit 1153 may apply Timewarp to the drawing of each frame image in order to keep the Motion-to-photon latency within a certain value in a delay environment caused by wireless communication between the information processing device 150 and the terminal device 110.

[0099] Here, in VR, it is known that a phenomenon called VR sickness occurs due to the "discrepancy" between the screen seen in front of the eyes with a head-mounted display (HMD) and one's own physical sensations. For example, when the user turns around and the scenery on the screen changes, the scenery actually displayed on the HMD in front of the eyes may be slightly delayed from the scenery that the user thinks should be like this based on their own sensations. Such a delay is called Motion-to-photon latency. Alternatively, when the user recognizes depth (space) and moves, the scenery actually displayed on the HMD in front of the eyes may be shifted from the scenery that the user thinks will be visible after the movement. When such delays and shifts occur, VR sickness is likely to occur.

[0100] As a method for improving this VR sickness, a method of increasing the frame rate of the frame image displayed on the display unit is known. By increasing the frame rate, the difference between the scenery assumed by the user and the scenery actually displayed on the display unit becomes smaller, and the occurrence of VR sickness can be suppressed.

[0101] Furthermore, by applying the above-mentioned time warp to reduce the Motion-to-photon latency, VR sickness can be improved.

[0102] In the rendering process described with reference to FIG. 7, the frame rate is K [fps], and the frame image is updated every 1 / K seconds. More specifically, the terminal device 110 generates frame images #1, #2,... from the video data acquired from the information processing device 150 every 1 / K seconds. At this time, the terminal device 110 generates the frame images #1, #2,... using the video data acquired each time.

[0103] Therefore, when the terminal device 110 attempts to increase the frame rate, for example, to suppress the occurrence of VR sickness, it is necessary to shorten the period for acquiring video data, which increases the load on wireless communication.

[0104] Therefore, the terminal device 110 uses the time warp technique to increase the frame rate of the frame image displayed on the display unit 116 without changing the period for acquiring video data from the information processing device 150.

[0105] As shown in FIG. 8, the terminal device 110 generates a frame image #1 using the acquired video data D1 and displays it on the display unit 116. Further, the terminal device 110 generates a frame image #1-1 using the acquired video data D1 and displays it on the display unit 116. At this time, the terminal device 110 performs time warp processing on the video data D1 using the information related to the latest inertia to generate the frame image #1-1. The terminal device 110 uses the information related to the latest inertia to determine the user's viewpoint or the field of view including the viewpoint, and determines the display area based on the determined line-of-sight direction. This display area is also called a viewport. The terminal device 110 extracts the determined display area from the video data D1 to generate the frame image #1-1. In this case, the information related to inertia can be measured at a period shorter than, for example, the display period of the frame image displayed on the display unit 116.

[0106] In this way, the terminal device 110 can increase the frame rate without shortening the acquisition period of the video data by generating a plurality of frame images from one video data using the information related to the latest inertia measured at different times. For example, in FIG. 8, the terminal device 110 generates two frame images #1 and #1-1 from one video data D1. As a result, the terminal device 110 can shorten the period (hereinafter also referred to as the frame period) displayed on the display unit 116 to 1 / 2 compared to the case of generating one frame image #1 from one video data D1.

[0107] The terminal device 110 can reduce the Motion-to-photon latency and suppress VR sickness by reflecting the change in the information related to inertia in the same video data to shorten the frame period. In this way, the method of reflecting the change in the information related to inertia in the same video data is called the above-mentioned time warp or asynchronous time warp (ATW). By applying this time warp or asynchronous time warp, the Motion-to-photon latency can be reduced and the frame period can be shortened.

[0108] <2.3. Communication Processing Example> Next, an example of the communication processing executed in the content distribution system 100 will be described with reference to FIGS. 9 to 11. As described above with reference to FIG. 5, in the content distribution system 100, the NR network architecture is applied.

[0109] Here, in the NR network architecture, for the UE 10 to receive services via the 5GC / NGC 20, for example, registration to the 5GC / NGC 20 (Registration) is performed. The UE 10 selects, for example, a PLMN (Public Land Mobile Network) corresponding to the 5GC / NGC 20 and executes a registration process (Registration Procedure).

[0110] Hereinafter, an example of the communication processing performed for the UE 10 to receive services via the 5GC / NGC 20, including such a registration process, will be described with reference to FIGS. 9 to 11.

[0111] (Registration Process) First, the registration process performed by the UE 10 will be described with reference to FIG. 9. FIG. 9 is a sequence diagram showing an example of the registration process according to an embodiment of the present disclosure.

[0112] As shown in FIG. 9, the UE 10 in the RM-DEREGISTERED state, that is, the UE 10 not registered to the 5GC / NGC 20, transmits a Registration Request message to the RAN / AN 230 to execute an initial registration (step S301). At this time, the UE 10 transmits the UE identity included in the registration request message.

[0113] If the UE identity has a valid EPS GUTI, it is the 5G-GUTI mapped from the EPS GUTI. Here, EPS (Evolved Packet System) refers to the 4G system corresponding to LTE (Long Term Evolution), which is composed of EUTRAN and EPC. EPS GUTI (Globally Unique Temporary Identifier) is a temporary ID used to identify the UE within EPS instead of the ID uniquely assigned to each UE, such as IMSI (International Mobile Subscriber Identity) and IMEI (International Mobile Equipment Identity), from a security perspective.

[0114] Alternatively, if available, the UE identity is the PLMN-specific 5G-GUTI assigned by the PLMN to which UE10 is attempting to register.

[0115] Alternatively, if available, the UE identity is the PLMN-specific 5G-GUTI assigned by the PLMM that is treated as an equivalent PLMN for the PLMN (Public Land Mobile Network) to which UE10 is attempting to register.

[0116] Alternatively, if available, the UE identity is the PLMN-specific 5G-GUTI assigned by any PLMN.

[0117] Otherwise, UE10 includes the SUCI (Subscription Concealed Identifier) in the registration request message. Here, SUCI is an ID obtained by encrypting the SUPI (Subscription Permanent Identifier), which is an ID uniquely assigned to each UE10.

[0118] UE10 includes in the registration request message the mapping of each S-NSSAI (Single NSSAI) of the Requested NSSAI to the S-NSSAIs of the HPLMN (Home PLMN). Thereby, it can be confirmed whether the S-NSSAI(s) of the Requested NSSAI (Network Slice Selection Assistance Information) can be permitted based on the Subscribed S-NSSAIs.

[0119] Also, if UE10 is using the Default Configured NSSAI, UE10 includes the Default Configured NSSAI Indication in the registration request message.

[0120] Here, an S-NSSAI is composed of a mandatory SST (Slice / Service Type) that identifies the slice type and an optional SD (Slice Differentiator) for differentiating different slices within the same SST. Note that the mandatory SST is 8 bits and the optional SD is 24 bits.

[0121] In addition, all or each of the services for applications of AR, VR, MR (Mixed Reality), SR (Substitutional Reality), XR (X Reality, or Extended Reality) may be defined as slices identified by this S-NSSAI. In other words, the services for applications of AR, VR, MR, SR, XR may be realized by one or more network slices. That is, one or more S-NSSAIs may be associated with the services for applications of AR, VR, MR, SR, XR.

[0122] Here, AR, also called augmented reality, is a technology that overlays and expands a virtual world, such as 3D videos and characters created by CG (Computer Graphics), onto the real world.

[0123] VR, also called virtual reality, is a technology that enables the experience of a virtual world created by 360° video captured by CG or 360° cameras.

[0124] MR, also called mixed reality, is a technology that closely fuses the real world and the virtual world to represent the virtual world more realistically.

[0125] SR, also called substitute reality, is a technology that replaces the virtual world with the real world for recognition.

[0126] XR is a general term for technologies that create experiences with some changes to the real world, including AR, VR, MR, and SR.

[0127] When receiving a registration request message from UE10, RAN / AN230 performs AMF Selection (step S302). If the registration request message does not contain a 5G-S-TMSI (5G S-Temporary Mobile Subscription Identifier) or a GUAMI (Globally Unique AMF Identifier), RAN / AN230 selects AMF209 based on the (R)AT (Radio Access Technology) and, if available, the Requested NSSAI. Alternatively, if the 5G-S-TMSI or GUAMI in the registration request message does not indicate a valid AMF209, RAN / AN230 selects AMF209 based on the (R)AT and, if available, the Requested NSSAI.

[0128] When RAN / AN230 is NG-RAN, transfer the registration request including the selected PLMN ID or the combination of the PLMN ID identifying the SNPN (Standalone NonPublic Network) and the NID (Network Identifier) to AMF209 (step S303).

[0129] If UE10 does not provide the SUCI to AMF209, AMF209 starts the Identity Request process, sends an Identity Request message to UE10, and requests the SUCI (step S304).

[0130] When UE10 receives the Identity Request message in step S304, it responds with an Identity Response message including the SUCI (step S305). Here, UE10 can obtain the SUCI using the public key of the HPLMN.

[0131] Based on the SUPI or SUCI, AMF209 performs AUSF Selection (step S306) and initiates the authentication of UE10.

[0132] When AUSF201 receives an authentication request from AMF209, it must perform the authentication of UE10.

[0133] As an authentication process, AUSF201 selects UDM207 and obtains authentication data from UDM207.

[0134] When UE10 is authenticated, AUSF201 provides security-related information to AMF209.

[0135] When the authentication is successful with AMF209, AMF209 starts NGAP (NG Application Protocol) processing and provides a security context to RAN / AN230.

[0136] RAN / AN230 retains the security context and returns a response to AMF209.

[0137] RAN / AN230 then uses this security context to protect the messages exchanged with UE10.

[0138] AMF209 performs UDM Selection based on the SUPI and selects UDM207 (step S307).

[0139] AMF209 registers with UDM207 using Nudm_UECM_Registration (step S308).

[0140] If AMF209 does not have the subscriber information (Subscription Data) of UE10, it uses Nudm_SDM_Get (step S309) to obtain Subscription Data such as Access and Mobility Subscription data and SMF Selection Subscription data (step S310).

[0141] After AMF209 obtains the Access and Mobility Subscription data from UDM207, it generates a UE context. The Access and Mobility Subscription data includes information indicating whether the NSSAI may be included in plain text in the RRC Connection Establishment for 3GPP Access.

[0142] AMF209 sends a Registration Accept to UE10 (step S311). The registration acceptance message contains the 5G-GUTI and the Registration Area. The N2 message containing the registration acceptance message includes the Allowed NSSAI.

[0143] The Allowed NSSAI only includes S-NSSAIs that do not require Network Slice-Specific Authentication and Authorization based on the subscriber information, or S-NSSAIs that have successfully passed Network Slice-Specific Authentication and Authorization based on the UE context of AMF209.

[0144] Also, for UE10 registered to a PLMN, AMF209 may provide a list of equivalent PLMNs, but for UE10 registered to an SNPN, AMF209 must not provide a list of equivalent PLMNs.

[0145] UE10 sends a Registration Complete message to AMF209 to notify that a new 5G-GUTI has been assigned (step S312).

[0146] According to the above registration process, UE10 enters the registered state with 5GC / NGC20, that is, the RM-REGISTERED state.

[0147] (PDU Session Establishment Process) Next, with reference to FIG. 10, the PDU session establishment process performed by UE10 will be described. FIG. 10 is a sequence diagram showing an example of the PDU session establishment process according to an embodiment of the present disclosure.

[0148] The UE 10 registered in the AMF 209 transmits a PDU Session Establishment Request message to the AMF 209 as shown in FIG. 10 (step S401). Here, the PDU Session Establishment Request message includes, among the Allowed NSSAI, the S-NSSAI corresponding to the requested service and the UE Requested DNN (Data Network Name). The UE Requested DNN is, for example, a DNN that enables connection to services such as AR, VR, MR, SR, and XR.

[0149] Upon receiving the PDU Session Establishment Request message, the AMF 209 performs SMF Selection (step S402). Here, if the PDU Session Establishment Request message includes the S-NSSAI and does not include the DNN, the default DNN for this S-NSSAI is selected as the DNN. For example, assume that all of the services for AR, VR, MR, SR, and XR applications, or each of them, is defined as a slice identified by a specific S-NSSAI. In this case, the default DNN for the specific S-NSSAI is the DNN that enables connection to the services of AR, VR, MR, SR, and XR.

[0150] The AMF 209 transmits an Nsmf_PDUSession_CreateSMContext Request including the S-NSSAI of the Allowed NSSAI to the selected SMF 206 (step S403). Here, the Nsmf_PDUSession_CreateSMContext Request includes the SUPI, S-NSSAI, UE Requested DNN, or DNN.

[0151] If the Session Management Subscription data corresponding to the SUPI, DNN, and S-NSSAI is not available, the SMF206 retrieves the Session Management Subscription data from the UDM207 using Nudm_SDM_Get. Also, the SMF206 registers using Nudm_SDM_Subscribe to be notified when the Session Management Subscription data is updated.

[0152] Upon receiving the Nsmf_PDUSession_CreateSMContext Request, if the SMF206 can process the PDU session establishment request, it generates an SM context. Then, the SMF206 responds to the AMF209 with the Nsmf_PDUSession_CreateSMContext Response to provide the SM Context ID (step S404).

[0153] If a second authentication and authorization process by the DN-AAA server is required during the establishment of the PDU session, the SMF206 initiates the PDU Session establishment authentication / authorization process (step S405).

[0154] If dynamic PCC (Policy and Charging Control) is applied to the PDU session to be established, the SMF206 performs PCF Selection (step S406). Otherwise, the SMF206 may apply local policies.

[0155] Also, SMF206 may execute the SM Policy Association Establishment procedure (step S407) to establish an SM Policy Association with PCF205 and obtain default PCC Rules for the PDU session. Thereby, PCC Rules can be obtained before selecting UPF220.

[0156] SMF206 executes UPF Selection to select one or more UPF220s (step S408).

[0157] SMF206 sends an N4 Session Establishment Request message to the selected UPF220 (step S409).

[0158] UPF220 returns an N4 Session Establishment Response message to respond to SMF206 (step S410).

[0159] If multiple UPF220s are selected for the PDU session, this N4 session establishment process is initiated for each UPF220.

[0160] The SMF 206 sends a Namf_Communication_N1N2MessageTransfer message to the AMF 209 (step S411). Here, the Namf_Communication_N1N2MessageTransfer message includes a PDU Session ID, N2 SM information, CN Tunnel Info, the S-NSSAI of the Allowed NSSAI, and an N1 SM container. Here, the N2 SM information includes a PDU Session ID, QFI(s), QoS Profile(s), etc. Also, when multiple UPFs 220 are used for a PDU session, the CN Tunnel Info includes tunneling information related to these multiple UPFs 220 that terminate N3.

[0161] The N1 SM container includes a PDU Session Establishment Accept that the AMF 209 must provide to the UE 10. Also, the PDU Session Establishment Accept includes the S-NSSAI of the Allowed NSSAI.

[0162] The Namf_Communication_N1N2MessageTransfer message includes a PDU Session ID so that the AMF 209 knows which access to use for the UE 10.

[0163] The AMF 209 sends an N2 PDU Session Request message to the RAN / AN 230 (step S412). Here, the AMF 209 sends, via the N2 PDU Session Request message, a NAS (Non-Access-Stratum) message including a PDU Session ID destined for the UE 10 and a PDU Session Establishment Accept, and the N2 SM information received from the SMF 206 to the RAN / AN 230.

[0164] The RAN / AN 230 transfers a NAS message including the PDU Session ID and the N1 SM container to the UE 10 (step S413). Here, the N1 SM container includes the PDU Session Establishment Accept.

[0165] The RAN / AN 230 responds to the AMF 209 with an N2 PDU Session Response message (step S414).

[0166] The AMF 209 transfers the N2 SM information received from the RAN / AN 230 to the SMF 206 via an Nsmf_PDUSession_UpdateSMContext Request message including the SM Context ID and the N2 SM information (step S415).

[0167] The SMF 206 initiates an N4 Session Modification procedure with the UPF 220 and sends an N4 Session Modification Request message to the UPF 220 (step S416). The SMF 206 provides AN Tunnel Info in addition to the transfer rules to the UPF 220.

[0168] UPF 220 responds to the SMF 206 with an N4 Session Modification Response message (step S417). When multiple UPF 220s are used in a PDU session, all UPF 220s that terminate N3 are the targets for the above N4 session modification procedure.

[0169] According to the above processing, a PDU session is established.

[0170] Note that for each QoS flow, the QoS Profile must include QoS parameters. The QoS parameters are, for example, 5QI (5G QoS Identifier) and ARP (Allocation and Retention Priority).

[0171] The QoS flow may be either "GBR (Guaranteed Bit Rate)" or "Non-GBR" according to the QoS Profile.

[0172] For a Non-GBR QoS flow, the QoS Profile may include a QoS parameter called RQA (Reflective QoS Attribute).

[0173] For a GBR QoS flow, the QoS parameters of Guaranteed Flow Bit Rate (GFBR) and Maximum Flow Bit Rate (MFBR) for both the uplink and downlink must be included.

[0174] 5QI is a parameter for the access node to control the transfer processing of the QoS flow. For example, it includes scheduling weights, admission thresholds, queue management thresholds, link layer settings, etc.

[0175] The ARP contains information regarding the priority level, pre-emption capability, and pre-emption vulnerability.

[0176] The priority level of the ARP defines the relative importance of the QoS flow and is set in the range from 1 to 15, with the highest importance being 1.

[0177] The pre-emption capability of the ARP is an indicator that defines whether a QoS flow can use the resources already allocated to other QoS flows with a lower priority level.

[0178] The pre-emption vulnerability of the ARP is an indicator that defines whether a QoS flow will release the resources allocated to it to allow other QoS flows with a higher priority level.

[0179] For the pre-emption capability and pre-emption vulnerability of the ARP, either "enabled" or "disabled" must be set.

[0180] (RRC_CONNECTED Transition Procedure) The signaling between the UE10 and the core network (e.g., AMF209) is performed by NAS signaling. The NAS signaling connection is used to enable this NAS signaling.

[0181] The NAS signaling connection is composed of an AN signaling connection between the UE10 and the AN (Access Network) and an N2 connection between the AN and the AMF209. Here, the AN signaling connection is, for example, an RRC (Radio Resource Control) connection.

[0182] Therefore, with reference to FIG. 11, the RRC_CONNECTED transition process for transitioning the RRC state of the UE 10 from RRC_IDLE to RRC_CONNECTED will be described. FIG. 11 is a sequence diagram showing an example of the RRC_CONNECTED transition process according to an embodiment of the present disclosure. The RRC_CONNECTED transition process is activated by the UE 10 (an example of the terminal device 110) when transitioning from RRC_IDLE to RRC_CONNECTED.

[0183] First, it is assumed that the UE 10 is in the RRC_IDLE and CM-IDLE states (step S500). Here, the RRC_IDLE state is a state in which no RRC connection is established with the base station device 130. The CM-IDLE state is a state in which no NAS signaling connection via N1 is established with the AMF 209.

[0184] The UE 10 transmits an RRC setup request (RRCSetupRequest) message via the SRB (Signalling Radio Bearer) 0 for a new connection with the base station device 130 (step S501).

[0185] When the UE 10 receives an RRC setup (RRCSetup) message from the base station device 130 (step S502), it transitions the RRC state from RRC_IDLE to RRC_CONNECTED and maintains CM-IDLE as it is (step S503).

[0186] When the base station device 130 receives an RRC setup complete (RRCSetupComplete) message from the UE 10 (step S504), it completes the RRC setup process, and the UE 10 transitions to CM-CONNECTED (step S505).

[0187] The first NAS message (INITIAL UE MESSAGE) from the UE 10 included in the RRC setup complete (RRCSetupComplete) message is transmitted to the AMF 209 (step S506).

[0188] Here, the first NAS message is, for example, a Registration Request message (refer to step S301 in FIG. 9), or a PDU Session Establishment Request message (step S401 in FIG. 10). Also, several NAS messages are exchanged between the UE 10 and the AMF 209.

[0189] The AMF 209 prepares UE context data and transmits the UE context data to the base station device 130 via an INITIAL CONTEXT SETUP REQUEST message (step S507). Here, the UE context data includes a PDU session context, a security key, UE radio capability, and UE security capabilities, etc.

[0190] The base station device 130 transmits a SecurityModeCommand message to the UE 10 (step S508). When the UE 10 transmits a SecurityModeComplete message to the base station device 130 via the SRB1 (step S509), the base station device 130 activates the AS (Access-Stratum) security.

[0191] To configure the SRB2 and DRBs (Data Radio Bearers), the base station device 130 transmits an RRCReconfiguration message to the UE 10 (step S510). When the UE 10 transmits an RRCReconfigurationComplete message to the base station device 130 via the SRB1 (step S511), the RRC reconfiguration process is completed.

[0192] The base station device 130 transmits an INITIAL CONTEXT SETUP RESPONSE message to the AMF 209 (step S512) to notify that the setting process has been completed.

[0193] (Settings of SPS-Config and ConfiguredGrantConfig) When the AMF 209 receives a PDU session establishment request message (see step S401 in FIG. 10) including an S-NSSAI (for example, S-NSSAI1) corresponding to a specific service from the terminal device 110, the AMF 209 selects the SMF 206 for providing the service corresponding to this S-NSSAI1. Here, the specific service is, for example, a service for applications such as AR, VR, MR, SR, and XR.

[0194] Also, the SMF 206 selected to provide the service corresponding to S-NSSAI1 selects the PCF 205 and the UPF 220 necessary for providing services for applications such as AR, VR, MR, SR, and XR.

[0195] Furthermore, for example, the base station device 130 may respectively determine the SPS-Config and ConfiguredGrantConfig to be set for the downlink and uplink with the terminal device 110 in response to an instruction from the AMF 209.

[0196] The base station device 130 can set the SPS-Config and ConfiguredGrantConfig for the terminal device 110 via the RRC. For example, the base station device 130 sets them for the terminal device 110 by including the SPS-Config and ConfiguredGrantConfig in an RRC reconfiguration message (see step S508 in FIG. 11) and transmitting it.

[0197] SPS-Config is used to configure semi-persistent transmission on the downlink. Multiple SPS (Semi-Persistent Scheduling) can be configured for one BWP (Bandwidth Part) of a serving cell. Multiple SPS are configured with an SPS-ConfigList.

[0198] In addition to the method called type 1 via the above-mentioned RRC, the base station device 130 can also configure ConfiguredGrantConfig by means of a PDCCH (Physical Downlink Control Channel) that specifies a CS-RNTI (Radio Network Temporary Identifier) called type 2.

[0199] The SPS-Config information element included in the RRC message includes fields such as periodicity, periodicityExt, and SPS-ConfigIndex.

[0200] Here, when periodicityExt is not included in the SPS-Config information element, periodicity is referred to, and when periodicityExt is included, periodicity is ignored.

[0201] In TS38.331, values of 10 ms, 20 ms, 32 ms, 40 ms, 64 ms, 80 ms, 128 ms, 160 ms, 320 ms, and 640 ms are defined as the periodicity of SPS-Config.

[0202] Regarding the periodicityExt of SPS-Config, when the SCS (Subcarrier Spacing) is 15 kHz, it is defined that any number of slots between 1 slot and 640 slots can be set as periodicityExt. Also, when the SCS is 30 kHz, it is defined that any number of slots between 1 slot and 1280 slots can be set as periodicityExt. When the SCS is 60 kHz, it is defined that any number of slots between 1 slot and 2560 slots can be set as periodicityExt. When the SCS is 120 kHz, it is defined that any number of slots between 1 slot and 5120 slots can be set as periodicityExt.

[0203] When SPS is set, the MAC entity must determine that the Nth downlink allocation occurs in the slot (Slot#_N) within the SFN (System Frame Number) that satisfies the following equation (1).

[0204] (numberOfSlotsPerFrame × SFN + Slot#_N) = [(numberOfSlotsPerFrame × SFNinit + slotinit) + N × periodicity × numberOfSlotsPerFrame / 10] modulo(1024 × numberOfSlotsPerFrame) ··· (1)

[0205] Here, numberOfSlotsPerFrame is the number of slots in a radio frame (for example, 10 when the SCS is 15 kHz), and SFNinit and slotinit are the SFN and slot# at which the first PDSCH (Physical Downlink Shared Channel) transmission was performed when SPS was set, respectively.

[0206] In addition, in order to allocate a plurality of slots continuously on the time axis as SPS resources, a parameter named numberOfSlotsPerSPS may be further introduced. The MAC entity determines that the Nth downlink allocation occurs in a continuous numberOfSlotsPerSps slots starting from the slot (Slot#_N) within the SFN that satisfies the above formula (1).

[0207] The ConfiguredGrantConfig information element includes fields named periodicity, periodicityExt, and ConfiguredGrantConfigIndex.

[0208] Here, when periodicityExt is not included in the ConfiguredGrantConfig information element, periodicity is referred to; when periodicityExt is included, periodicity is ignored.

[0209] In TS38.331, as the periodicity of ConfiguredGrantConfig, for example, when the SCS is 15 kHz, 2, 7, n*14 symbols are defined. Here, n is any value among 1, 2, 4, 5, 8, 10, 16, 20, 32, 40, 64, 80, 128, 160, 320, 640.

[0210] In addition, regarding periodicityExt of ConfiguredGrantConfig, for example, when the SCS is 15 kHz, it is defined that any number of symbols between 1 symbol and 640 symbols can be set as periodicityExt, and a period of periodicityExt*14 symbols can be set.

[0211] When CG (Configured Grant) is configured, the MAC entity must determine that the Nth uplink allocation occurs in the symbol (Symbol#_N) within the Slot# of the SFN (System Frame Number) that satisfies the following equation (2).

[0212] [(SFN × numberOfSlotsPerFrame × numberOfSymbolsPerSlot) +(Slot# × numberOfSymbolsPerSlot)+Symbol#_N]= (timeDomainOffset × numberOfSymbolsPerSlot+S+N × periodicity) modulo(1024 × numberOfSlotsPerFrame × numberOfSymbolsPerSlot)···(2)

[0213] Here, numberOfSlotsPerFrame is the number of slots in a radio frame (e.g., 10 when SCS is 15 kHz), and numberOfSymbolsPerSlot is the number of symbols in a slot (14 in the case of Normal CP). Also, timeDomainOffset and S are parameters obtained from the SLIV (Start and length indicator value). timeDomainOffset is the offset value in the time domain of the resource at SFN = 0, and S is the symbol (Symbol#) where the PUSCH (Physical Uplink Shared Channel) was first allocated.

[0214] Also, in order to allocate a plurality of consecutive symbols as CG resources on the time axis, a parameter numberOfSymbolsPerCg may be further introduced. The MAC entity determines that the Nth uplink allocation occurs in the consecutive numberOfSymbolsPerCg symbols starting from the symbol (Symbol#_N) within the Slot# of the SFN that satisfies the above equation (2).

[0215] <<3. Technical Problem>> Next, the technical problem of the content distribution system 100 according to the embodiment of the present disclosure will be described, particularly focusing on the case of transmitting video data by semi-persistent transmission.

[0216] FIG. 12 is a diagram for explaining an example of video data distribution by a content distribution system. In FIG. 12, communication of video data via SPS is performed between the base station device 130 and the terminal device 110. Further, it is assumed that the terminal device 110 doubles the frame rate using the time warp described above and displays the video.

[0217] For example, the terminal device 110, which is an HMD, sends a PDU session establishment request message including S-NSSAI1 (see step S401 in FIG. 10) to the AMF 209 in order to use the XR service. The AMF 209 that has received the PDU session establishment request message instructs the base station device 130 to set SPS-Config and ConfiguredGrantConfig for the downlink and uplink with the terminal device 110, respectively.

[0218] The terminal device 110 receives video data with a frame rate of, for example, 45 fps via the base station device 130 by SPS (Semi-Persistent Scheduling) of the downlink. Hereinafter, the frame rate of the video data transmitted by the information processing device 150 will also be referred to as the first frame rate.

[0219] Further, the terminal device 110 transmits information related to inertia measured by the inertial measurement device 114 via the base station device 130 by CG (Configured Grant) of the uplink.

[0220] The terminal device 110 utilizes time warping on the received video data with the first frame rate (45 fps) and displays it as a video with a frame rate of, for example, 90 fps. Hereinafter, the frame rate of the video that the terminal device 110 displays on the display unit 116 is also referred to as the second frame rate.

[0221] The video with the second frame rate (90 fps) is displayed on the display of the terminal device 110 at a cycle of 11.11 ms. Also, it is desirable that the reception of the video data with the first frame rate (45 fps) can be received ideally at a cycle of 22.22 ms. However, since the period of the SPS is set in slot units (1 ms when the SCS is 15 kHz), it is set to, for example, 22 ms as the closest period.

[0222] Here, a method for setting the period of the SPS will be described. Information related to the format including the frame rate of the video handled by the service corresponding to S-NSSAI1 is stored, for example, in the UDR (Unified Data Repository).

[0223] When the establishment of a PDU session is required for the provision of the service corresponding to S-NSSAI1, the SMF 206 acquires information related to the format including the frame rate of the video handled by the service corresponding to S-NSSAI1 from the UDR and provides it to the AMF 209 via the NAS message.

[0224] The AMF 209 determines the period of the SPS from the acquired information related to the format of the video and instructs the base station device 130 to set the SPS with the determined period.

[0225] Further, based on the information related to the format including the frame rate of the video handled by the service corresponding to the S-NSSAI1 obtained from the UDR, the SMF206 may determine the period of the SPS and provide the period of the SPS to the base station apparatus 130 via the AMF209. For example, the QoS Profile included in the N2 SM information provided by the SMF206 to the base station apparatus 130 via the AMF209, or this period of the SPS is included in the QoS parameter.

[0226] Furthermore, the QoS Profile, or the QoS parameter may include information for explicitly instructing the setting of the SPS. For example, set "sps-enabled".

[0227] Note that the SMF206 may include the period of the SPS, and furthermore, information for explicitly instructing the setting of the SPS, for example, "sps-enabled" in the Alternative QoS Profile provided to the base station apparatus 130.

[0228] Alternatively, the information related to the format including the frame rate of the video handled by the service corresponding to the S-NSSAI1 may be included in the PCC Rules provided from the PCF205 to the SMF206.

[0229] Also, define the QFI (QoS Flow Identifier) and 5QI (5G QoS Identifier) corresponding to the format of the video handled by the service corresponding to the S-NSSAI1, or the period of the SPS, and the SMF206 may notify the base station apparatus 130 of this QFI and 5QI.

[0230] The QoS flow is characterized by the QoS Profile provided from the 5GC to the base station apparatus 130 and the QoS rule(s) provided from the 5GC to the terminal apparatus 110 at the NAS level. The QoS Profile is used for the base station apparatus 130 to determine how to process at the radio interface.

[0231] The QoS Profile contains QoS parameters, which are, for example, 5QI and ARP.

[0232] QoS rule(s) is / are used to indicate the correspondence between uplink user plane data and QoS flows. For example, the CG setting is included in the QoS rule.

[0233] Here, the CG setting is the CG period, and further, information for explicitly indicating the CG setting, such as "cg-enabled".

[0234] At the AS level, the DRB determines how packets are processed on the radio interface. The mapping of QoS flows and DRBs by the base station device 130 is performed based on the QoS Profile related to the QFI.

[0235] As described above, the terminal device 110 receives video data at a period of 22 ms and displays videos (frame images) on the display unit 116 at a period of 11.11 ms.

[0236] In the example shown in FIG. 12, the terminal device 110 receives video data D1 from point A within a predetermined reception period. The terminal device 110 displays the first video generated from the received video data D1 at the next display timing (point B1). Also, the terminal device 110 displays the second video generated from the video data D1 at point B2 as a time warp of the first video displayed at point B1 (hereinafter also referred to as time warp display).

[0237] The terminal device 110 receives video data at a period of 22 ms and displays videos at a display period of 11.11 ms. More specifically, the terminal device 110 displays the first video at a period of 22.22 ms and displays the second video with time warp at a period of 22.22 ms.

[0238] As described above, the period in which the terminal device 110 receives video data (the period of the SPS) is different from the period in which the terminal device 110 displays the first video (the first frame rate). Therefore, even if the reception timing of the video data and the display timing of the video at the first frame rate (45 fps) coincide at a certain point in time as shown by point A in FIG. 12, a shift gradually occurs between the reception timing and the display timing. Although this shift is small, as the shift gradually accumulates, problems such as the delay amount until display becoming so large that it cannot be ignored from the perspective of Motion-to-photon latency, or conversely, not being able to keep up with the display, will occur.

[0239] ·Outline of the proposed technology Therefore, in the present disclosure, a technology is proposed that can stably display a video in a terminal device 110 that periodically receives video data and periodically displays a video. As the proposed technology, when the difference between the periodic reception timing of video data in the terminal device 110 and the display timing of the video satisfies a predetermined condition, the base station device 130 changes the setting regarding the reception timing.

[0240] <<4.Technical features>> <4.1.Reconfiguration of SPS FIG. 13 is a diagram for explaining the reconfiguration of the SPS by the base station device 130 according to an embodiment of the present disclosure.

[0241] As described above, the terminal device 110 receives video data at a period of 22 ms, and the terminal device 110 displays the first video at a period of 22.22 ms.

[0242] As described above, when the period in which the terminal device 110 receives video data (the period of the SPS) is different from the period in which the terminal device 110 displays the first video, a shift (difference) occurs between the reception timing and the display timing.

[0243] When the absolute value of the difference between the reception timing at which the terminal device 110 receives video data and the display timing of the first video becomes equal to or greater than a predetermined threshold, the base station device 130 performs reconfiguration of SPS. The base station device 130 resets the current SPS setting and performs SPS setting again. The base station device 130 reconfigures SPS-Config so that the reception timing at which the terminal device 110 receives video data and the display timing of the first video are aligned.

[0244] When the absolute value of the difference between the reception timing at which the terminal device 110 receives video data and the display timing of the first video becomes equal to or greater than a predetermined threshold, the terminal device 110 receives video data at the changed reception timing based on the reconfigured SPS-Config.

[0245] FIG. 14 is a flowchart showing the flow of SPS reconfiguration processing according to an embodiment of the present disclosure. FIG. 14 shows the case where the terminal device 110 performs SPS reconfiguration processing.

[0246] The terminal device 110 sets SPS based on a notification from the base station device 130 (for example, an RRC message including SPS-Config) (step S601). The terminal device 110 receives video data from the base station device 130 at the set SPS period (step S602).

[0247] The terminal device 110 measures the cumulative time of the difference between the SPS period (for example, 22 ms) and the frame rate of the video data (for example, the first frame rate: 22.22 ms) (step S603). More specifically, each time the terminal device 110 receives video data, the terminal device 110 accumulates the difference (0.22 ms) between the SPS period and the first frame rate, and calculates the difference between the reception timing at which the video data is received and the display timing.

[0248] Note that the terminal device 110 may calculate the difference between the reception timing and the display timing by calculating the difference between the time when the video data is received and the time when the video data is displayed.

[0249] The terminal device 110 determines whether the measured cumulative time is equal to or greater than a predetermined threshold value set in advance (step S604). If the cumulative time is less than the threshold value (step S604; No), the process returns to step S602, and the terminal device 110 receives video data at the SPS period.

[0250] On the other hand, if the cumulative time is equal to or greater than the threshold value (step S604; Yes), the terminal device 110 activates a process of requesting the base station device 130 to reset the SPS (step S605), and returns to step S601.

[0251] In step S605, the terminal device 110 may report a request for resetting the SPS (resetting of SPS-Config) including, as an offset value, the cumulative time to be corrected or the number of slots corresponding to the cumulative time to be corrected.

[0252] When the base station device 130 receives a request for resetting the SPS-Config from the terminal device 110, it resets the SPS based on the information related to the reported cumulative time to be corrected. Note that this request for resetting the SPS-Config is made via an RRC message.

[0253] The terminal device 110 executes the above SPS reset process while receiving video data.

[0254] Note that here, it is assumed that the terminal device 110 requests reconfiguration of SPS, but it is not limited to this (that is, the request for reconfiguration of SPS by the terminal device 110 does not have to be an essential component). For example, the base station device 130 may calculate the difference between the display timing at the reception timing when receiving video data and determine whether to perform reconfiguration of SPS. In this case, the base station device 130 acquires information regarding the frame rate of video data from, for example, the information processing device 150. Additionally or alternatively, the base station device 130 may acquire information regarding the frame rate of video data from the UDR or the NF of 5GC / NGC20. Additionally or alternatively, the base station device 130 may acquire information (that is, information regarding the frame rate of video data) of a higher layer that does not originally terminate by reading it using DPI (Deep Packet Inspection) or the like.

[0255] Alternatively, the NF of 5GC / NGC20 may cause the base station device 130 to reconfigure SPS based on the difference between the display timing at the reception timing when receiving video data. Here, the case where the SMF206 instructs the base station device 130 of the timing for reconfiguring SPS will be described.

[0256] In this case, the terminal device 110 includes, in addition to S-NSSAI1, the absolute value of the cumulative time of the difference between the period of the SPS that the terminal device 110 can tolerate and the period of the frame rate of the video in the PDU session establishment request message (refer to step S401 in FIG. 10) transmitted to receive the service corresponding to S-NSSAI1.

[0257] The SMF206 acquires S-NSSAI1 and the cumulative time that the terminal device 110 can tolerate from the AMF209 via Nsmf_PDUSession_CreateSMContext Request (refer to step S401 in FIG. 10).

[0258] Note that, here, it is assumed that the terminal device 110 notifies the allowable cumulative time, but it is not limited to this. For example, the SMF 206 may use a value determined in advance based on the Motion-to-photon latency or the like as the allowable cumulative time.

[0259] The SMF 206 obtains information related to the format including the frame rate of the video handled by the service corresponding to the S-NSSAI 1 from the UDR.

[0260] The SMF 206 determines the period of the SPS based on the frame rate of the video and determines the period for setting the SPS based on the allowable cumulative time. Here, the period for setting the SPS is the period from when the SPS is set until the SPS needs to be reset.

[0261] The AMF 209 obtains the period of the SPS and the period for setting the SPS from the SMF 206 via the N2 SM information of the Namf_Communication_N1N2MessageTransfer (refer to step S411 in FIG. 10).

[0262] The AMF 209 notifies the base station device 130, via the N2 PDU session request message (refer to step S412 in FIG. 10), of the period of the SPS and the period for setting the SPS obtained from the SMF 206, and the number of slots corresponding to the cumulative time to be corrected as an offset value.

[0263] The base station device 130 sets the period of the SPS in the downlink with the terminal device 110 based on the period of the SPS and the period for setting the SPS obtained from the AMF 209, and starts a timer for setting the period for setting the SPS.

[0264] When the expiration date of this timer expires, the base station device 130 resets the SPS with the slot for starting the SPS offset by the number of slots corresponding to the offset value, and resets the timer.

[0265] Thereafter, until the terminal device 110 terminates the service corresponding to S-NSSAI1, this SPS reconfiguration process is repeated.

[0266] <4.2. Multiple SPS Configurations> In the example described above, the case where the base station device 130 sets one SPS has been explained, but the base station device 130 may be configured to set multiple SPSs. Thereby, the base station device 130 can increase the resources allocated to the SPS.

[0267] FIG. 15 and FIG. 16 are diagrams for explaining an SPS setting example by the base station device 130 according to an embodiment of the present disclosure.

[0268] As shown in FIG. 15, the base station device 130 may set multiple SPSs in a plurality of consecutive slots within the SPS period (for example, 22 ms). Alternatively, as shown in FIG. 16, the base station device 130 may set multiple SPSs in a plurality of dispersed slots.

[0269] The base station device 130, for example, allocates and transmits video data to a plurality of slots in which the SPS is set.

[0270] Also, the base station device 130 may realize the reconfiguration of the SPS by switching each of the multiple SPSs.

[0271] Note that in FIGS. 15 and 16, the base station device 130 sets the SPS in a plurality of slots starting from the head of the SPS period, but it is not limited thereto. The base station device 130 may set the SPS in a plurality of slots starting from the end of the SPS period, or may set the SPS in a plurality of slots located at the center of the SPS period. Also, in FIGS. 15 and 16, the number of resource allocations for which the base station device 130 sets the SPS is three, but it is not limited thereto, and it may be two or four or more.

[0272] In addition, the base station device 130 sets discontinuous reception, DRX (Discontinuous Reception), for the terminal device 110 to periodically monitor the PDCCH. One of the processes performed by the terminal device 110 in the idle mode is to monitor the PDCCH that notifies paging from the base station device 130. Therefore, in the idle mode, DRX for periodically monitoring the PDCCH is set to suppress the power consumption during standby.

[0273] Also, it is important to reduce the power consumption in the connected mode of the terminal device 110. Therefore, the base station device 130 can set C-DRX (Connected mode DRX) using RRC Connection Setup or RRC Connection Reconfiguration. The value of the long DRX-Cycle is set according to the monitoring period of the PDCCH, and the values of drxStartOffset and onDurationTimer are set based on the slot position for allocating the PDCCH. Further, the drx-InactivityTimer is set as the period for receiving the data indicated by the scheduling information received via the PDCCH. In addition to this Long DRX, the base station device 130 can set Short DRX.

[0274] Short DRX is set by drxShortCycleTimer and shortDRX-Cycle. The terminal device 110 in the connected mode monitors the PDCCH according to the Long DRX setting. When the demodulation of the PDCCH containing the scheduling information is successful over the period when onDurationTimer is valid, the drx-InactivityTimer is started, and over the period when the drx-InactivityTimer is valid, the data indicated by the scheduling information can be received. When the expiration of the drx-InactivityTimer is reached, the terminal device 110 starts the drxShortCycleTimer, and over the period when the drxShortCycleTimer is valid, monitors the PDCCH at a higher frequency shortDRX-Cycle period than the longDRX-Cycle. By monitoring the PDCCH in this shortDRX-Cycle, for example, the QoS of the packets transmitted in a short period can be ensured. When the expiration of the drxShortCycleTimer is reached, the terminal device 110 resumes the periodic monitoring of the PDCCH according to the Long DRX setting.

[0275] The base station device 130 sets C-DRX for the terminal device 110 based on the monitoring period of the PDCCH and the SPS period. For example, when the PDCCH is notified within the slot in which SPS is set, one Long DRX is set. The value of longDRX-Cycle is set according to the SPS period, and the values of drxStartOffset and onDurationTimer are set based on the slot position in which SPS is set. Here, when SPS is set in a plurality of consecutive slots (Figure 15), the value of onDurationTimer is set according to the number of consecutive slots. Alternatively, the values of drxStartOffset and onDurationTimer of Long DRX are set according to the position of the first slot in which SPS is set, and the value of drx-InactivityTimer is set according to the positions of the second and subsequent slots. When SPS is set in a plurality of dispersed slots (Figure 16), the value of onDurationTimer is set so as to include all of the dispersed slots. Alternatively, when SPS is set in a plurality of dispersed slots, the values of drxStartOffset and onDurationTimer of Long DRX are set according to the position of the first slot in which SPS is set, and the values of drxShortCycleTimer and shortDRX-Cycle of Short DRX are set according to the positions of the second and subsequent slots. The value of drxShortCycleTimer is set based on the period of the slots set dispersedly within the SPS period, and shortDRX-Cycle is set based on the period during which the plurality of dispersedly set slots are included.

[0276] Also, when the PDCCH is notified in a slot adjacent to the slot in which SPS is set, the value of one longDRX-Cycle is set according to the SPS period, and the values of drxStartOffset and onDurationTimer are set based on the positions of the adjacent slot and the slot in which SPS is set. That is, over the period of onDurationTimer, the monitoring of the PDCCH and the data sent using the slot in which SPS is set are received.

[0277] Note that this one Long DRX setting is reset at the timing when the SPS is reset. When the reset of the SPS is realized by switching each of a plurality of SPSs, the Long DRX is reset each time the SPS is switched. Based on the slot position of the switched SPS, the values of drxStartOffset, onDurationTimer, or drx-InactivityTimer are reset. In order to update each parameter of DRX in this DRX reset, each parameter may be notified via DCI.

[0278] Also, the monitoring period of the PDCCH and the period of the SPS may be flexibly set, that is, two independent Long DRXs may be set to have different periods. The first Long DRX is set for monitoring the PDCCH, and the second Long DRX is set for receiving data via the SPS. The value of the first longDRX-Cycle is set according to the monitoring period of the PDCCH, and the values of the first drxStartOffset and the first onDurationTimer are set according to the slot that notifies the PDCCH. The value of the second longDRX-Cycle is set according to the SPS period, and the values of the second drxStartOffset and the second onDurationTimer are set based on the slot position where the SPS is set. Note that, for setting the second Long DRX, the method shown in the case of setting one Long DRX described above can be used. Here, when part or all of the period of the first onDurationTimer and the period of the second onDurationTimer overlap, the terminal device 110 determines the period as the logical sum (OR) of the period of the first onDurationTimer and the period of the second onDurationTimer as the period of the onDurationTimer. Also, when the timing of the end of the first onDurationTimer and the start period of the second onDurationTimer, or the timing of the end of the second onDurationTimer and the start period of the first onDurationTimer are below a certain threshold, it is considered that it becomes difficult to control the on and off of the receiving system of the terminal device 110. In such a case, the terminal device 110 can avoid the problem of controlling the on and off of this receiving system by setting a continuous period including the periods of the first onDurationTimer and the second onDurationTimer as the period of the third onDurationTimer. Also, the threshold for this determination (for example, 5 slots, etc.) may be notified to the terminal device 110 as one of the Long DRX parameters (for example, DurationThreshold) when setting the second Long DRX. Note that the above-mentioned concept of the slot in the setting of the SPS or DRX may include a mini-slot.

[0279] FIG. 17 is a diagram for explaining an example of setting SPS by the base station apparatus 130 according to an embodiment of the present disclosure.

[0280] In FIG. 17, the base station apparatus 130 sets a plurality of SPSs having the same period within the period of SPS (for example, 22 ms).

[0281] The base station apparatus 130 sets resource allocations 701 to 704 corresponding to four SPSs having an interval of arbitrary slots, for example, in the downlink with the terminal apparatus 110. In FIG. 17, there are six slots empty between the resource allocations 701 and 702, between the resource allocations 702 and 703, and between the resource allocations 703 and 704. Also, there are four slots empty between the resource allocation 704 and the resource allocation 701 of the next period.

[0282] The base station apparatus 130 can individually activate each of the set plurality of resource allocations using DCI (Downlink Control Information). Here, for example, the base station apparatus 130 first activates only the SPS corresponding to the resource allocation 701.

[0283] Suppose that the cumulative time of the difference between the period of the SPS and the period of the first frame rate of the video becomes equal to or more than the time difference between the resource allocation 701 and the resource allocation 702, that is, six slots in the example of FIG. 17. In this case, the base station apparatus 130 deactivates the SPS corresponding to the resource allocation 701 using DCI and activates the SPS corresponding to the resource allocation 702.

[0284] Next, assume that the cumulative time of the difference between the period of the SPS and the period of the first frame rate of the video becomes equal to or greater than six slots, which is the time difference between resource allocation 702 and resource allocation 703. In this case, the base station apparatus 130 deactivates the SPS corresponding to resource allocation 702 using DCI and activates the SPS corresponding to resource allocation 703.

[0285] Subsequently, assume that the cumulative time of the difference between the period of the SPS and the period of the first frame rate of the video becomes equal to or greater than six slots, which is the time difference between resource allocation 703 and resource allocation 704. In this case, the base station apparatus 130 deactivates the SPS corresponding to resource allocation 703 using DCI, and the base station apparatus 130 activates the SPS corresponding to resource allocation 704.

[0286] Similarly, assume that the cumulative time of the difference between the period of the SPS and the period of the first frame rate of the video becomes equal to or greater than four slots, which is the time difference between resource allocation 704 and the resource allocation 701 of the next period. In this case, the base station apparatus 130 deactivates the SPS corresponding to resource allocation 704 using DCI and activates the SPS corresponding to resource allocation 701.

[0287] Thereafter, until the terminal device 110 terminates the service corresponding to S-NSSAI1, the activation / deactivation process of each of the plurality of set SPSs is continued.

[0288] As described above, when switching the SPS used for transmitting video data, the base station apparatus 130 may notify the terminal device 110 of the offsets of the SPSs before and after the switching using, for example, DCI.

[0289] Here, information regarding the period of the SPS, the number of SPSs set within the SPS period, the arrangement of resource allocation corresponding to each SPS within the SPS period, and the period from activating each SPS to deactivating it is notified from the SMF206 to the base station apparatus 130 in the PDU session establishment process.

[0290] <4.3.CG Reconfiguration> In applications such as AR, VR, MR, SR, and XR where free viewpoint videos or real-time videos are viewed on an HMD, it is important to suppress the Motion-to-photon latency within a certain value as described above. Therefore, in order to reflect the movement of the head, the viewpoint, or the change in the visual field including the viewpoint in each frame image of the video, a periodic uplink for transmitting the latest information related to inertia detected by the terminal device 110 occurs. Thus, when the terminal device 110 sends a PDU session establishment request for receiving the service corresponding to S-NSSAI1 to the AMF209, the 5GC sets a CG (Configured Grant) in addition to the above-described SPS. Here, the CG setting method can use the same method as the SPS setting method described so far.

[0291] Also, in the PDU session establishment process for the service corresponding to S-NSSAI1, the selected SMF206 may use the AF208 to provide the service corresponding to S-NSSAI1.

[0292] The AF208 determines the SPS setting, for example, when the application used by the terminal device 110 requires periodic downlink reception. Further, when the application involves video reception, the AF208 identifies the video format and determines the required SPS setting according to the identified video format.

[0293] Also, when the application used by the terminal device 110 requires periodic uplink transmission, AF208 may determine the CG setting. For example, in order to reflect the information related to the inertia detected by the terminal device 110 in the video received by the application, a CG setting considering the frame rate of the video is determined. That is, AF208 provides information assisting the settings necessary for receiving the video data and the settings necessary for transmitting the information (e.g., information related to inertia) used for generating the video data to other NFs or the base station device 130 based on the format of the video handled by the application.

[0294] The SPS setting and the CG setting determined by AF208 are provided to the base station device 130 via SMF206 and AMF209.

[0295] Here, in the above-described example, the case where the base station device 130 performs SPS reconfiguration has been described, but the base station device 130 may perform reconfiguration of ConfiguredGrantConfig (CGConfig). This point will be described with reference to FIGS. 18 and 19.

[0296] FIGS. 18 and 19 are diagrams for explaining CG reconfiguration by the base station device 130 according to an embodiment of the present disclosure.

[0297] As shown in FIG. 18, the information processing device 150 periodically receives inertial measurement information via the base station device 130 during the inertial measurement information reception period. The period at this time is determined by the period of the uplink communication in which the base station device 130 receives inertial measurement information from the terminal device 110, and for example, coincides with the CG period set by ConfiguredGrantConfig.

[0298] The information processing device 150 executes video data generation processing based on the received inertial measurement information to generate video data, and transmits the video data to the terminal device 110 via the base station device 130. Such video data is transmitted at the SPS period in data transmission using SPS.

[0299] When the SPS period and the CG period are the same, the information processing apparatus 150 can generate video data based on the most recently received inertial measurement information.

[0300] In this case, when the cumulative time of the difference between the SPS period and the first frame rate becomes equal to or greater than the threshold value, the base station apparatus 130 performs SPS reconfiguration. As a result, a deviation occurs in data transmission using SPS.

[0301] In the example of FIG. 18, the SPS is reconfigured so that the transmission timing of data transmission using SPS becomes earlier. Therefore, even if the information processing apparatus 150 generates video data based on the most recently received inertial measurement information, the video data cannot be transmitted because it cannot meet the transmission timing after the reconfiguration. Alternatively, the information processing apparatus 150 has to generate video data using the inertial measurement information received immediately before in order to transmit the video data.

[0302] Therefore, as shown in FIG. 19, when performing SPS reconfiguration, the base station apparatus 130 according to the present embodiment performs ConfiguredGrant (CG) reconfiguration. At this time, it is desirable that the base station apparatus 130 perform CG reconfiguration before the timing of performing SPS reconfiguration. Thereby, even if SPS reconfiguration is performed, the information processing apparatus 150 can generate video data based on the latest inertial measurement information received most recently.

[0303] <4.4. Change of Time Warp> In the example described above, the base station apparatus 130 performs SPS or CG reconfiguration to reduce the deviation between the communication timing and the display timing that occurs in the terminal apparatus 110. However, the method for reducing the deviation is not limited to this. For example, the terminal apparatus 110 may reduce such a deviation by adjusting the number of time warp images to be displayed using time warp.

[0304] FIG. 20 is a diagram for explaining an example of display processing by the terminal device 110 according to an embodiment of the present disclosure.

[0305] As shown in FIG. 20, the terminal device 110 generates and displays a frame image (hereinafter, also referred to as a first image) using information on the latest inertia from the video data received during the reception period of the SPS period. Further, the terminal device 110 time-warp displays the frame image (time-warp image) generated in the same manner. The terminal device 110 displays the first image or the time-warp image as a frame image at a second frame rate.

[0306] In this case, due to the cumulative slight deviation between the period of the SPS and the period of the first frame rate (45 fps), a state occurs in which the reception of the video data does not meet the display timing of the first image. In FIG. 20, a state occurs at point B where the reception of the video data does not meet the display timing of the first image.

[0307] Suppose that the cumulative time of the difference between the period of the SPS and the period of the first frame rate becomes equal to or greater than a certain threshold value, and the state where the display timing of the first image cannot be met occurs. As shown in the lower figure of FIG. 20, the terminal device 110 displays a time-warp image obtained by applying time-warp to the video data received at the previous reception timing at the timing when the first image is originally to be displayed. Thereby, the terminal device 110 can delay the display timing of the first image by a half cycle and display the first image generated using the most recently received video data.

[0308] In the above example, the case where the reception timing of the video data is delayed and the display timing of the first image cannot be met has been described. Now, the case where the reception timing of the video data is advanced will be described.

[0309] FIG. 21 is a diagram for explaining another example of display processing by the terminal device 110 according to an embodiment of the present disclosure.

[0310] Due to the cumulative slight deviation between the period of the SPS and the period of the first frame rate (45 fps), a state occurs where the delay from receiving video data to the display timing of the first image generated based on the video data becomes large. In FIG. 21, at point D, the delay from receiving video data to the display timing of the first image has become so large that, for example, the Motion-to-photon latency cannot be ignored.

[0311] Thus, assuming that the cumulative time of the difference between the period of the SPS and the period of the first frame rate has reached a certain threshold or more, and the delay from receiving video data to the display timing of the first image has become so large that the Motion-to-photon latency cannot be ignored.

[0312] As shown in the lower diagram of FIG. 21, the terminal device 110 displays the first image generated from the most recently received video data at the timing (point C) of displaying the time-warped image obtained by applying time warping to the video data received at the previous reception timing. Thereby, the terminal device 110 can advance the display timing of the first image by a half cycle and can reduce the influence of the Motion-to-photon latency.

[0313] <4.5. Priority setting> In some of the above-described examples, the case where one video data is assigned to one SPS has been described, but it is not limited thereto. For example, the base station device 130 may assign video data divided into a plurality of regions to a plurality of SPSs according to the priority of each region. Here, each divided video data is, for example, data called a segment.

[0314] FIGS. 22 to 25 are diagrams for explaining an example of the video data allocation process by the base station device 130 according to the embodiment of the present disclosure.

[0315] The information processing device 150 sets the user's viewpoint or the field of view including the viewpoint based on the latest inertia-related information acquired from the terminal device 110. Further, the information processing device 150 determines an area so that the set view or the viewpoint is at the center, and generates video data for the determined area.

[0316] At this time, as shown in FIG. 22, the information processing device 150 divides the generated video data into a plurality of areas. Then, the information processing device 150 changes the resolution of the divided areas according to the distance between the set user's viewpoint and the divided areas.

[0317] For example, as shown in FIG. 22, the information processing device 150 generates video data assuming that the user's viewpoint is located at the center of the video data, and divides the generated video data into nine 3×3 areas.

[0318] In this case, as shown in FIG. 23, the information processing device 150 sets the highest resolution for the area 801 located at the center and closest to the viewpoint among the divided areas (high resolution). Also, the information processing device 150 sets the lowest resolution for the areas 806 to 809 located at the corners of the video data and farthest from the viewpoint among the divided areas (low resolution). The information processing device 150 sets the resolution of the remaining areas 802 to 805 to a resolution between the high resolution and the low resolution (medium resolution). The areas 802 to 805 are areas adjacent to the area 801 closest to the viewpoint by a side, and the areas 806 to 809 are areas adjacent to the areas 802 to 805 by a side.

[0319] Here, the case where the video data is divided into nine has been described, but the number of divisions of the image data is not limited to nine. The number of divisions may be two or more and eight or less, or may be ten or more. Also, here, the case where the resolution of the areas is divided into three levels of low, medium, and high has been described, but the number of resolutions is not limited to three. The number of resolutions may be two, or may be four or more. Further, here, the case where the size of each divided area is the same has been described, but the example is not limited to the case where the size of each area is the same. For example, the areas may be divided into areas of different sizes.

[0320] Here, as video data applicable to each region, a plurality of formats with different resolutions may be defined in advance. That is, the information processing apparatus 150 selects a video format with a different resolution according to the distance from the viewpoint and generates video data.

[0321] In addition to the distance from the viewpoint, the information processing apparatus 150 may further select a video format with a different resolution based on the communication quality between the terminal device 110 and the base station device 130. For example, the AF208 includes a wireless communication quality acquisition unit (not shown) and acquires the communication quality between the terminal device 110 and the base station device 130 from the base station device 130. The wireless communication quality acquisition unit provides the information processing apparatus 150 with the communication quality between the terminal device 110 and the base station device 130 acquired from the base station device 130.

[0322] As shown in FIG. 24, the AF208 assigns priorities according to the resolution of each region of the video. A high priority is assigned to the high-resolution region 801, a medium priority is assigned to the medium-resolution regions 802 to 805, and a low priority is assigned to the low-resolution regions 806 to 809. Here, the priorities are, for example, QFI (QoS Flow identifier) and 5QI (5G QoS Identifier).

[0323] Here, the QoS flow is the finest-grained concept for differentiating QoS within a PDU session, and in 5GS, the QoS flow is identified by the QFI. In N3 between the UPF220 and the RAN / AN230 corresponding to the base station device 130, each data flow is sent with an encapsulated QFI added to the header. Note that the QFI may be equivalent to the 5QI.

[0324] The AMF209 determines the setting of the SPS including the period of the SPS based on the frame rate of the video in each priority region. Here, the AMF209 may make the frame rates of the videos in each priority region the same, or may lower the frame rate of the video in the region with a lower priority.

[0325] In addition, the SPS settings for each priority are determined taking into account that videos in areas with higher priority are received by the terminal device 110 earlier in time than videos in areas with lower priority.

[0326] The SPS settings for each priority determined by the AMF 209 are provided to the base station device 130 via the SMF 206 and the AMF 209.

[0327] The base station device 130 executes SPS resource allocation based on the SPS settings for each priority acquired from the AMF 209.

[0328] In the example shown in FIG. 25, the base station device 130 sets a periodic resource allocation 810 for SPS with high priority, a periodic resource allocation 811 for SPS with medium priority, and a periodic resource allocation 812 for SPS with low priority.

[0329] The base station device 130 identifies the priority based on the QFI added to the data flow received from the UPF 220, and transmits the data of each area of the video data using resource allocation according to the priority. For example, the base station device 130 transmits the high-priority area 801 to the terminal device 110 using the resource allocation 810. Similarly, the base station device 130 transmits the medium-priority areas 802 to 805 to the terminal device 110 using the resource allocation 811, and transmits the low-priority areas 806 to 809 to the terminal device 110 using the resource allocation 812.

[0330] In addition, information including the mapping and the format of each region necessary for the rendering unit 1153 of the terminal device 110 to restore the divided video into one video is transmitted using the periodic resource allocation 810 for sending high-priority data. Here, the information including the mapping and the format of each region necessary for restoring the divided video into one video may be, for example, an MPD (Media Presentation Description) or a file for a similar purpose.

[0331] Based on the information including this mapping and the format of each region, the rendering unit 1153 can apply a decoding method suitable for the format of each divided region and restore it as video data for one region.

[0332] Based on the timing set in the SPS that first received the data via the periodic resource allocation 810 (see, for example, point A in FIG. 12), the rendering unit 1153 sets the timing of the frame of the video to be displayed (see, for example, point B1 in FIG. 12). For the timing of the frame of this video, for example, the period required for decoding, the period required for rendering processing, and an offset period considering the margin are applied. This offset period is controlled by the video application control unit 1151.

[0333] Here, an example of changing the resolution of the divided region according to the distance between the user's viewpoint and the divided region has been shown, but the priority may be changed without changing the resolution of each divided region. The information processing device 150 sets the highest priority (high priority) for the region 801 that is closest to the viewpoint and located in the center among the divided regions. In addition, the information processing device 150 sets the lowest priority (low priority) for the regions 806 to 809 that are farthest from the viewpoint and located at the corners of the video data among the divided regions. The information processing device 150 sets the priority of the remaining regions 802 to 805 to a priority between the high priority and the low priority (medium priority). Here, the priority is, for example, QFI and 5QI.

[0334] Also, when transmitting data of each area, the order of transmission may be determined based on pixels. For example, even if the terminal device 110 cannot receive information of all pixels within a predetermined period, the information processing device 150 preferentially transmits information of pixels at specific locations in the frame image so that a low-resolution image can be displayed. Subsequently, it controls to transmit information of the remaining pixels. The base station device 130 transmits data of each area to the terminal device 110 according to the priority based on these pixels. The rendering unit 1153 synthesizes the received multiple low-resolution frame images to generate a high-resolution frame image.

[0335] <<5. Other Embodiments>> The above-described embodiments are merely examples, and various modifications and applications are possible.

[0336] In the above-described embodiment, an example of displaying a 90fps video using time warp for a 45fps video has been shown, but the frame rate is not limited to this example. The technology of the present disclosure can be applied to the display of videos with various frame rates.

[0337] In the above-described embodiment, it is assumed that the information processing device 150 generates video data based on information related to inertia and transmits it to the terminal device 110. That is, the information processing device 150, for example, generates video data corresponding to the user's viewpoint from 360-degree video information and transmits it to the terminal device 110, but it is not limited to this. For example, the information processing device 150 may directly transmit the 360-degree video data to the terminal device 110. In this case, the information processing device 150 may reduce the amount of transmitted data by, for example, transmitting 360-degree video data with a low resolution. Also, the information processing device 150 may transmit both video data corresponding to the user's viewpoint and 360-degree video data with reduced resolution to the terminal device 110.

[0338] In the above-described embodiment, it is assumed that the NF of the base station apparatus 130 or 5GC / NGC 20 acquires the frame rate, but the present invention is not limited thereto. That is, the information regarding the frame rate acquired by the NF of the base station apparatus 130 or 5GC / NGC 20 may be not only the value of the frame rate itself (for example, 45 fps or 90 fps), but also an index corresponding to the frame rate (for example, QFI, or 5QI).

[0339] In addition, as an example of information for restoring the divided video into one video, an example including mapping and the format of each region has been shown, but information regarding the frame rate may be included in the information for restoring the divided video into one video. The NF of the base station apparatus 130 or 5GC / NGC 20 may acquire the frame rate via the information for restoring the divided video into one video.

[0340] In the above-described embodiment, the case where the terminal device 110 receives video data in the downlink and transmits information related to inertia in the uplink has been described, but the present invention is not limited thereto. For example, the data received by the terminal device 110 may be data received in real time and periodically, and may be other than video data. Also, the data transmitted by the terminal device 110 may be data transmitted in real time and periodically, and may be other than information related to inertia. As described above, the technology of the present disclosure can be applied to communication of various data performed in real time and periodically.

[0341] <<6. Application Example>> In addition, in some embodiments, the SPS or CG setting described above may take into account the requirements of services using augmented reality (AR) / virtual reality (VR) / mixed reality (MR) / substitutional reality (SR) (for example, cloud games).

[0342] In 5G NR (New Radio), several services are being considered as use cases. Among these, AR / VR services are expected to be the killer content of 5G NR. 3GPP TR 22.842 v17.1.0 and TS 22.261 v17.0.1 define the requirements for game image rendering in cloud games using AR / VR. More specifically, these technical specifications and reports describe the following for motion-to-photon delay and motion-to-sound delay as the allowable delay levels at which AR / VR users do not feel discomfort in the movement of the video during game image rendering.

[0343] · Motion-to-photon delay: While maintaining the required data rate (1 Gbps), the motion-to-photon delay is in the range of 7 - 15 ms. · Motion-to-sound delay: Less than 20 ms.

[0344] Note that the motion-to-photon delay is defined as the delay between the physical movement of the user's head and the updated image in the AR / VR headset (e.g., Head Mount Display). Also, the motion-to-sound delay is defined as the delay between the physical movement of the user's head and the updated sound wave from the head-mounted speaker reaching the user's ear. The AR / VR headset and head-mounted speaker here may be the terminal device 110 in the present disclosure.

[0345] To meet these delay-related conditions, the above-mentioned technical specifications and reports stipulate that the 5G system should meet the following two requirements regarding rendering.

[0346] ·Max Allowed End-to-end latency: 5ms (i.e., the total allowable delay of the uplink and downlink between the terminal (e.g., terminal device 110) and the interface to the data network (e.g., the network where the Application Function (AF) is located) is 5ms). ·Service bit rate: user-experienced data rate: 0.1Gbps (100Mbps) (i.e., the throughput capable of supporting AR / VR content).

[0347] Note that the rendering here includes Cloud rendering, Edge rendering, or Split rendering. Cloud rendering means that AR / VR data is rendered on the cloud of the network (on a certain entity based on the core network (including UPF) placement and data network (including application server and AF) placement without considering the user's location). Edge rendering means that AR / VR data is rendered on the edge of the network (on a certain entity (e.g., Edge Computing Server, an application server in the data network in the network placement for Edge Computing) based on the core network (including UPF) placement and data network (including application server and AF) placement close to the user's location). Split rendering means that part of the rendering is performed on the cloud and the other part is performed on the edge.

[0348] FIG. 26 is an image diagram of a rendering server and an AR / VR client related to rendering. FIG. 26 is described in the above technical report. Here, the AR / VR client may correspond to the terminal device 110 in the present disclosure. Also, the Cloud Render Server may correspond to the information processing device 150 in the present disclosure. Further, the Cloud Render Server may be an application server (for example, Edge Computing Server) for edge computing within a Local Area Data Network (LADN) where a Local UPF connected to the base station device 130 in the present disclosure serves as an interface. Further, the Cloud Render Server may be named Edge Render Server or Split Render Server.

[0349] In this application example, for example, in the case of data communication (for example, session (PDU session), radio bearer, packet flow (QoS flow)) that requires a motion-to-photon delay (7 - 15 ms) or a motion-to-sound delay (less than 20 ms), the above-described reconfiguration of SPS or CG may be performed.

[0350] In another aspect, in the case of data communication (for example, session (PDU session), radio bearer, packet flow (QoS flow)) that requires a rendering-related required condition Max Allowed End-to-end latency (5 ms), the above-described reconfiguration of SPS or CG may be performed.

[0351] <<7. Conclusion>> The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings. However, the technical scope of the present disclosure is not limited to such examples. It is obvious that those having ordinary knowledge in the technical field of the present disclosure can conceive of various modification examples or correction examples within the scope of the technical idea described in the claims, and these are naturally understood to belong to the technical scope of the present disclosure.

[0352] Among the processes described in the above embodiments, all or part of the processes described as being automatically performed can also be manually performed, or all or part of the processes described as being manually performed can be automatically performed by a known method. In addition, the processing procedures, specific names, and information including various data and parameters shown in the above documents and drawings can be arbitrarily changed unless otherwise specified. For example, the various information shown in each figure is not limited to the illustrated information.

[0353] Also, each component of each device shown in the drawings is a functional concept, and it is not necessarily physically configured as shown in the drawings. That is, the specific form of the distribution and integration of each device is not limited to that shown in the drawings, and all or part of it can be functionally or physically distributed and integrated in any unit according to various loads and usage situations.

[0354] Also, the above-described embodiments can be appropriately combined within a range that does not conflict with the processing content.

[0355] Also, the effects described in this specification are merely illustrative or exemplary and not limiting. That is, the technology according to the present disclosure can exhibit other effects that are obvious to those skilled in the art from the description of this specification, together with or instead of the above effects.

[0356] Note that the following configurations also belong to the technical scope of the present disclosure. (1) A wireless communication unit that transmits video data to a terminal device at a predetermined period, When the difference between the periodic reception timing at which the terminal device receives the video data and the display timing of the video data displayed on the terminal device at a predetermined frame rate satisfies a predetermined condition, a control unit that changes the setting regarding the reception timing A base station device comprising: (2) The base station device according to (1), wherein the setting regarding the reception timing is a Semi-Persistent Scheduling (SPS) setting. (3) The base station device according to (1) or (2), wherein the control unit changes the setting regarding the reception timing by resetting the reception timing so that the reception timing and the display timing match. (4) The base station device according to any one of (1) to (3), wherein the control unit changes the setting regarding the reception timing by notifying the terminal device of an offset indicating the reception timing after the change. (5) The base station device according to any one of (1) to (4), wherein when the settings regarding a plurality of the reception timings are set in the terminal device, the control unit notifies the terminal device of the setting to be deactivated and the setting to be newly activated among the settings regarding the plurality of the reception timings, thereby changing the setting regarding the reception timing. (6) The base station device according to any one of (1) to (5), wherein the predetermined condition is that the difference is equal to or greater than a threshold value, or the cumulative value of the difference is equal to or greater than a threshold value. (7) The base station device according to any one of (1) to (6), wherein the control unit changes the setting regarding the reception timing in response to a request from the terminal device. (8) The base station device according to any one of (1) to (7), wherein the control unit changes the setting regarding the reception timing in response to an instruction from a network function belonging to the network to which it is connected. (9) The base station apparatus according to any one of (1) to (8), wherein the control unit acquires information regarding the frame rate from a content server that acquires the video data. (10) When the terminal device generates an image from the video data based on information regarding the user's viewpoint and displays the video data at a second frame rate higher than the frame rate, the terminal device adjusts the number of images generated according to the difference. The base station apparatus according to any one of (1) to (9). (11) The control unit transmits each region obtained by dividing the video data into a plurality of regions at the reception timing set according to the priority of the region. The priority of the region is set based on information regarding the user's viewpoint. The base station apparatus according to any one of (1) to (10). (12) The priority of the region is set according to the resolution of the region set based on information regarding the user's viewpoint. The base station apparatus according to (11). (13) A wireless communication unit that receives video data from a base station apparatus at a predetermined period, A control unit that displays the video data at a predetermined frame rate, and when a difference between a periodic reception timing at which the wireless communication unit receives the video data and a display timing at which the video data is displayed at the predetermined frame rate satisfies a predetermined condition, the wireless communication unit receives the video data based on the changed reception timing setting. Terminal device. (14) Transmitting video data to a terminal device at a predetermined period, and when a difference between a periodic reception timing at which the terminal device receives the video data and a display timing at which the video data is displayed on the terminal device at a predetermined frame rate satisfies a predetermined condition, changing a setting regarding the reception timing. A communication method including (15) Receiving video data from a base station apparatus at a predetermined period, Displaying the video data at a predetermined frame rate, When receiving the video data, if the difference between the periodic reception timing of receiving the video data and the display timing of displaying the video data at the predetermined frame rate satisfies a predetermined condition, receiving the video data based on the set reception timing that has been changed. A communication method including (16) A wireless communication unit that receives information about a user from a terminal device at a first period and transmits video data generated based on the information about the user at a second period, A control unit that changes the setting of the transmission timing at which the terminal device periodically transmits information about the user when the difference between the periodic reception timing at which the terminal device receives the video data and the display timing of the video data displayed on the terminal device at a predetermined frame rate satisfies a predetermined condition. A base station apparatus comprising (17) The base station apparatus according to (1), wherein the control unit further sets a period of intermittent reception and an on period based on the setting regarding the reception timing. (18) The base station apparatus according to (17), wherein the control unit sets one intermittent reception as the intermittent reception setting and allocates a downlink control channel to the on period in the setting of the one intermittent reception. (19) The control unit sets a second intermittent reception different from a first intermittent reception for monitoring a downlink control channel as the intermittent reception setting, The base station apparatus according to (17), wherein the period and the on period of the second intermittent reception are set based on the setting regarding the reception timing. (20) The control unit sets a threshold related to the interval between the first on-period of the first intermittent reception and the second on-period of the second intermittent reception as the setting of the second intermittent reception, for the base station apparatus according to (19). (21) The wireless communication unit sets the cycle and on-period of intermittent reception based on the setting of the reception timing, for the terminal device according to (13). (22) The wireless communication unit sets a second intermittent reception different from the setting of the first intermittent reception for monitoring the downlink control channel as the setting of the intermittent reception, wherein the cycle and on-period of the second intermittent reception are set based on the setting of the reception timing, for the terminal device according to (21). (23) When part or all of the first on-period of the first intermittent reception and the second on-period of the second intermittent reception overlap, the wireless communication unit sets a third on-period including the first on-period and the second on-period, for the terminal device according to (22). (24) The wireless communication unit sets a threshold related to the interval between the first on-period of the first intermittent reception and the second on-period of the second intermittent reception as the setting of the second intermittent reception, and when the interval between the first on-period of the first intermittent reception and the second on-period of the second intermittent reception is less than or equal to the threshold, sets a third on-period including the first on-period and the second on-period, for the terminal device according to (22).

Explanation of Signs

[0357] 100 Content Delivery System 110 Terminal Device 130 Base Station Device 131 Communication Unit 134 Control Unit 150 Information Processing Device

Claims

1. Obtaining periodic information of XR traffic from a core network; The periodic information of the traffic of the XR is indicated by information related to the traffic, The periodic information of the traffic of the XR is used to set DRX (Discontinuous Reception), Base station equipment.

2. The base station device according to claim 1 , wherein the information relating to the XR traffic is related to a Policy and Charging Control (PCC) Rule.

3. The base station device according to claim 1 , wherein the periodicity information of the XR traffic is acquired from the core network in relation to a PDU (Protocol Data Unit) session establishment process for an XR service.

4. The base station apparatus according to claim 1 , wherein a plurality of transmission opportunities are set within one period of a Configured Grant (CG) setting.

5. The base station device according to claim 4 , further comprising: a plurality of the transmission opportunities configured within one period of the setting of the CG associated with the periodicity information of the traffic of the XR.

Citation Information

Patent Citations

  • Base station device, communication system, terminal device, method for communication, and program

    JP2019165328A

  • Systems and methods for enhanced user equipment assistance information in wireless communication systems

    US20170013557A1