Information processing device, terminal device, system, method and program

Abstract

This system provides a method for reducing the amount of data transferred during the distribution of video from an information processing device to a terminal device for display. [Solution] The terminal device transmits terminal status information relating to the state of the terminal device to the information processing device. Based on the terminal status information received from the terminal device, the information processing device detects or predicts that the video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device is not being used, and based on the detection or prediction of the non-use, it reduces or stops the distribution of the video consisting of multiple frame images to the terminal device.

Description

Technical Field

[0001] This disclosure relates to the transfer of screen images between an information processing device and a terminal device.

Background Art

[0002] Conventionally, a server as an information processing device having the function of MEC (abbreviation of "Multi-Access Edge Computing" or "Mobile Edge Computing"), which arranges computing resources closer to a base station than a core network of mobile communication (a place physically closer to a user's terminal device) to perform processing of various services, is known (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

[0004] A system according to an aspect of the present disclosure is a system including an information processing device and a terminal device that can communicate with each other via a base station of mobile communication. The terminal device transmits terminal state information regarding the state of the terminal device to the information processing device. The information processing device detects or predicts non-use, in which use of a video composed of a plurality of frame images distributed from the information processing device and output to a display screen of the terminal device is not performed, based on the terminal state information received from the terminal device, and thins out or stops the distribution of the video composed of the plurality of frame images to the terminal device based on the detection or prediction of the non-use.

[0005] In the system described above, the information processing device may, based on the terminal status information received from the terminal device, predict the resumption of use of a video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device, and based on the prediction of the resumption of use, make prior preparations for the distribution of the video to the terminal device, and immediately resume the distribution of the video to the terminal device.

[0006] In the system described above, the terminal status information may include at least one piece of information: information indicating whether the display screen is lit or turned off, information indicating angular velocity or acceleration indicating a change in the orientation of the terminal device, and information regarding the ambient illuminance around the terminal device.

[0007] In the system described above, the terminal device may generate terminal status information based on the output of one or more sensors provided on the terminal device.

[0008] In the system described above, the information processing device may include a video transmission unit that transmits the video to the terminal device, and a video control unit that controls the output rate of the video from the video transmission unit based on the terminal status information.

[0009] In the aforementioned system, the information processing device may, when the terminal device is in the unused state, extend the transmission interval of the video frame image data to the upper limit of a predetermined range and transmit only keyframes or only still images to the terminal device.

[0010] In the system described above, if the display screen of the terminal device is turned off or the video is not displayed and the terminal device remains stationary for a predetermined period of time, the information processing device may stop distributing the video to the terminal device and continue to transmit control signals to the terminal device.

[0011] In the system described above, if the information processing device detects a change in the orientation of the terminal device or an indication of the display screen lighting up, it may warm up the decoder and encoder for generating the frame image data of the video and pre-fill the transmission buffer with the frame image data of the video.

[0012] In the system described above, when non-use is detected or predicted, the session for video distribution between the information processing device and the terminal device may not be disconnected, and the session may be maintained in a low-load state.

[0013] In the aforementioned system, the information processing device may use an AI having a judgment model created in advance through machine learning to detect or predict the non-use.

[0014] In the system described above, the information processing device may include: a receiving unit that receives terminal status information relating to the status of the terminal device from the terminal device via a mobile communication base station; a virtual terminal function unit that performs on behalf of the terminal device the process of drawing multiple frame images of the video to be displayed on the display screen of the terminal device to generate multiple frame image data; and a transmitting unit that transmits the multiple frame image data of the video to the terminal device via the base station.

[0015] An information processing device according to another aspect of the present disclosure is an information processing device capable of communicating with a terminal device via a mobile communication base station. This information processing device includes: a receiving unit that receives terminal status information relating to the state of the terminal device from the terminal device via a mobile communication base station; a non-use determination unit that detects or predicts non-use of a video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device, based on the terminal status information received from the terminal device; and a distribution control unit that reduces or stops the distribution of the video consisting of multiple frame images to the terminal device based on the detection or prediction of non-use.

[0016] The information processing device may be an MEC device located closer to a base station than the core network of a mobile communication network, an MEC device mounted on the base station, an MEC device having the functions of the base station, a device or system that provides private cloud services within the core network of a mobile communication network, or a device or system that provides public cloud services in a connection network located outside the core network of a mobile communication network.

[0017] A terminal device according to yet another aspect of the present disclosure is a terminal device capable of communicating with an information processing device via a mobile communication base station. This terminal device comprises a receiving unit that receives a plurality of frame image data of video displayed on the display screen of the terminal device from the information processing device, and a transmitting unit that transmits terminal state information relating to the state of the terminal device to the information processing device.

[0018] A method relating to yet another aspect of the present disclosure is a method for controlling the transfer of display images in a system comprising an information processing device and a terminal device that can communicate with each other via a mobile communication base station. This method includes: the terminal device transmitting terminal status information relating to the state of the terminal device to the information processing device; the information processing device detecting or predicting, based on the terminal status information received from the terminal device, that a video consisting of a plurality of frame images distributed from the information processing device and output to the display screen of the terminal device is not being used; and the information processing device reducing or stopping the distribution of the video consisting of a plurality of frame images to the terminal device based on the detection or prediction of non-use.

[0019] A program relating to yet another aspect of this disclosure is a program that runs on a computer or processor provided in an information processing device capable of communicating with a terminal device via a mobile communication base station. This program includes program code for detecting or predicting non-use of a video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device, based on terminal status information received from the terminal device, and program code for reducing or stopping the distribution of the video consisting of multiple frame images to the terminal device based on the detection or prediction of non-use.

[0020] A program according to yet another aspect of this disclosure is a program that runs on a computer or processor in a terminal device that can communicate with an information processing device via a mobile communication base station. This program includes program code for receiving a plurality of frame image data of video displayed on the display screen of the terminal device from the information processing device, and program code for transmitting terminal state information relating to the state of the terminal device to the information processing device.

[0021] Furthermore, the program disclosed herein may include a pre-trained model used in machine learning or a trained model created by machine learning (for example, a model used in the AI ​​provided in the aforementioned information processing device, or a model used in the AI ​​provided in the aforementioned terminal device). [Brief explanation of the drawing]

[0022] [Figure 1] Figure 1 is an explanatory diagram showing an example of a schematic configuration of a thin client UE to which the system according to the embodiment can be applied. [Figure 2] Figure 2 is an explanatory diagram showing an example of the main components of an information processing device in a system according to the embodiment. [Figure 3] Figure 3 is an explanatory diagram illustrating the challenges in transferring screen images from the information processing unit to the terminal device in a thin client UE system, as shown in the reference example. [Figure 4]FIG. 4 is a sequence diagram when a general session reconnection method is applied to the system of the client UE according to the reference example. [Figure 5] FIG. 5 is an explanatory diagram showing an example of transfer control of a screen image according to the state of a terminal device in the system according to the embodiment. [Figure 6] FIG. 6 is a functional block diagram showing an example of the main configuration of an information processing device and a terminal device in the system according to the embodiment.

Mode for Carrying Out the Invention

[0023] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. A system according to an embodiment of the present disclosure is a screen image transfer control system that can improve the efficiency of transferring (network transfer) a screen image when distributing video from an information processing device (for example, a server device or a MEC device) to a user's terminal device (UE). For example, in the system according to the present embodiment, when a system of a client UE in which an information processing device and a terminal device cooperate with each other is constructed, the user experience quality (low latency and visual continuity) of a user operating the actual UE is not impaired, and the transfer data amount (network traffic) of the screen image of the distribution video transferred from the client UE (virtual terminal function unit, virtual UE function unit, vUE) of the information processing device to the terminal device (actual UE) actually operated by the user can be reduced.

[0024] In the embodiments of the present disclosure, a configuration example of a mobile communication system conforming to the fifth-generation standard specification will be mainly described. However, the system and information processing devices such as the MEC device of the present embodiment are also applicable to mobile communication systems conforming to the next-generation standard specifications after the fourth and fifth generations. In addition, the system and information processing devices of the present embodiment can also be used in a radio access network, a fixed network (for example, a fixed network connected by wire in a house), and the like.

[0025] Figure 1 is an explanatory diagram showing an example of a schematic configuration of a thin client UE to which the system according to the embodiment can be applied. In Figure 1, the system of this embodiment is a cellular mobile communication system conforming to the fifth generation standard specifications, and comprises a 5G core network (hereinafter also referred to as "5G core" in the embodiment) 10 which is the core network of the mobile communication network, a gNodeB (hereinafter also referred to as "gNB" in the embodiment) 20 which is a base station, and an MEC group 300 which includes a plurality of MEC devices (hereinafter also referred to as "MEC" in the embodiment). The user device (hereinafter also referred to as "UE" in the embodiment) 50 which is the user's terminal device can send and receive various information and data with the MEC (information processing device) 30 via the gNB 20 and UPF (User Plane Function) 101. In addition, the UE 50 can access the Internet 80 via the gNB 20, UPF 101, 102, and send and receive various information and data with various devices such as servers on the Internet 80 and various systems such as cloud computer systems. In this embodiment, UE50 is, for example, a subscriber terminal used by a subscriber of a mobile communication service.

[0026] MEC30 is a computer device such as a server that has MEC (Multi-Access Edge Computing or Mobile Edge Computing) functionality, which involves locating computing resources closer to the gNB (base station) 20 (physically closer to the UE50) than the 5G core 10 or its main components to process various services. MEC30 is expected to achieve the following: suppression of traffic volume flowing into the core network, reduction of security risks through local data production and consumption, improvement of real-time performance through shortened transmission distance, and load reduction through distributed processing. MEC30 may be installed on the gNB (base station) 20, or it may have the functionality of the gNB (base station) 20. Furthermore, multiple MEC30s belonging to the MEC group 300 may be located in multiple different areas (e.g., base station cells). Furthermore, the information processing device disclosed herein may be a device or system that provides private cloud services (e.g., a telecommunications carrier's private cloud services) within the 5G core 10 of a mobile communication network, or it may be a device or system that provides public cloud services in a connectivity network (e.g., the Internet) located outside the 5G core 10 of a mobile communication network.

[0027] In this embodiment, the multiple UPFs 101 and 102 in the 5G core 10 are node devices having network functions that process communication in the user plane (hereinafter also referred to as "U-Plane") where user data is sent, received, and processed. In Figure 1, among the multiple UPFs of the 5G core 10, UPF-MEC101 is a UPF that processes user plane communication with the MEC30.

[0028] In the following description, when describing multiple MEC30s separately, an identification number in parentheses will be added to the code; when describing common configurations, the identification number in parentheses will not be added. The same applies to other gNB20, UE50, UPF101, 102, etc. Also, in the following description, MEC30 may be a server device as an information processing device (hereinafter also referred to as "server" or "host server").

[0029] The 5G core 10 of this embodiment is composed of the aforementioned U-Plane and a control plane portion (hereinafter also referred to as "C-Plane"). The C-Plane is the overall control system of the mobile communication system, mainly where control signals are sent, received, and processed.

[0030] The C-Plane houses functional units (node ​​devices) such as the RAN (Radio Access Network) accommodating gNB20, UPF (User Plane Function), AMF (Access and Mobility Management Function), SMF (Session Management Function), NWDAF (Network Data Analytics Function), UDR (Unified Data Repository), and AUSF (Authentication Server Function). The RAN is the radio access network. The UPF has functions such as subscriber communication packet forwarding. The AMF has functions such as subscriber mobility management. The SMF has functions such as subscriber session management. The NWDAF has functions such as analysis of 5G core 10 network data. The UDR has functions such as a subscriber information database. The AUSF has functions such as subscriber authentication.

[0031] Furthermore, the C-Plane is configured with functional units (node ​​devices) such as NSSF (Network Slice Selection Function), NEF (Network Exposure Function), NRF (Network Repository Function), PCF (Policy Control Function), UDM (Unified Data Management), and AF (Application Function). NSSF has functions such as network slice selection. NEF has functions such as external exposure of 5G core functions. NRF has functions such as 5G core function management. PCF has functions such as policy control. UDM has functions such as subscriber information management. AF has functions such as external application server.

[0032] In C-Plane, communication between node devices such as AMFs is conducted via interfaces such as Namf. Furthermore, communication between multiple gNB20s in the RAN is conducted via the Xn interface.

[0033] The U-Plane houses the RAN, DN (Data Network), etc., which accommodate the aforementioned UPF101, 102, and gNB20. The DN is an external data network to the 5G core. The DN houses the cloud, which is connected via the Internet 80, the IMS (IP Multimedia Subsystem) which provides services such as IP telephony including voice and video calls, and messaging services such as SMS, the MEC30, etc. The U-Plane may also include the UE50.

[0034] Communication between the AMF on the C-Plane and the UE50 on the U-Plane takes place via the N1 interface, and communication between the AMF and gNB20 takes place via the N2 interface. Communication between the SMF on the C-Plane and UPF101 and 102, which are at the point of contact with the U-Plane, takes place via the N4 interface. In the U-Plane, communication between gNB20 and UPF101 takes place via the N3 interface, communication between UPF102 and DN takes place via the N6 interface, and communication between multiple UPF101 and 102 takes place via the N9 interface.

[0035] The system of this embodiment can construct a thin client UE55 system in which UE50 and MEC30 cooperate with each other. The thin client UE55 is a system that can reduce the processing load on the actual UE 50 by using the UE 50 that the user actually uses and operates (hereinafter also referred to as "actual UE") as a thin client type UE that inputs information and data. The server device such as MEC30 on the network side executes some or most of the processing of the actual UE 50 on behalf of the actual UE 50 based on the information and data received from the actual UE 50.

[0036] In the system of this embodiment, a thin client UE55 system can be constructed in which the actual UE50 and MEC30 cooperate with each other to transmit and receive at least one of audio and video between the actual UE50 and target devices such as other UEs, and to use network services with the Internet 80.

[0037] Figure 2 is an explanatory diagram showing an example of the main components of an information processing device (MEC30) according to the embodiment. The MEC30 is, for example, a server device composed of a single computer device or multiple computer devices. In Figure 2, the MEC30 has a main unit 31 and an application execution unit 32. The main unit 31 has a physical server (hardware) 311, a host kernel (OS) 312, and a container base 313 for executing containers of various applications. The application execution unit 32 has, for example, a guest kernel (OS) 33 consisting of open software and a thin client UE container 34 consisting of proprietary software for building the thin client UE55 system described above. The guest kernel (OS) 33 and the thin client UE container 34 are combined and implemented as a container that can be started on the main unit 31. The MEC30 may also have a function (virtual base station function unit) that connects the MEC30 to the 5G core (core network) 10 as a pseudo base station of a mobile communication network.

[0038] The thin client UE container 34 runs on the guest kernel (OS) 33 and has functions such as a terminal OS 341, an input unit 342, a screen rendering function 343, a media framework 344, and an output unit 345. The terminal OS 341 is a virtual OS that substitutes for the thin client UE container 34 to perform some of the UE's processing. The terminal OS 341 may also be an OS that manages applications involving full-screen switching.

[0039] The input unit 342 has the function of inputting operation information received from the actual UE 50 and at least one data of voice and sensor information into the application. The input unit 342 functions as a receiver that receives operation information from the actual UE (user terminal device) 50 and at least one input data of voice and sensor information input from the actual UE 50 via the gNB (mobile network base station) 20.

[0040] The screen rendering function 343 is executed on the terminal OS 341 and has the function of rendering and generating image elements of the display screen that will be shown on the actual UE 50.

[0041] The media framework 344 has a function to generate output data for a display screen and output data for at least one of audio, video, and messages by encoding, for example, the image elements of the display screen generated by the screen rendering function 343 and at least one of the audio, video, and messages output from the actual UE 50 in a predetermined format that the actual UE 50 can decode and output.

[0042] The output unit 345 transmits the output data of the display screen generated by the media framework 344, at least one output data of audio, video, and messages (including frame image data of the screen image), and the screen transition information described later to the actual UE 50. The output unit 345 functions as a transmission unit that transmits at least one output data of audio, video, messages, and display screens (including frame image data of the screen image) output from the actual UE 50 to the actual UE 50 via the gNB (base station) 20.

[0043] Figure 3 is an explanatory diagram illustrating the challenges in transferring screen images from the information processing device (server) to the terminal device (actual UE) in a thin client UE system according to a reference example. In Figure 3, parts common to the system in Figure 1 are denoted by the same reference numerals, and their explanations are omitted. In the system according to the reference example in Figure 3, for example, when a user operates the actual UE 50 to use the video distribution service from the server 30, the user often operates the actual UE 50 intermittently and views the display screen intermittently. Therefore, even when the user is not operating the actual UE 50, i.e., when the user is not looking at the display screen (for example, when the screen is off, the screen brightness is reduced, or the standby screen is displayed), frame image data of multiple screen images 610 to 650 displayed on the entire (full) screen of the actual UE 50 is transferred from the thin client UE 55 of the server 30 to the actual UE 50 at predetermined time intervals. This transfer of frame image data of the display images when not in use is a wasteful transfer of frame image data that the user is not looking at, reducing the efficiency of image data transfer and putting pressure on the communication bandwidth.

[0044] Figure 4 is a sequence diagram showing the case where a general session reconnection method is applied to a thin client UE system in the reference example. In Figure 4, when the user operates the physical UE 50 and the display screen of the physical UE 50 is turned ON (S901), and the video distribution service from the server 30's thin client UE 55 to the physical UE 50 is used, a session is established between the physical UE 50 and the thin client UE 55 (S902). After the session is established and the use of the video distribution service begins, if the user does not operate the physical UE 50 for a predetermined period of time, the display screen of the physical UE 50 will turn OFF (unused state) (S903), and the session between the physical UE 50 and the thin client UE 55 will be disconnected (S904). Subsequently, when the user resumes operating the physical UE 50, the display screen of the physical UE 50 will turn ON (S905), and the session between the physical UE 50 and the thin client UE 55 will be rebuilt (S906). Because this session reconstruction causes a delay of several seconds to tens of seconds, in a real UE50 where users intermittently operate and view the display screen, convenience is greatly impaired and the user's perceived quality (low latency and visual continuity) is compromised. Therefore, the above-mentioned general session reconnection method is unsuitable for thin client UE systems.

[0045] In the system of this embodiment, terminal status information (hereinafter also referred to as "UE status information") regarding the state of the actual UE50 is fed back from the actual UE50 to the thin client UE55 to reduce the amount of screen image data transferred when video is distributed from the server 30's thin client UE55 to the actual UE50, without compromising the perceived quality (low latency and visual continuity) of the user operating the actual UE50. Based on the fed-back UE status information, the server 30 controls the transfer of screen images from the thin client UE55 to the actual UE50.

[0046] Figure 5 is an explanatory diagram showing an example of screen image transfer control according to the state of a terminal device (UE) in the system according to the embodiment. In Figure 5, parts common to Figures 1 to 3 described above are denoted by the same reference numerals and their descriptions are omitted. In the system according to the embodiment of Figure 5, the actual UE (terminal device) 50 transmits terminal state information (hereinafter also referred to as "UE state information") regarding the state of the actual UE 50 to the thin client UE 55 of the server (information processing device) 30. The actual UE 50 generates the UE state information, for example, based on the output of one or more sensors provided on the actual UE 50.

[0047] The UE status information may include at least one piece of information: information indicating whether the display screen (touchscreen) of the actual UE50 is lit or turned off; information indicating the angular velocity or acceleration indicating the change in the attitude of the actual UE50; and information regarding the ambient illuminance around the actual UE50. Here, the angular velocity or acceleration information is, for example, information regarding the output signal of the angular velocity or acceleration output from a gyro sensor (also called a "gyroscope") mounted on the actual UE50, or information regarding the angular velocity or acceleration calculated based on the output signal output from the gyro sensor. The ambient illuminance information is, for example, information regarding the output signal of the ambient illuminance output from an illuminance sensor mounted on the actual UE50, or information regarding the ambient illuminance calculated based on the output signal output from the illuminance sensor.

[0048] Based on UE status information received from the actual UE 50, the thin client UE 55 of the server 30 detects or predicts that the video consisting of multiple frame images distributed from the server 30 and output to the display screen (touchscreen) of the actual UE 50 is not being used. Based on the detection or prediction of non-use, it reduces or stops the transfer of frame image data in the distribution of the video consisting of multiple screen images (frame images) to the actual UE 50. In the example in Figure 5, when the actual UE 50 is not in use (for example, when the display screen (touchscreen) is turned off), transfer control is performed so that the frame image data of the second screen image 610' to the fourth screen image 640' from the five consecutive frame image data of screen images 610 to 650 sent from the thin client UE 55 of the server 30 to the actual UE 50 is reduced and not transferred to the actual UE 50. This prevents the unnecessary transfer of frame image data when the actual UE 50 is not in use (for example, when the display screen (touchscreen) is turned off).

[0049] Note that the screen images to be thinned out may be any one or more screen images selected from the multiple screen images 610 to 650. Also, when the actual UE 50 is not in use (for example, when the display screen (touchscreen) is turned off), the transfer of all frame image data of the multiple screen images 610 to 650 may be stopped.

[0050] In the system shown in Figure 5, the thin client UE55 of server 30 may, based on UE status information received from the actual UE50, predict the resumption of use of video consisting of multiple frame images distributed from the thin client UE55 and output to the display screen of the actual UE50. Based on this prediction of the resumption of use, it may prepare in advance for the distribution of video to the actual UE50 and immediately resume the distribution of video to the actual UE50. In this case, delays in the resumption of transmission of video frame images to the actual UE50 can be avoided.

[0051] In the system shown in Figure 5, when the actual UE 50 is not in use, the thin client UE 55 of the server 30 may extend the transmission interval of the video frame image data up to the upper limit of a predetermined range and transmit only keyframes or only still images to the actual UE 50. In this case, the upper limit of the communication bandwidth between the actual UE 50 and the thin client UE 55 of the server 30 during the decimated transfer of frame image data in the unused state can be managed, and the amount of communication can be significantly reduced.

[0052] In the system shown in Figure 5, if the thin client UE55 of the server 30 is turned off or the video is not displayed on the display screen of the actual UE50 and the actual UE50 remains stationary for a predetermined period of time, it may stop distributing video to the actual UE50 (transferring frame image data) and continue to transmit only control signals to the actual UE50. In this case, the unnecessary transfer of frame image data to the actual UE50 in the unused state can be eliminated, thereby minimizing the communication load between the actual UE50 and the server 30, as well as minimizing the power consumption of both the actual UE50 and the server 30.

[0053] In the system shown in Figure 5, when the thin client UE55 of the server 30 detects a change in the orientation of the actual UE50 or an indication that the display screen of the actual UE50 is about to light up, it may warm up the decoder and encoder for generating the frame image data of the video and pre-fill the transmission buffer with the frame image data of the video. In this case, it is possible to prevent the loss of frame image data (frame drop) immediately after resuming transmission of the frame image of the video to the actual UE50, and to realize an immediate experience of using the video when video distribution is resumed.

[0054] In the system shown in Figure 5, when non-use is detected or predicted, the session for video distribution between the server 30's thin client UE55 and the actual UE50 may not be disconnected, and the session may be maintained in a low-load state. In this case, when the actual UE50 intermittently uses the video distributed from the thin client UE55, session disconnection and reconstruction do not occur, thus ensuring convenience during intermittent use.

[0055] In the system shown in Figure 5, the thin client UE55 of server 30 may use an AI having a judgment model created in advance through machine learning to detect or predict the non-use. Alternatively, the thin client UE55 may use an AI having a judgment model created in advance through machine learning to predict the resumption of the use of the video.

[0056] Figure 6 is a functional block diagram showing an example of the main components of an information processing device (server) and a terminal device (UE) in a system according to this embodiment. In Figure 6, the thin client UE 55 of the server 30 comprises a thin client UEOS 550, a video control unit 552, and a video transmission unit 553.

[0057] The thin client UEOS550 is the basic system (terminal OS) that constitutes the thin client UE55. The thin client UEOS550 also functions as a virtual terminal function unit (virtual UE function unit) that executes some of the processing performed by the actual UE50 on behalf of the actual UE50 based on operation information received from the actual UE50. For example, the thin client UEOS550 also functions as a virtual terminal function unit that executes the process of generating multiple frame image data by drawing multiple frame images of video to be displayed on the display screen of the actual UE50 on behalf of the actual UE50. For example, the thin client UEOS550 executes virtual UE functions based on operation information (touch information) received from the actual UE50. In addition, the thin client UEOS550 draws the display screen of a virtual UE based on the processing content.

[0058] The video control unit 552 also functions as a receiving unit that receives UE status information regarding the state of the actual UE 50 from the actual UE 50 via a mobile communication base station.

[0059] The video control unit 552 receives frame image data of the screen image drawn by the thin client UEOS 550 and outputs it to the video transmission unit 553. The video control unit 552 incorporates, for example, software that includes an RTSP (Real Time Streaming Protocol) server, which is a communication protocol for controlling the distribution of video and audio, and controls the variable bitrate and variable frame rate in said distribution.

[0060] The video control unit 552 controls the video output rate of the video transmission unit 553 based on the aforementioned UE status information. For example, the video control unit 552 adjusts the frame rate and information amount of the video frame image data output to the video transmission unit 553 based on a request from the sensor monitoring unit 514 of the actual UE 50. This adjustment of the frame rate and information amount is performed, for example, to the extent that the session between the thin client UEOS 550 and the actual UE 50 can be maintained. In addition, the video control unit 552 may have a function to delay the reflection of changes in the image quality of the video to be transmitted, for example, by using a delay timer, to deal with cases where multiple changes in the image quality of the video to be transmitted occur in a short period of time.

[0061] The video transmission unit 553 also functions as a transmission unit that transmits multiple frame image data of the video to the actual UE 50 via the base station. For example, the video transmission unit 553 converts the frame image data of the drawing screen image (screen image) received from the video control unit 552 into a format that can be sent over the network, and transmits it to the actual UE 50 via the network. The video transmission unit 553 may also have an RTP (Real-time Transport Protocol) server function that uses RTP (Real-time Transport Protocol), a communication protocol for transmitting continuous data flows such as audio and video in real time over a TCP / IP network.

[0062] In Figure 6, the actual UE 50 comprises a client application execution unit 510, a touchscreen 520 as a display unit, a gyro sensor 541, and an illuminance sensor 542. The touchscreen 520 is a physical device with a touch sensor built into the screen (display surface), and has the function of displaying images and receiving user operations. For example, the touchscreen 520 acquires user operation information and transmits it to the thin client UE 55 of the server 30 via the touch information transmission unit 511. The touchscreen 520 also displays the screen content of the thin client UE 55. Furthermore, the touchscreen 520 maintains the ON / OFF state of the screen.

[0063] The client application execution unit 510 includes a video receiving unit 512 and a sensor monitoring unit 514. The video receiving unit 512 also functions as a receiver that receives multiple frame image data of the video displayed on the display screen of the actual UE 50 from the thin client UE 55 of the server 30. For example, the video receiving unit 512 receives video packets (e.g., frame image data of the distributed video) from the video transmission unit 553 of the thin client UE 55, decodes them, and then outputs them as screen images to the touchscreen 520. The video receiving unit 512 may also have RTP (Real-time Transport Protocol) client functionality.

[0064] The screen image output from the video receiving unit 512 (for example, a screen image of a streamed video) is drawn on the touchscreen 520.

[0065] The gyro sensor 541 can detect the angular velocity or acceleration of the actual UE50, collect the detected data, and output it as gyro information. The illuminance sensor 542 can detect the ambient illuminance around the actual UE50, collect the detected data, and output it as illuminance information.

[0066] The sensor monitoring unit 514 also functions as a transmitter that sends UE status information regarding the state of the actual UE 50 to the thin client UE 55 of the server 30.

[0067] For example, the sensor monitoring unit 514 periodically monitors the gyro information output from the gyro sensor 541 and the illuminance information output from the illuminance sensor 542. When at least one of the gyro information and the illuminance information changes beyond a predetermined amount, the sensor monitoring unit 514 sends a control request to the video control unit 552 of the thin client UE 55 of the server 30 according to the amount of change. The sensor monitoring unit 514 also monitors the ON / OFF state of the touchscreen 520 and sends a control request to the video control unit 552 of the thin client UE 55 of the server 30 according to its ON / OFF state. The control request sent from the sensor monitoring unit 514 to the video control unit 552 of the thin client UE 55 includes the aforementioned UE state information.

[0068] In the system shown in Figure 6, the client application execution unit 510 may be equipped with an AI (device AI) having a judgment model created in advance through machine learning, and may use the device AI to monitor gyro information and illuminance information. Alternatively, the client application execution unit 510 may use the device AI to determine whether at least one of the gyro information and illuminance information has changed by more than a predetermined amount.

[0069] In Figure 6, the video control unit 552 also functions as an unused determination unit that detects or predicts unused video consisting of multiple frame images distributed from the server 30's thin client UE 55 and output to the display screen of the actual UE 50, based on UE status information received from the actual UE 50. Furthermore, the video control unit 552 also functions as a distribution control unit that reduces or stops the distribution of video consisting of multiple frame images to the actual UE 50 based on the detection or prediction of unused video.

[0070] The video control unit 552 of the thin client UE55, in response to a control request received from the actual UE50, detects or predicts, based on the aforementioned UE status information, that the video consisting of multiple frame images distributed from the thin client UE55 and output to the touchscreen 520 of the actual UE50 is not being used. If the video control unit 552 detects or predicts such non-use, it controls the video output rate of the video transmission unit 553 to reduce or stop the distribution of the video consisting of multiple frame images to the actual UE50.

[0071] Furthermore, the video control unit 552 of the thin client UE55, in response to a control request received from the actual UE50, predicts the resumption of use of video consisting of multiple frame images distributed from the thin client UE55 and output to the touchscreen 520 of the actual UE50, based on the aforementioned UE status information. When the video control unit 552 predicts the resumption of use, it prepares for the distribution of video to the actual UE50 and immediately resumes the distribution of video to the actual UE50.

[0072] In the system shown in Figure 6, the thin client UE55 of server 30 is equipped with an AI (server AI) that has a judgment model created in advance through machine learning, and may use the server AI to detect or predict the non-use, or to predict the resumption of use.

[0073] As described above, according to the embodiments of this disclosure, it is possible to improve the efficiency of screen image transfer (network transfer) when distributing video from an information processing device (e.g., a server device or an MEC device) 30 to a user's terminal device (actual UE) 50.

[0074] Furthermore, according to the embodiments of this disclosure, it is possible to detect when a user is not using the thin client UE function of this system (non-use state) and to significantly reduce the amount of communication (traffic) flowing through the network.

[0075] Furthermore, according to the embodiments of this disclosure, it is possible to detect signs that a user is about to use the thin client function of the system again and to prepare in advance so that it can be used immediately.

[0076] In other words, according to the embodiments of this disclosure, it is possible to detect when a user is not using the thin client UE function of the system (non-use state), thereby significantly reducing network traffic, while also detecting signs of the thin client UE function being ready for reuse and making it immediately available.

[0077] Furthermore, according to the embodiments of this disclosure, when video distributed from the thin client UE55 of the server 30 to the actual UE50 is used intermittently, delays (lag) associated with session disconnection and reconstruction can be avoided, ensuring convenience during intermittent use, and achieving both network bandwidth efficiency and user-perceived quality.

[0078] Furthermore, the system disclosed herein can reduce the amount of data on the display screen that is transferred from the information processing device (MEC, server) to the terminal device (UE) via the mobile communication base station, and thus can contribute to achieving Sustainable Development Goal (SDG) 9, "Build resilient infrastructure, promote inclusive and sustainable industrialization and foster innovation."

[0079] In this specification, AI refers to artificial intelligence (including AGI or ASI) that generates content such as text, images, audio, and video using deep learning technologies such as transformers, self-attention, and autoregressive networks, including generative AI, language models (LLM / SLM), GPT®, Gemini®, Claude®, Llama®, and other language models. Extension technologies for generative AI include frameworks such as Search Augmentation Generation (RAG), Memory Augmentation Generation, hybrid search using vector databases, chunking / chunk processing, knowledge graph linking, entity linking, AutoGen, AOG, and LangChain. Performance improvement technologies for generative AI include fine tuning using RLHF / RLAIF, PEFT, LoRA, etc., distillation, quantization, weight sharing, continuous learning, associative learning, and in-context learning. Furthermore, the generating AI can operate in any environment, including on-premise, cloud, and edge (on-device), and parallel and distributed learning and inference using GPUs, TPUs, NPUs, IPUs, ASICs, and FPGAs are also possible.

[0080] Furthermore, the processing steps and the components of the receiving unit, transmitting unit, functional unit, sensor monitoring unit, processing unit, analysis unit, control unit, inference unit, AI, information processing device (MEC, server), node device, base station, terminal device, and system described herein can be implemented by various means. For example, these steps and components may be implemented in hardware, firmware, software, or a combination thereof.

[0081] With respect to hardware implementation, means such as processing units used to realize the above processes and components in a physical entity (e.g., various wireless communication devices, Node B, terminals, hard disk drive devices, or optical disc drive devices) may be implemented in one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), processors, controllers, microcontrollers, microprocessors, electronic devices, other electronic units designed to perform the functions described herein, computers, or combinations thereof.

[0082] Furthermore, with respect to the firmware and / or software implementation, means such as processing units used to realize the above-mentioned components may be implemented in the form of a program (e.g., code such as procedures, functions, modules, instructions, etc.) that performs the functions described herein. Generally, any computer / processor-readable medium that clearly embodies the firmware and / or software code may be used to implement means such as processing units used to realize the above-mentioned processes and components as described herein. For example, the firmware and / or software code may be stored in memory in a control device, for example, and executed by a computer or processor. That memory may be implemented inside the computer or processor, or it may be implemented outside the processor. Also, the firmware and / or software code may be stored in a computer or processor-readable medium such as random access memory (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), programmable read-only memory (PROM), electrically erasable PROM (EEPROM), flash memory, floppy disks, compact disks (CDs), digital versatile disks (DVDs), magnetic or optical data storage devices, etc. The code may be executed by one or more computers or processors, and the computers or processors may be made to perform functional embodiments as described herein.

[0083] Furthermore, the medium may be a non-temporary recording medium. Also, the program code may be readable and executable by a computer, processor, or other device or machine, and its format is not limited to a specific format. For example, the program code may be source code, object code, or binary code, or it may be a mixture of two or more of these codes.

[0084] Furthermore, the descriptions of embodiments disclosed herein are provided to enable those skilled in the art to manufacture or use the disclosure. Various modifications to the disclosure will be readily apparent to those skilled in the art, and the general principles defined herein are applicable to other variations without departing from the spirit or scope of the disclosure. Therefore, the disclosure is not limited to the examples and designs described herein, but should be accepted in the broadest sense that conforms to the principles and novel features disclosed herein. [Explanation of symbols]

[0085] 30: Information Processing Equipment (MEC, Server) 50: Terminal device (actual UE) 55: Thin Client UE 510: Client application execution unit 512: Video receiving unit 514: Sensor Monitoring Unit 520: Touchscreen 550: Thin Client UEOS 552: Video Control Unit 553: Video transmission unit

Claims

1. A system comprising an information processing device and a terminal device that can communicate with each other via a mobile communication base station, The terminal device transmits terminal status information relating to the state of the terminal device to the information processing device. The aforementioned information processing device is Based on the terminal status information received from the terminal device, the system detects or predicts that the video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device is not being used. Based on the detection or prediction of non-use, the distribution of the video consisting of the multiple frame images to the terminal device is reduced or stopped. The aforementioned information processing device is Based on the terminal status information received from the terminal device, the system predicts the resumption of use of video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device. Based on the prediction of the resumption of use, preparations will be made in advance for the distribution of the video to the terminal device, and the distribution of the video to the terminal device will be immediately resumed. system.

2. A system comprising an information processing device and a terminal device that can communicate with each other via a mobile communication base station, The terminal device transmits terminal status information relating to the state of the terminal device to the information processing device. The aforementioned information processing device is Based on the terminal status information received from the terminal device, the system detects or predicts that the video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device is not being used. Based on the detection or prediction of non-use, the distribution of the video consisting of the multiple frame images to the terminal device is reduced or stopped. The terminal status information includes at least one piece of information: information indicating whether the display screen is lit or turned off, information indicating angular velocity or acceleration indicating a change in the orientation of the terminal device, and information regarding the ambient illuminance around the terminal device. system.

3. A system comprising an information processing device and a terminal device that can communicate with each other via a mobile communication base station, The terminal device transmits terminal status information relating to the state of the terminal device to the information processing device. The aforementioned information processing device is Based on the terminal status information received from the terminal device, the system detects or predicts that the video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device is not being used. Based on the detection or prediction of non-use, the distribution of the video consisting of the multiple frame images to the terminal device is reduced or stopped. When the terminal device is in the unused state, the information processing device extends the transmission interval of the video frame image data to the upper limit of a predetermined range and transmits only keyframes or only still images to the terminal device. system.

4. A system comprising an information processing device and a terminal device that can communicate with each other via a mobile communication base station, The terminal device transmits terminal status information relating to the state of the terminal device to the information processing device. The aforementioned information processing device is Based on the terminal status information received from the terminal device, the system detects or predicts that the video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device is not being used. Based on the detection or prediction of non-use, the distribution of the video consisting of the multiple frame images to the terminal device is reduced or stopped. If the display screen of the terminal device is turned off or the video is not displayed and the terminal device remains stationary for a predetermined period of time, the information processing device stops distributing the video to the terminal device and continues to transmit control signals to the terminal device. system.

5. A system comprising an information processing device and a terminal device that can communicate with each other via a mobile communication base station, The terminal device transmits terminal status information relating to the state of the terminal device to the information processing device. The aforementioned information processing device is Based on the terminal status information received from the terminal device, the system detects or predicts that the video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device is not being used. Based on the detection or prediction of non-use, the distribution of the video consisting of the multiple frame images to the terminal device is reduced or stopped. When the information processing device detects a change in the orientation of the terminal device or an indication of the display screen lighting up, it warms up the decoder and encoder for generating the frame image data of the video and pre-fills the transmission buffer with the frame image data of the video. system.

6. In any system of Claim 1 to 5, The terminal device generates terminal status information based on the output of one or more sensors provided on the terminal device. system.

7. In any system of Claims 1 to 5, The aforementioned information processing device is A video transmission unit that transmits the video to the terminal device, A video control unit controls the output rate of the video transmission unit based on the terminal status information, A system that includes these features.

8. In any of the systems described in claims 1 to 5, When the aforementioned non-use is detected or predicted, the session for video distribution between the information processing device and the terminal device is not disconnected, and the session is maintained in a low-load state. system.

9. In any of the systems described in claims 1 to 5, The aforementioned information processing device uses AI having a judgment model created in advance through machine learning to detect or predict the non-use. system.

10. In any of the systems described in claims 1 to 5, The aforementioned information processing device is A receiving unit that receives terminal status information relating to the status of the terminal device from the terminal device via a mobile communication base station, A virtual terminal function unit that, on behalf of the terminal device, performs the process of drawing multiple frame images of the video to be displayed on the display screen of the terminal device to generate multiple frame image data, The system includes a transmitting unit that transmits a plurality of frame image data of the video to the terminal device via the base station, system.

11. In any of the systems described in claims 1 to 5, The aforementioned information processing device is a MEC device located closer to a base station than the core network of a mobile communication network, a MEC device mounted on the base station, a MEC device having the functions of the base station, a device or system that provides private cloud services within the core network of a mobile communication network, or a device or system that provides public cloud services in a connection network located outside the core network of a mobile communication network. system.

12. An information processing device capable of communicating with a terminal device via a mobile communication base station, A receiving unit that receives terminal status information relating to the status of the terminal device from the terminal device via a mobile communication base station, A non-use determination unit detects or predicts non-use of video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device, based on the terminal status information received from the terminal device, The system includes a distribution control unit that, based on the detection or prediction of non-use, reduces or stops the distribution of video consisting of multiple frame images to the terminal device, The non-use determination unit predicts the resumption of use of video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device, based on the terminal status information received from the terminal device. Based on the prediction of the resumption of use, the distribution control unit prepares in advance for the distribution of the video to the terminal device and immediately resumes the distribution of the video to the terminal device. Information processing device.

13. An information processing device capable of communicating with a terminal device via a mobile communication base station, A receiving unit that receives terminal status information relating to the status of the terminal device from the terminal device via a mobile communication base station, A non-use determination unit detects or predicts non-use of video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device, based on the terminal status information received from the terminal device, The system includes a distribution control unit that, based on the detection or prediction of non-use, reduces or stops the distribution of video consisting of multiple frame images to the terminal device, The terminal status information includes at least one piece of information: information indicating whether the display screen is lit or turned off, information indicating angular velocity or acceleration indicating a change in the orientation of the terminal device, and information regarding the ambient illuminance around the terminal device. Information processing device.

14. An information processing device capable of communicating with a terminal device via a mobile communication base station, A receiving unit that receives terminal status information relating to the status of the terminal device from the terminal device via a mobile communication base station, A non-use determination unit detects or predicts non-use of video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device, based on the terminal status information received from the terminal device, The system includes a distribution control unit that, based on the detection or prediction of non-use, reduces or stops the distribution of video consisting of multiple frame images to the terminal device, The distribution control unit, in the unused state of the terminal device, extends the transmission interval of the video frame image data to the upper limit of a predetermined range and transmits only keyframes or only still images to the terminal device. Information processing device.

15. An information processing device capable of communicating with a terminal device via a mobile communication base station, A receiving unit that receives terminal status information relating to the status of the terminal device from the terminal device via a mobile communication base station, A non-use determination unit detects or predicts non-use of video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device, based on the terminal status information received from the terminal device, The system includes a distribution control unit that, based on the detection or prediction of non-use, reduces or stops the distribution of video consisting of multiple frame images to the terminal device, If the display screen of the terminal device turns off or the video is not displayed and the terminal device remains stationary for a predetermined period of time, the distribution control unit stops distributing the video to the terminal device and continues to transmit control signals to the terminal device. Information processing device.

16. An information processing device capable of communicating with a terminal device via a mobile communication base station, A receiving unit that receives terminal status information relating to the status of the terminal device from the terminal device via a mobile communication base station, A non-use determination unit detects or predicts non-use of video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device, based on the terminal status information received from the terminal device, The system includes a distribution control unit that, based on the detection or prediction of non-use, reduces or stops the distribution of video consisting of multiple frame images to the terminal device, When the distribution control unit detects a change in the orientation of the terminal device or an indication of the display screen lighting up, it warms up the decoder and encoder for generating the frame image data of the video and pre-fills the transmission buffer with the frame image data of the video. Information processing device.

17. A method for controlling the transfer of display images in a system comprising information processing devices and terminal devices that can communicate with each other via a mobile communication base station, The terminal device transmits terminal status information relating to the state of the terminal device to the information processing device. The information processing device detects or predicts, based on the terminal status information received from the terminal device, that video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device is not being used. The information processing device reduces or stops the distribution of the video consisting of the multiple frame images to the terminal device based on the detection or prediction of non-use. The information processing device predicts the resumption of use of a video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device, based on the terminal status information received from the terminal device. The information processing device, based on the prediction of the resumption of use, prepares in advance for the distribution of the video to the terminal device and immediately resumes the distribution of the video to the terminal device. Methods that include...

18. A method for controlling the transfer of a display image in a system comprising an information processing device and a terminal device that can communicate with each other via a mobile communication base station, The terminal device transmits terminal status information relating to the state of the terminal device to the information processing device. The information processing device detects or predicts, based on the terminal status information received from the terminal device, that video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device is not being used. The information processing device includes, based on the detection or prediction of non-use, reducing or stopping the distribution of the video consisting of the plurality of frame images to the terminal device, The terminal status information includes at least one piece of information: information indicating whether the display screen is lit or turned off, information indicating angular velocity or acceleration indicating a change in the orientation of the terminal device, and information regarding the ambient illuminance around the terminal device. method.

19. A method for controlling the transfer of a display image in a system comprising an information processing device and a terminal device that can communicate with each other via a mobile communication base station, The terminal device transmits terminal status information relating to the state of the terminal device to the information processing device. The information processing device detects or predicts, based on the terminal status information received from the terminal device, that video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device is not being used. The information processing device reduces or stops the distribution of the video consisting of the multiple frame images to the terminal device based on the detection or prediction of non-use. The information processing device, when the terminal device is in the unused state, extends the transmission interval of the video frame image data to the upper limit of a predetermined range and transmits only keyframes or only still images to the terminal device. Methods that include...

20. A method for controlling the transfer of a display image in a system comprising an information processing device and a terminal device that can communicate with each other via a mobile communication base station, The terminal device transmits terminal status information relating to the state of the terminal device to the information processing device. The information processing device detects or predicts, based on the terminal status information received from the terminal device, that video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device is not being used. The information processing device reduces or stops the distribution of the video consisting of the multiple frame images to the terminal device based on the detection or prediction of non-use. If the information processing device detects that the display screen of the terminal device is turned off or the image is not displayed and the terminal device remains stationary for a predetermined period of time, it will stop distributing the image to the terminal device and will continue to transmit control signals to the terminal device. Methods that include...

21. A method for controlling the transfer of a display image in a system comprising an information processing device and a terminal device that can communicate with each other via a mobile communication base station, The terminal device transmits terminal status information relating to the state of the terminal device to the information processing device. The information processing device detects or predicts, based on the terminal status information received from the terminal device, that video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device is not being used. The information processing device reduces or stops the distribution of the video consisting of the multiple frame images to the terminal device based on the detection or prediction of non-use. When the information processing device detects a change in the orientation of the terminal device or an indication of the display screen lighting up, it warms up the decoder and encoder for generating the frame image data of the video and pre-fills the transmission buffer with the frame image data of the video. Methods that include...

22. A program that runs on a computer or processor installed in an information processing device capable of communicating with terminal equipment via a mobile communication base station, A program code for detecting or predicting non-use of video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device, based on terminal status information received from the terminal device, A program code for reducing or stopping the distribution of video consisting of multiple frame images to the terminal device based on the detection or prediction of non-use, A program code for predicting the resumption of use of video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device, based on the terminal status information received from the terminal device, Based on the prediction of the resumption of use, a program code is provided to prepare in advance for the distribution of the video to the terminal device and to immediately resume the distribution of the video to the terminal device. A program that includes this.

23. A program to be executed in a computer or processor provided in an information processing device that can communicate with a terminal device via a mobile communication base station, A program code for detecting or predicting non-use of video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device, based on terminal status information received from the terminal device, The program code includes, based on the detection or prediction of non-use, a program code for reducing or stopping the distribution of video consisting of multiple frame images to the terminal device, The terminal status information includes at least one piece of information: information indicating whether the display screen is lit or turned off, information indicating angular velocity or acceleration indicating a change in the orientation of the terminal device, and information regarding the ambient illuminance around the terminal device. program.

24. A program to be executed in a computer or processor provided in an information processing device that can communicate with a terminal device via a mobile communication base station, A program code for detecting or predicting non-use of video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device, based on terminal status information received from the terminal device, A program code for reducing or stopping the distribution of video consisting of multiple frame images to the terminal device based on the detection or prediction of non-use, In the unused state of the terminal device, program code for extending the transmission interval of the video frame image data up to the upper limit of a predetermined range, and transmitting only keyframes or only still images to the terminal device, A program that includes this.

25. A program to be executed in a computer or processor provided in an information processing device that can communicate with a terminal device via a mobile communication base station, A program code for detecting or predicting non-use of video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device, based on terminal status information received from the terminal device, A program code for reducing or stopping the distribution of video consisting of multiple frame images to the terminal device based on the detection or prediction of non-use, If the display screen of the terminal device turns off or the video is not displayed and the terminal device remains stationary for a predetermined period of time, program code for stopping the distribution of the video to the terminal device and maintaining only the transmission of control signals to the terminal device, A program that includes this.

26. A program to be executed in a computer or processor provided in an information processing device capable of communicating with a terminal device via a mobile communication base station, A program code for detecting or predicting non-use of video consisting of multiple frame images distributed from the information processing device and output to the display screen of the terminal device, based on terminal status information received from the terminal device, A program code for reducing or stopping the distribution of video consisting of multiple frame images to the terminal device based on the detection or prediction of non-use, When a change in the orientation of the terminal device or an indication of the display screen lighting up is detected, program code is provided for warming up the decoder and encoder for generating the frame image data of the video and for pre-filling the transmission buffer with the frame image data of the video. A program that includes this.

Images