Mobile cloud computing endpoint and operating procedures for it
The mobile cloud computing terminal optimizes hardware resource use by integrating cloud computing services for efficient resource allocation and synchronization, addressing inefficiencies in existing technologies and reducing the need for frequent device replacements.
Patent Information
- Application Number
- DE112018000226
- Authority / Receiving Office
- DE · DE
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2017-01-11
- Filing Date
- 2018-01-10
- Publication Date
- 2024-11-14
- Estimated Expiration
- 2038-01-10
AI Technical Summary
Current mobile cloud computing technologies face limitations in GUI display and synchronization, resource planning, and media redirection, leading to inefficient use of hardware resources and frequent device replacements, which are costly and environmentally harmful.
A mobile cloud computing terminal with a base system architecture, cloud computing service layer, and transmission management module that manages and prioritizes communication channels for efficient resource allocation and synchronization, allowing users to access cloud computing resources for enhanced functionality without frequent hardware upgrades.
The solution extends the hardware replacement cycle, supports multiple operating systems, and optimizes resource usage, providing a seamless user experience with real-time synchronization and reduced environmental impact.
Smart Images

Figure 00000000_0000_ABST
Abstract
Description
RELATED REGISTRATION
[0001] The present application claims priority over Chinese patent application No. 201710021223.X, filed on January 11, 2017, entitled “Mobile cloud computing terminal and operating method therefor”. TECHNICAL AREA
[0002] The present invention belongs to the field of cloud computing and mobile communications and relates in particular to a mobile cloud computing terminal and an operating method for it. STATE OF THE ART
[0003] Smart mobile devices such as smartphones, tablets, and laptops are network devices that people use every day. Currently, smart mobile devices have a short update cycle, with consumers typically replacing their device with a newer version every year. However, these upgrades usually focus on performance parameters such as CPU processing power, memory size, and storage capacity, while other hardware components (e.g., screens and network adapters) are updated less frequently. This overly frequent replacement of electronic products puts economic pressure on consumers and negatively impacts energy conservation and environmental protection.Furthermore, some users who aim for "adequate usage" often find that their smart devices have excessive power consumption, leading to waste.
[0004] On the other hand, with the development of mobile communication technology, the fifth generation of mobile communication technology (5G) is on the verge of commercialization, which will allow smart mobile devices to enjoy a faster and more convenient network connectivity environment. In the 5G era, there will be 50 billion connected Internet of Everything services worldwide, with ever-increasing demands on the computing power and service quality of smart devices. Mobile cloud computing will become one of the key technologies for innovative 5G network services. Mobile cloud computing represents a new way of delivering and using IT resources or information services. It is the product of introducing cloud computing to the mobile internet.
[0005] In current mobile cloud technologies, cloud servers are typically used to provide cloud services to mobile devices, enabling the devices to log in and synchronize data and events. For example, patent document CN102377739A discloses a mobile device that only performs basic functions such as displaying video, playing audio, and transmitting user input to the cloud server, while other functions are provided by a cloud server. This reduces dependence on the mobile device's hardware performance, lowers the cost of the mobile device, and facilitates the expansion and upgrade of mobile device capabilities.However, the implementation described in patent document CN102377739A is limited to cloud-synchronous transmission and decoding of audio and video and the associated event operations. Its scope is limited, and it cannot address issues such as GUI display and synchronization of the mobile device, cloud computing resource planning, and acceleration of media redirection. Patent document CN103345406A discloses that the cloud server provides a virtual machine to run the Android system and simulate the virtual mobile device. The physical mobile device is then accessed in a manner similar to remote support.However, in the embodiment of patent document CN103345406A, the physical mobile device still requires a specific configuration to run the app for accessing the virtual cloud machine. This also necessitates the operation of a complex framework of the same Android system and uses direct remote control to transmit the screen to the desktop of the remote system. This results in enormous and slow data traffic, and the screen is easily paused. Publication US 2016 / 0283057 A1 discloses a computer device for event planning.
[0006] Furthermore, the market for smart mobile devices has a demand for enterprise applications and security and confidentiality services. There are also users who need to use a variety of operating systems or custom systems. For example, a user on a business trip might use a Windows system and a mobile phone with an Android system. Being able to use multiple operating systems on the same mobile device offers significant convenience. REVELATION OF THE INVENTION
[0007] The present invention provides a mobile cloud computing terminal, an operating method and a computer device for solving the above-mentioned problems.
[0008] On the one hand, the technical design of the present invention provides a mobile cloud computing terminal device comprising local hardware including a human-computer interaction device, local storage, a communication transmission unit and a microprocessor.The mobile cloud computing endpoint further comprises: a base system architecture for operating the local hardware to perform basic communication and application functions; a cloud computing service layer for interacting with a cloud system in a remote cloud computing server, wherein the cloud computing service layer is operated based on the base system architecture, the cloud system being a user-specific system operated based on cloud computing resources; and a transmission management module for managing and monitoring a transmission channel between a communication interface of the cloud computing service layer and the cloud computing server, wherein the transmission channel comprises a command channel, an application data channel, and a file data stream channel.The cloud computing service layer includes a multimedia processing unit (MPU) that decodes multimedia compressed data sent from the cloud computing server and displays it using local hardware. Depending on network conditions or remaining battery power, the data is displayed in one of the following ways: after pre-coding and rendering the video and audio files in the cloud system, the MPU receives and displays the images; or the MPU performs soft decoding or direct hard decoding of the multimedia compressed data by accessing local hardware resources.
[0009] Furthermore, the command channel transmits a command generated by a user when operating the human-computer interaction device and a command issued by the cloud computing server, wherein the application data channel transmits application operational data, which includes update data for GUI synchronization, wherein the file data stream channel is configured to transmit media stream file data or basic user files, wherein the command channel has a higher priority than the application data channel with respect to the allocation of network resources, and wherein the application data channel has a higher priority than the file data stream channel with respect to the allocation of network resources.
[0010] Furthermore, the transmission management module includes one or more buffer zones designed to buffer real-time data in the transmission channel during real-time interaction between the communication interface of the cloud computing service layer and the cloud computing server.
[0011] Preferably, the buffer zone assigned to the command channel has a higher speed priority than the other channels, while the buffer zone assigned to the file data stream channel has a larger volume than the other channels. The communication protocol used by the transmission management module includes TCP, HTTP, UDP, or WebSocket.
[0012] Furthermore, the cloud computing service layer includes a GUI management unit which, depending on an activated GUI connection of the cloud system, generates a corresponding local GUI interface in the display of the human-computer interaction device via an application data channel and docks the command channel in real time, thereby enabling real-time synchronization between a local GUI interface and a cloud GUI interface.
[0013] Furthermore, the mobile cloud computing endpoint also includes a resource allocation module that is designed to dispose of and allocate local hardware and software resources and / or cloud hardware and software resources to the cloud computing service layer.
[0014] Preferably, the resource allocation module adjusts the allocation amount of software and hardware resources based on the request quantity and priority of the cloud computing service layer and the transmission management module, as well as the network throughput of the communication transmission unit. The resource allocation module comprises: an internal storage integration unit configured to integrate internal storage resources of other cloud computing endpoints via the cloud computing server; and a storage integration unit configured to integrate storage resources of other cloud computing endpoints via the cloud computing server.
[0015] Furthermore, the base system architecture includes a local application service layer configured to provide a basic operating environment for the local application. This local application service layer is synchronized with an application service layer of the cloud system on the cloud computing server. The base system architecture includes an Android architecture, a Windows architecture, and a Unix architecture. The communication transmission unit includes a mobile communication module, which may support one or more of the 2G, 3G, 4G, and / or 5G network communication modes. The communication transmission unit may also include a Wi-Fi communication module, a Bluetooth communication module, and / or a near-field communication module.
[0016] Furthermore, the local hardware also includes a dedicated hard decoder for multimedia processing.
[0017] According to another aspect of the present invention, an operating method for a mobile cloud computing terminal is provided, the operating method comprising the following steps: A. Checking a user request and accessing a cloud computing server; B. Receiving user-specific GUI data and application data based on cloud computing resources, generating a local GUI interface, and assigning a corresponding local application service; C. Capturing user actions received from the local hardware and collecting status parameters of the mobile cloud computing terminal, converting the status parameters into user commands and application operating data, and then sending the user commands and application operating data to the cloud computing server; D.Receiving GUI and application data from the cloud system, updating the local GUI interface, and synchronizing the corresponding local application service; E. Determining whether the user issues a termination command, and if so, terminating the cloud computing service, and if not, returning to step C. In step D, updating the local GUI interface includes: decoding multimedia compressed data sent from the cloud computing server (2) and rendering it by the local hardware; and, after pre-coding and rendering the video and audio files in the cloud system, receiving an image from the multimedia compressed data and displaying the image on the interface depending on network conditions or remaining battery power in the local hardware.
[0018] Preferably, the operating procedure further comprises: managing and monitoring a command channel, an application data channel, and a file data stream channel located between a communication interface of the mobile cloud computing end device and the cloud computing server to enable real-time communication; scheduling and allocating local hardware and software resources and / or cloud hardware and software resources to optimize the local operation of the cloud computing service.
[0019] According to a third aspect of the present invention, a computing device is provided comprising a memory and a processor, wherein the processor executes a program instruction stored in memory to carry out the steps of the operating procedure.
[0020] The advantageous effects of the present invention are that a cloud computing terminal is proposed which fills the technical gap in the field, that the replacement cycle of hardware of the mobile terminal is extended to satisfy the user's needs to use a user-specific system and different systems in the same terminal, and that resource allocation and planning between the mobile cloud computing terminal and the server is provided and unused resources are activated to realize integration and sharing. BRIEF DESCRIPTION OF THE DRAWINGS Fig. Figure 1 shows a schematic view of an application of a mobile cloud computing terminal according to the invention; Fig. Figure 2 shows a block diagram of a mobile cloud computing terminal device according to the invention and a schematic block diagram of a cloud computing server; Fig. Figure 3 shows an operational flow diagram of a mobile cloud computing terminal device according to the invention and an interacting operational flow diagram of a cloud computing server; Fig. Figure 4 shows a flowchart of the transmission management in the operating process of a mobile cloud computing terminal according to the invention; and Fig. Figure 5 shows a flowchart for the processing of multimedia redirection in the operating process of a mobile cloud computing terminal device according to the invention. DETAILED EXAMPLES OF EXECUTION
[0021] Fig. Figure 1 shows a schematic view of an application of a mobile cloud computing device according to the invention, illustrating that a mobile cloud computing device 1 and a cloud computing server 2 are networked via a communication device 3, and the networking method used can be a wired connection, a wireless connection, or any combination thereof. In particular, the mobile cloud computing device 1 and the cloud computing server 2 can be connected using a mobile communication link (for example, 2G, 3G, 4G, or 5G communication mode), a wide area network, or Ethernet. It is understood that multiple mobile cloud computing devices 1, cloud computing servers 2, and communication devices 3 can be present.The cloud computing server 2 comprises a multiprocessor system, a small computer, a large computer, a distributed computing system, a cluster computing system, and the like. The communication device 3 comprises a network adapter, a network switch, a router, a modem, a fiber optic / twisted-pair line, a wireless access point, an antenna, a mobile communication base station, and the like.
[0022] Referring to Fig. 2. The cloud computing server 2 can include a cloud cluster architecture 21, a network manager 22, a processor 23, a dispatcher 24, a storage device 25, and the like. The cloud cluster architecture 21 integrates the cloud terminal resources to provide an operating environment for the multitude of cloud systems. Within each group of cloud systems, the operation of the multiple cloud systems is simulated sequentially. The cloud system, with the network manager 22, processes the communication of the corresponding mobile cloud computing endpoint 1 to provide a cloud computing service. Depending on the current operation of the cloud computing server, the processor 23 can instruct the dispatcher 24 to allocate resources from various cloud computing endpoints in the cloud cluster network or from mobile cloud computing endpoints.In one example, if the storage capacity of cloud computing server 2 is low, processor 23 can analyze the NAS (Network Attached Storage) resources connected to cloud computing server 2 in the cloud cluster network. Dispatcher 24 then addresses the available storage content of the NAS to storage 25 for internal use by cloud computing server 2 or for use by one or more cloud computing mobile devices 1. In another example, if the storage capacity of cloud computing server 2 is low, processor 23 can analyze the inactive storage resources of the mobile cloud computing device 1 connected to cloud computing server 2. Dispatcher 24 then integrates the available inactive storage resources of the mobile cloud computing device 1 into a storage pool of cloud computing server 2.
[0023] In one embodiment according to the present invention, the mobile cloud computing device 1 runs an operating system that can be switched between a basic mode and a cloud computing mode. In the basic mode of the operating system, only basic communication functions (such as making calls, sending and receiving text messages, FM radio) and applications (APPs) (e.g., notepad, calculator, offline map) can be executed on the mobile cloud computing device 1. In its cloud computing mode, the mobile cloud computing device 1 can interact with the cloud system running on the cloud computing server 2 via a network, for example, a high-speed 5G network, load extensive hardware resources of the cloud system, and access the APP running on the cloud system.After the user activates the interaction device 150 to complete the login verification, the mobile cloud computing endpoint 1 is connected to a corresponding cloud system simulated on the cloud computing server 2. This switches the user interface (UI) of the mobile endpoint 1 from the call input page 10 to the app function page 10', thereby synchronizing the UI of the mobile cloud computing endpoint 1 with a pseudo-generated interface 10" of the cloud system. It should be noted that the simulated cloud system does not necessarily have to display the UI graphics, which is why... Fig. 1 the pseudo-generated interface 10" of the cloud system serves only as a schematic description.
[0024] The structure and operation of the mobile cloud computing terminal 1 according to the invention are described in more detail below in various embodiments.
[0025] Reference is made to the block diagram of the in Fig. The mobile cloud computing terminal 1 shown in Figure 2 is taken. The local hardware of the mobile cloud computing terminal 1 comprises a human-computer interaction device 150, a microprocessor 153, a decoder 154, a memory 155, and a communication transmission unit 156. Preferably, the human-computer interaction device 150 may include a touchscreen 151 and a fingerprint device 152.
[0026] In some embodiments, the human-computer interaction device 150 may remotely include one or more input devices, such as a keyboard, mouse, pen, speech input device, touch input device, infrared camera, video input device, etc., and one or more output devices, such as one or more displays, speakers, projectors, vibration feedback devices, and the like.
[0027] The input device and the output device can be connected to the mobile cloud computing terminal 1 via a wired connection, a wireless connection, or any combination thereof. In one embodiment, an input or output device from another mobile terminal can be used as the input or output device of the current mobile terminal.
[0028] Decoder 154 is used to decode the digital video and audio data stream into an analog video and audio signal. Preferably, decoder 154 can be a dedicated hardware decoding chip or a decoding unit integrated into microprocessor 153. The mobile cloud computing terminal 1 can further include an encoder for compressing the analog video and audio signals into data-encoded files.
[0029] The storage devices 155, 25 in the mobile cloud computing endpoint 1 and the cloud computing server 2 generally use computer storage media. Computer storage media include volatile and non-volatile, removable and non-removable media, which are applied to any method or technology to store information such as computer-readable instructions or other data. Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory, and other storage technologies, CD-ROM, digital video disc (DVD), and other optical storage devices, or any other medium capable of storing the required information and accessible by a suitable device.The transmission medium contained herein typically stores computer-readable commands or other data in the form of "modulated data signals", such as carrier waves or other transmission methods, and includes any means of transmitting information.
[0030] The communication transmission unit 156 of the mobile cloud computing terminal 1 comprises a mobile communication module, wherein the mobile communication module includes one or more of the 2G, 3G, 4G, and 5G network communication modes. The communication transmission unit 156 further comprises a Wi-Fi communication module, a Bluetooth communication module, and / or a near-field communication module. In other embodiments, the communication transmission unit 156 may include one or more communication connection elements that enable communication between the mobile terminal and other devices. The communication connection elements may also include, but are not limited to, a modem, a radio frequency transmitter / receiver, an infrared connector, a USB connector, or another connector.
[0031] Based on the hardware resources, the mobile cloud computing endpoint 1 further comprises a basic operating system architecture 12, a cloud computing service layer 11, and a transmission management module 13. In the present embodiment, the cloud computing service layer 11, which is operated on the basis of the basic system architecture 12, interacts with the cloud system associated with the remote cloud computing server 2 via the transmission management module 13, as described below.
[0032] The basic system architecture 12 serves to operate the local hardware to perform basic communication and application functions. Specifically, the basic system architecture 12 comprises a core layer, a system core library, and an application layer. The core layer provides core system services such as security functions, memory management, process management, hardware drivers, etc. The system core library provides the functions of a systematic function library adapted for the hardware of the mobile cloud computing endpoint 1 and also includes some core application programming interfaces (APIs). The application layer contains several applications, such as SMS client programs, telephone dialer programs, image browsers, web browsers, etc. In a preferred embodiment, the system architecture can be based on the architecture of a basic embedded system (e.g., Linux, Unix, WinCE, etc.).) developed and modified directly based on the architecture of an open-source mobile embedded system (such as Android).
[0033] The transmission management module 13 is used to manage and monitor a transmission channel between a communication interface of the cloud computing service layer and the cloud computing server, where the transmission channel includes a command channel, an application data channel, and a file data stream channel.The command channel transmits a command generated by a user when operating the human-computer interaction device and a command issued by the cloud computing server. The application data channel transmits application operational data, including update data for GUI synchronization. The file data stream channel is configured to transmit media stream file data or basic user files. The command channel has a higher priority than the application data channel with respect to network resource allocation. The transmission management module can also provide means for encrypting the communication based on encryption protocols such as SSL, TLS, and the like.The Transport Management Module 13 further includes one or more buffer zones configured to buffer real-time data in the transport channel during real-time interaction between the cloud computing service layer's communication interface and the cloud computing server. The buffer zone associated with the command channel has a higher speed priority than the other channels, while the buffer zone associated with the file data stream channel has a larger volume than the other channels. The communication protocol used by the Transport Management Module includes TCP, HTTP, UDP, or WebSocket.
[0034] Cloud computing service layer 11 executes a set of supporting components of the cloud computing function, which include a security audit unit, a GUI management unit, a multimedia processing unit, a cloud synchronous monitoring unit, and a background management unit.
[0035] The security verification unit can be used to verify the user identity of the mobile cloud computing terminal, for example by verifying the account and password entered by the user via the touchscreen 151 or the fingerprints entered by the user via the fingerprint device 152, in order to log in to the operating system of the mobile cloud computing terminal 1 and / or to access the user account on the cloud computing server 2.
[0036] The GUI management unit can be used to generate a standard interface, such as the APP function page 10, and then display the corresponding local GUI interface on the screen of the human-computer interaction device 150. The GUI management unit is further used to dock the command channels of the local server and the cloud computing server in real time, thus enabling real-time synchronization of the local device and the cloud system-side GUI interface. Preferably, the GUI management unit displays a corresponding local GUI interface on the human-computer interaction device's display via the application data channel, depending on the enabled GUI port of the cloud system. The command channel is docked in real time, a local GUI interface is generated first, and then the local GUI interface is synchronized with a cloud GUI interface.For example, as soon as the user activates the touchscreen 151 to click on the social app icon in the app's function page 10, the GUI management unit immediately uses the cached data from the social app (e.g., data from the friends page) to locally pre-generate a target interface to display the chat friend and a cached online status identifier of friends. Since the user's click command was transmitted to the cloud computing server 2 via the command channel, the corresponding cloud system is triggered to analyze the click action. Cloud computing server 2 then sends the updated GUI data back to the pre-generated GUI management unit, with minor updates and synchronization (e.g., updating the chat friend's online status identifier) occurring on the pre-generated target interface.Such a GUI update is faster and more efficient than the conventional remote support-based interface transfer (see patent document CN103345406A) and also significantly improves the smoothness of the interface and the user's real-time operating experience.
[0037] A multimedia processing unit (MPU) is designed to decode and display multimedia compressed data sent from the cloud computing server using local hardware. Specifically, the MPU has two methods for displaying the media: 1) server-side rendering, where, after pre-coding, decoding, and rendering the video and audio files in the cloud system, the MPU receives the images for display; and 2) multimedia redirection, also known as on-device rendering, where the video and audio files are split and repackaged, and the MPU performs soft decoding and direct hard decoding of the multimedia compressed data by accessing local hardware resources.Preferably, the activation of the aforementioned multimedia redirection function is supported simultaneously on both a local mobile device and a cloud device. For example, video and audio recorded on the mobile cloud computing device can be encoded and compressed by the multimedia processing unit and then transmitted to the cloud system for redirected decoding and playback. The above options have their own advantages and disadvantages: In option 1), the powerful computing resources of the cloud computing server 2 can be used for decoding and rendering, while the transmitted image and audio data place high demands on the network.Option 2) allows for improvements in video parallelism density within the cloud system and even the entire cloud computing server. Utilizing the mobile device's display chip, this enhances image quality and video smoothness, saving bandwidth resources but also increasing the workload on the mobile cloud computing device. In a preferred embodiment, the multimedia processing unit can switch between the two options based on parameters such as network conditions, remaining battery power, and the like. For example, if the mobile cloud computing device is accessing a stable Wi-Fi network, Option 1 can be used; if the mobile cloud computing device is accessing the network and the remaining battery power is sufficient, Option 2 can be used.
[0038] Preferably, the mobile cloud computing endpoint 1 further comprises a resource allocation module 14 configured to allocate and assign local hardware and software resources and / or cloud hardware and software resources to the cloud computing service layer. Depending on the request quantity and priority of the cloud computing service layer and the transmission management module, as well as the network throughput of the communication transmission unit, the resource allocation module 14 determines the allocation amount of software and hardware resources.The resource allocation module comprises: an internal storage integration unit configured to integrate internal storage resources of other cloud computing endpoints via the Cloud Computing Server 2's Dispatcher 24; and a storage integration unit configured to integrate storage resources of other cloud computing endpoints via the Cloud Computing Server 2. The cloud computing endpoint can be a distributed remote extension of the Cloud Computing Server 2 or another mobile cloud computing endpoint that has accessed the Cloud Computing Server 2. In this way, each mobile cloud computing endpoint 1 can access idle resources (such as internal storage and memory resources) from remote extensions across the cloud platform network and integrate them as an extension of local resources into the local host, allowing the local host to utilize more externally integrated resources without requiring a hardware upgrade.
[0039] Fig. Figure 3 shows an operational flow diagram of the mobile cloud computing terminal 1 according to the invention. A synchronous, cooperating operational flow diagram of the cloud computing server 2 is also shown in Figure 3. Fig. 1 shown.
[0040] In one embodiment, the operating method of the mobile cloud computing terminal 1 according to the invention comprises the following steps: S101: Checking a user request, accessing a cloud computing server 2 and selecting a cloud system to use; S102: Receiving user-specific GUI data and application data powered by cloud computing resources, generating a local GUI interface, and mapping a corresponding local application service; S103: Capture user actions received from the local hardware and collect status parameters of the mobile cloud computing endpoint, convert the status parameters into user commands and application operational data, and then send the user commands and application operational data to the cloud computing server; S104: Receiving GUI data and application data from the cloud system, updating the local GUI interface, and synchronizing the corresponding local application service; S105, S106: Determine if the user issues a termination command, if so, terminate the cloud computing service and switch to the local base system interface, and if no, return to step S103.
[0041] Accordingly, the operating procedure of the Cloud Computing Server 2 comprises the following steps: S201: Pre-distributing cloud system resources to run the cloud system according to the service registered by the user, optionally pre-loading a cloud system to which the user last logged in or logs in by default; S202: Activate the cloud system currently selected by the user; S203: Sending user-specific GUI data and application data powered by cloud computing resources; S204: Executing an update of a corresponding program and function according to user commands and terminal parameters; S205: Updating data, packaging GUI and APP data files and sending them to the mobile cloud computing endpoint 1; S206, S207: Determine whether the user issues a termination command, if so saving and backing up the user data, and if not returning to step S203.
[0042] As in Fig. As shown in Figure 4, in a specific embodiment, a transfer management process is also executed in the mobile cloud computing terminal 1 during steps S102 to S104, wherein the following steps are performed: S301: Monitoring the command channel, application data channel, and file data stream channel located between a communication interface of the mobile cloud computing endpoint and the cloud computing server; S302: Provision when allocating network resources such that the command channel has a higher priority than the application data channel with respect to the allocation of network resources, and the application data channel has a higher priority than the file data stream channel with respect to the allocation of network resources. S303: Buffering real-time data in the transmission channel during a real-time interaction between the communication interface of the cloud computing service layer and the cloud computing server, and configuring the buffer zone assigned to the command channel to have a higher velocity priority than the other channels, and to have a larger buffer zone assigned to the file data stream channel than the other channels.
[0043] This allows the display of the human-computer interaction device to be driven via the application data channel, depending on the activated GUI connection of the cloud system, so that a corresponding local GUI interface is displayed on the screen, the command channel is docked in real time, a local GUI interface is generated with priority, and the local GUI interface is synchronized with a cloud GUI interface.
[0044] As in Fig.As shown in Figure 5, in a further specific embodiment, a multimedia redirection process is also carried out in parallel in the mobile cloud computing terminal 1 during steps S102 to S104, wherein the following steps are performed: S401: Disassembling or packaging the compressed video and audio files sent from Cloud Computing Server 2; S402: Calling local hardware resources to perform soft decoding or hard decoding of the multimedia compressed data. S403: Transferring the encoded and compressed video and audio recorded by the mobile cloud computing terminal 1 to the cloud system for redirected decoding and playback.
[0045] The foregoing describes only preferred embodiments of the present invention, and the present invention is not limited to these. As long as an embodiment achieves the technical effects of the present invention by the same means, it should fall within the scope of protection of the present invention. Various modifications and changes to the technical configurations and / or embodiments of the present invention may be made within the scope of the present invention. The person skilled in the art may understand that the technical improvements of the present invention include, but are not limited to: 1. The mobile device on which the base system is running can implement extensive user functions using the cloud computing service, while also integrating the resources of the cloud computing network. 2. As long as the user logs in to any mobile cloud computing device after authenticating their ID, they can access user data that is stored only on the cloud computing server. This applies to a wide variety of secure and confidential application scenarios. 3. The cloud computing endpoint has low hardware requirements and, instead of a powerful computing unit, internal storage or high-capacity storage, only requires a specific configuration of the network module and graphics processing hardware. 4. Resource optimization configuration and multi-transmission channel video redirection scheme are used to improve the user's real-time remote control response experience.
[0046] Although the principles of the present invention are described in detail above with reference to preferred embodiments, those skilled in the art should understand that the aforementioned embodiments merely illustrate schematic realizations of the present invention and do not limit its scope. The details in the embodiments are not intended to limit the scope of the present invention. All obvious modifications, such as equivalent transformations, simple substitutions, etc., based on the technical implementations of the present invention, are within the scope of the present invention without departing from its spirit and scope.
Claims
[1] Mobile cloud computing device (1), which comprises: a local hardware comprising a human-computer interaction device (150), a local memory (155), a communication transmission unit (156) and a microprocessor (153); a basic system architecture (12) for operating the local hardware to perform basic communication and application functions; a cloud computing service layer (11) for interacting with a cloud system in a remote cloud computing server (2), wherein the cloud computing service layer (11) is operated on the basis of the basic system architecture (12), wherein the cloud system is a user-specific system operating on the basis of cloud computing resources; and a transmission management module (13) for managing and monitoring a transmission channel between a communication interface of the cloud computing service layer (11) and the cloud computing server (2), the transmission channel comprising a command channel, an application data channel and a file data stream channel, wherein the cloud computing service layer (11) comprises a multimedia processing unit which decodes multimedia compressed data sent from the cloud computing server (2) and displays it through the local hardware, wherein, depending on network conditions or a remaining battery, the data is displayed in one of the following ways: after pre-coding and rendering the video and audio files in the cloud system, the multimedia processing unit receives and displays the images for display, or the multimedia processing unit performs soft decoding or direct hard decoding of the multimedia compressed data by calling the local hardware resources. [2] Mobile cloud computing terminal according to claim 1, wherein the command channel is used to transmit a command generated by a user when operating the human-computer interaction device (150) and a command issued by the cloud computing server (2); the application data channel is used to transmit application operational data that includes synchronously updated GUI data; and the file stream channel is used to transmit media stream file data or basic user files; wherein the command channel has a higher occupancy priority with respect to network resources than the application data channel, and wherein the application data channel has a higher occupancy priority with respect to network resources than the file stream channel. [3] The mobile cloud computing terminal according to claim 1, wherein the transmission management module (13) further comprises: one or more buffers for buffering real-time data in the transmission channel during a real-time interaction between the communication interface of the cloud computing service layer (11) and the cloud computing server (2). [4] Mobile cloud computing terminal according to claim 3, wherein the buffer zone assigned to the command channel has a higher speed priority than the buffer assigned to the other channels; and / or the buffer zone assigned to the file stream channel has a larger volume than the buffer assigned to the other channels. [5] The mobile cloud computing terminal according to claim 1, wherein the communication protocol used for the transmission management module (13) comprises TCP, HTTP, UDP or Web Socket. [6] The mobile cloud computing terminal according to claim 1, wherein the cloud computing service layer (11) comprises a GUI management unit that displays a corresponding local GUI interface on the display of the human-computer interaction device (150) via an application data channel depending on an activated GUI interface of the cloud system, and that is connected to the command channel in real time to generate a local GUI interface in priority, and then synchronizes the local GUI interface and a cloud GUI interface. [7] Mobile cloud computing terminal according to claim 1, further comprising a resource allocation module (14) configured to schedule and allocate local hardware and software resources and / or cloud hardware and software resources to the cloud computing service layer (11). [8] The mobile cloud computing terminal according to claim 7, wherein the resource allocation module (14) adjusts an allocation amount of the software and hardware resources depending on the request amount and request priority of the cloud computing service layer (11) and the transmission management module (13) and depending on the network throughput of the communication transmission unit (156). [9] A mobile cloud computing terminal according to claim 7, wherein the resource allocation module (14) comprises: a storage fusion unit configured to fuse storage resources of other cloud computing terminals via the cloud computing server (2); and a storage fusion unit designed to fuse storage resources of other cloud computing end devices via the cloud computing server (2). [10] A mobile cloud computing terminal according to claim 1, wherein the basic system architecture (12) comprises a local application service layer configured to provide a basic operating environment of the local application; the local application service layer is synchronized with the application service layer of the cloud system in the cloud computing server. [11] The mobile cloud computing terminal according to claim 1, wherein the basic system architecture (12) comprises an Android architecture, a Windows architecture, and a Unix architecture. [12] The mobile cloud computing terminal according to claim 1, wherein the communication transmission unit (156) comprises a mobile communication module, the mobile communication module comprising one or more of the 2G, 3G, 4G and 5G network communication modes. [13] The mobile cloud computing terminal according to claim 1, wherein the communication transmission unit (156) further comprises a Wi-Fi communication module, a Bluetooth communication module and / or a near-field communication module. [14] A mobile cloud computing terminal according to claim 1, wherein the local hardware also includes a dedicated hardware decoder for multimedia processing. [15] A method for operating a mobile cloud computing terminal (1), the method comprising the following steps: A. Verifying a user request and accessing a cloud computing server (2), B. Receiving GUI data and application data of a cloud system that is user-specific and operated based on cloud computing resources, generating a local GUI interface and associating a corresponding local application service; C. Detecting a user action received from the local hardware and collecting a state parameter of the mobile cloud computing terminal (1), wherein the user action and the state parameter are converted into a user command and application operation data, and then sent to the cloud computing server (2); D. Receive updated GUI data and application data of the cloud system, update the local GUI interface, and synchronize the corresponding local application service; E. Determine whether the user issues a termination command, if so, terminate the cloud computing service; otherwise, return to step C. wherein, in step D, updating the local GUI interface comprises: Decoding multimedia compressed data sent from the cloud computing server (2) and displaying it by the local hardware; and after pre-coding and rendering the video and audio files in the cloud system, receiving an image from the multimedia compressed data and displaying the image on the interface depending on network conditions or on a remaining battery of the local hardware. [16] A method for operating a mobile cloud computing terminal according to claim 15, further comprising: Real-time managing and monitoring a command channel, an application data channel, and a file stream channel located between the communication interface of the mobile cloud computing terminal (1) and the cloud computing server (2). [17] A method for operating a mobile cloud computing terminal according to claim 15, further comprising: Scheduling and allocating local hardware and software resources and / or cloud hardware and software resources to locally optimize operation of the cloud computing service (2). [18] A computer device comprising a memory and a processor, the processor executing a program instruction stored in the memory to perform the following steps: A. Validating a user request and accessing a cloud computing server; B. Receiving GUI data and application data of a cloud system that is user-specific and operated based on cloud computing resources, generating a local GUI interface and associating a corresponding local application service; C. Detecting a user action received from the local hardware and collecting a state parameter of the mobile cloud computing terminal, wherein the user action and the state parameter are converted into a user command and application operation data, and then sent to the cloud computing server; D. Receive updated GUI data and application data of the cloud system, update the local GUI interface, and synchronize the corresponding local application service; E. Determine whether the user issues a termination command, if so, terminate the cloud computing service; otherwise, return to step C. wherein, in step D, updating the local GUI interface comprises: Decoding multimedia compressed data sent from the cloud computing server and displaying it by the local hardware; and after pre-coding and rendering the video and audio files in the cloud system, receiving an image from the multimedia compressed data and displaying the image on the interface depending on network conditions or on a remaining battery of the local hardware.
Citation Information
Patent Citations
Mobile terminal as well as realization method, service system and cloud server thereof
CN102377739A
System and method for achieving cloud virtual mobile terminal of intelligent mobile terminal
CN103345406A
Cloud computing mobile terminals
CN106713485B
Event scheduling
US20160283057A1
