Cloud application processing method, chip and device
By setting up chips in electronic devices of cloud applications, and using display components, interactive components and connection components to process the streaming information in hardware layer, the poor performance problem in the prior art is solved, and performance improvement and development cost reduction are achieved.
Patent Information
- Application Number
- CN202211305411.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-10-24
- Publication Date
- 2025-08-26
- Estimated Expiration
- 2042-10-24
AI Technical Summary
In cloud applications, the prior art is usually processed at the application layer, resulting in poor performance.
By setting up a chip in an electronic device, the display components, interactive components and connection components in the chip process the streaming information, including the graphics processor GPU and the artificial intelligence AI computing unit, the streaming information processing of the hardware layer is realized.
Improves the performance of cloud applications, reduces development costs and simplifies the development process.
Smart Images

Figure CN115599482B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a method, chip, and device for processing cloud applications. Background Art
[0002] A cloud application can be installed in an electronic device, and the data of the cloud application can be stored in a cloud server. For example, the cloud application can be a cloud game.
[0003] In related technologies, when a user uses a cloud application on an electronic device, the electronic device can retrieve streaming information from a cloud server to render the cloud application. For example, the streaming information may include videos, images, etc. However, in this process, the streaming information is typically processed at the application layer, resulting in poor performance of the cloud application. Summary of the Invention
[0004] Multiple aspects of the present application provide a method, chip, and device for processing a cloud application to improve the performance of the cloud application.
[0005] In a first aspect, an embodiment of the present application provides a method for processing a cloud application, which is applied to an electronic device, wherein the electronic device is provided with a chip, the chip including an interaction component, a connection component, and a display component, the method comprising:
[0006] displaying a first page of the cloud application by the display component;
[0007] Acquiring, through the interaction component, an operation event on the first page from peripheral hardware corresponding to the electronic device;
[0008] Obtaining streaming information corresponding to the operation event from a cloud server through the connection component, where the streaming information is determined by the cloud server based on the first page and the operation event;
[0009] The streaming information is processed by the display component to display a second page corresponding to the streaming information.
[0010] In a possible implementation, processing the streaming information by the display component to display a second page corresponding to the streaming information includes:
[0011] Determining a display component interface corresponding to the display component;
[0012] calling the display component through the display component interface to process the streaming information through the display component to obtain a second page;
[0013] The second page is displayed on a display screen of the electronic device.
[0014] In a possible implementation, processing the streaming information by the display component to obtain a second page includes:
[0015] calling an image processing device in the electronic device through the display component to process the streaming information through the image processing device to obtain the second page;
[0016] The image processing device includes at least one of a graphics processing unit (GPU) and an artificial intelligence (AI) computing unit.
[0017] In a possible implementation, the interactive component is connected to the peripheral hardware via a peripheral bus; and obtaining, by the interactive component, an operation event on the first page from the peripheral hardware corresponding to the electronic device, includes:
[0018] Generate the operation event through the peripheral hardware and send the operation event to the peripheral bus;
[0019] The operation event is obtained from the peripheral bus through the interaction component.
[0020] In a possible implementation, obtaining streaming information corresponding to the operation event from a cloud server through the connection component includes:
[0021] Sending the operation event to the cloud server by calling a network component through the connection component, wherein the network component is arranged in the chip or the network component is arranged outside the chip;
[0022] The connection component calls the network component to receive the streaming information sent by the cloud server.
[0023] In a possible implementation, the chip further includes a control component; and before displaying the first page of the cloud application through the display component, the chip further includes:
[0024] obtaining, through the control component, an identifier and connection parameters of the cloud application;
[0025] Calling a network component through the connection component to send a network connection request to the cloud server, wherein the network connection request includes an identifier and connection parameters of the cloud application;
[0026] The connection component calls the network component to receive the network connection response sent by the cloud server, so as to establish a network connection with the cloud server.
[0027] In a second aspect, an embodiment of the present application provides a chip, comprising: an interactive component, a connection component, a display component, and a control component, wherein the control component is connected to the connection component, the display component, and the interactive component, respectively, and the control component is used to control the operation of the connection component, the display component, and the interactive component; wherein,
[0028] The display component is used to control the display of the first page of the cloud application;
[0029] The interaction component is used to obtain an operation event on the first page from peripheral hardware corresponding to the electronic device;
[0030] The connection component is used to obtain streaming information corresponding to the operation event from the cloud server, where the streaming information is determined by the cloud server based on the first page and the operation event;
[0031] The display component is used to process the streaming information to control the display of a second page corresponding to the streaming information.
[0032] In a possible implementation, processing the streaming information by the display component to display a second page corresponding to the streaming information includes:
[0033] Determining a display component interface corresponding to the display component;
[0034] calling the display component through the display component interface to process the streaming information through the display component to obtain a second page;
[0035] The second page is displayed on a display screen of the electronic device.
[0036] In a possible implementation, processing the streaming information by the display component to obtain a second page includes:
[0037] calling an image processing device in the electronic device through the display component to process the streaming information through the image processing device to obtain the second page;
[0038] The image processing device includes at least one of a graphics processing unit (GPU) and an artificial intelligence (AI) computing unit.
[0039] In a possible implementation, the interactive component is connected to the peripheral hardware via a peripheral bus; and obtaining, by the interactive component, an operation event on the first page from the peripheral hardware corresponding to the electronic device, includes:
[0040] Generate the operation event through the peripheral hardware and send the operation event to the peripheral bus;
[0041] The operation event is obtained from the peripheral bus through the interaction component.
[0042] In a possible implementation, obtaining streaming information corresponding to the operation event from a cloud server through the connection component includes:
[0043] Sending the operation event to the cloud server by calling a network component through the connection component, wherein the network component is arranged in the chip or the network component is arranged outside the chip;
[0044] The connection component calls the network component to receive the streaming information sent by the cloud server.
[0045] In a possible implementation, the chip further includes a control component; and before displaying the first page of the cloud application through the display component, the chip further includes:
[0046] obtaining, through the control component, an identifier and connection parameters of the cloud application;
[0047] Calling a network component through the connection component to send a network connection request to the cloud server, wherein the network connection request includes an identifier and connection parameters of the cloud application;
[0048] The connection component calls the network component to receive the network connection response sent by the cloud server, so as to establish a network connection with the cloud server.
[0049] In a third aspect, an embodiment of the present application provides an electronic device, comprising a display screen and a chip, wherein the chip comprises an interactive component, a connection component, a display component, and a control component, wherein the control component is linked to the connection component, the display component, and the interactive component, respectively, and the control component is used to control the operation of the connection component, the display component, and the interactive component; wherein,
[0050] The display component is used to control the display of the first page of the cloud application on the display screen;
[0051] The interaction component is used to obtain an operation event on the first page from the peripheral hardware corresponding to the electronic device;
[0052] The connection component is used to obtain streaming information corresponding to the operation event from the cloud server, where the streaming information is determined by the cloud server based on the first page and the operation event;
[0053] The display component is configured to process the streaming information to control the display of a second page corresponding to the streaming information on the display screen.
[0054] In a possible implementation, processing the streaming information by the display component to display a second page corresponding to the streaming information includes:
[0055] Determining a display component interface corresponding to the display component;
[0056] calling the display component through the display component interface to process the streaming information through the display component to obtain a second page;
[0057] The second page is displayed on a display screen of the electronic device.
[0058] In a possible implementation, processing the streaming information by the display component to obtain a second page includes:
[0059] calling an image processing device in the electronic device through the display component to process the streaming information through the image processing device to obtain the second page;
[0060] The image processing device includes at least one of a graphics processing unit (GPU) and an artificial intelligence (AI) computing unit.
[0061] In a possible implementation, the interactive component is connected to the peripheral hardware via a peripheral bus; and obtaining, by the interactive component, an operation event on the first page from the peripheral hardware corresponding to the electronic device, includes:
[0062] Generate the operation event through the peripheral hardware and send the operation event to the peripheral bus;
[0063] The operation event is obtained from the peripheral bus through the interaction component.
[0064] In a possible implementation, obtaining streaming information corresponding to the operation event from a cloud server through the connection component includes:
[0065] Sending the operation event to the cloud server by calling a network component through the connection component, wherein the network component is arranged in the chip or the network component is arranged outside the chip;
[0066] The connection component calls the network component to receive the streaming information sent by the cloud server.
[0067] In a possible implementation, the chip further includes a control component; and before displaying the first page of the cloud application through the display component, the chip further includes:
[0068] obtaining, through the control component, an identifier and connection parameters of the cloud application;
[0069] Calling a network component through the connection component to send a network connection request to the cloud server, wherein the network connection request includes an identifier and connection parameters of the cloud application;
[0070] The connection component calls the network component to receive the network connection response sent by the cloud server, so as to establish a network connection with the cloud server.
[0071] In a possible implementation, the electronic device further includes at least one of an image processing device, a network component, peripheral hardware, and a peripheral bus, wherein:
[0072] The chip is connected to the image processing device and the network component respectively;
[0073] The chip is also connected to the peripheral hardware via the peripheral bus.
[0074] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the cloud application processing method described in any one of the first aspects.
[0075] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the cloud application processing method shown in any one of the first aspects.
[0076] An embodiment of the present application provides a method, chip, and device for processing a cloud application. A chip may be provided in an electronic device, and the chip may include a display component, an interactive component, and a connection component. The electronic device may display the first page of the cloud application through the display component, and obtain an operation event for the first page from the peripheral hardware through the interactive component. The electronic device may obtain streaming information corresponding to the operation event from the cloud server through the connection component, and may process the streaming information through the display component to display a second page corresponding to the streaming information. Since the streaming information can be processed by the chip, that is, the streaming information can be processed at the hardware layer, the performance of the cloud application is improved compared to processing the streaming information in the application layer. BRIEF DESCRIPTION OF THE DRAWINGS
[0077] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:
[0078] Figure 1A schematic diagram of an application scenario provided by an exemplary embodiment of the present application;
[0079] Figure 2 A flowchart of a method for processing a cloud application provided by an exemplary embodiment of the present application;
[0080] Figure 3 A schematic diagram of the first page provided in an embodiment of the present application;
[0081] Figure 4 A schematic diagram of the second page provided in an embodiment of the present application;
[0082] Figure 5 A flowchart of another method for processing a cloud application provided by an exemplary embodiment of the present application;
[0083] Figure 6 A schematic structural diagram of a chip provided for an exemplary embodiment of the present application;
[0084] Figure 7 A schematic structural diagram of an electronic device provided as an exemplary embodiment of the present application;
[0085] Figure 8 A flowchart of another method for processing a cloud application provided by an exemplary embodiment of the present application;
[0086] Figure 9 A process diagram of a method for processing a cloud application provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION
[0087] To make the purpose, technical solutions, and advantages of this application more clear, the technical solutions of this application will be clearly and completely described below in conjunction with the specific embodiments of this application and the corresponding drawings. Obviously, the embodiments described are only part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.
[0088] Figure 1 This is a schematic diagram of an application scenario provided by an exemplary embodiment of this application. Figure 1 , includes an electronic device 101 and a cloud server 102. For example, the electronic device 101 can be a computer.
[0089] A cloud application may be installed in electronic device 101. When a user uses the cloud application on electronic device 101, the user may input operations on the cloud application through the peripheral hardware of electronic device 101. Electronic device 101 may obtain user operation events on the cloud application and send the operation events to cloud server 102.
[0090] After receiving the operation event, the cloud server 102 may determine corresponding streaming information according to the operation event and send the streaming information to the electronic device 101 so that the electronic device 101 may render the cloud application according to the streaming information.
[0091] In related technologies, when a user uses a cloud application on an electronic device, the electronic device can retrieve streaming information from a cloud server to render the cloud application. For example, the streaming information may include videos, images, etc. However, in this process, the streaming information is typically processed at the application layer, resulting in poor performance of the cloud application.
[0092] In an embodiment of the present application, a chip can be set in an electronic device, and the streaming technology function can be encapsulated in the chip to process the streaming information through the chip, thereby realizing the processing of the streaming information at the hardware layer. Compared with processing the streaming information at the application layer, the performance of the cloud application is improved.
[0093] The technical solutions shown in this application are described in detail below through specific embodiments. It should be noted that the following embodiments can exist independently or in combination with each other, and the same or similar contents will not be repeated in different embodiments.
[0094] Figure 2 This is a flowchart of a method for processing a cloud application provided by an exemplary embodiment of the present application. Figure 2 , the method may include:
[0095] S201: Display the first page of the cloud application through a display component.
[0096] The execution subject of the embodiments of the present application may be an electronic device or a component of a cloud application provided in the electronic device. The cloud application component may be implemented through software or a combination of software and hardware. The cloud application component may be a chip in the electronic device. For ease of understanding, the following description uses the electronic device as an example.
[0097] Optionally, the electronic device may be provided with a chip that may include a display component, an interaction component, and a connection component. The display component may be used to display cloud application pages on the electronic device; the interaction component may be used to obtain user operation events on the cloud application; and the connection component may be used to obtain information sent by the cloud server.
[0098] A cloud application may be installed in the electronic device, and a first page of the cloud application may be displayed through a display component. The first page may be a page currently displayed by the cloud application, and the first page may include multiple controls.
[0099] Next, combine Figure 3 , describe the first page.
[0100] Figure 3 This is a schematic diagram of the first page provided in this application embodiment. Figure 3 If the cloud application is a cloud game, the electronic device can display the first page of the cloud application, which can be the current game screen. The first page can include controls such as forward, backward, and jump.
[0101] S202: Obtain an operation event on the first page from peripheral hardware corresponding to the electronic device through an interactive component.
[0102] The peripheral hardware can be used for the user to input operations on the first page in the electronic device. For example, the peripheral hardware can be a keyboard, a mouse, etc.
[0103] Optionally, the interactive component may be connected to the peripheral hardware via a peripheral bus.
[0104] In an optional embodiment, the operation event on the first page may be obtained in the following manner: generating the operation event through peripheral hardware and sending the operation event to the peripheral bus; and obtaining the operation event from the peripheral bus through the interactive component.
[0105] For example, if the first page is Figure 3 As shown, the peripheral hardware is a mouse. When a user clicks a jump control in a cloud application with the mouse, a click event 1 is generated by the mouse and sent to the peripheral bus. The electronic device can obtain the click event 1 from the peripheral bus through the interactive component.
[0106] S203: Obtain streaming information corresponding to the operation event from the cloud server through the connection component.
[0107] The streaming information may be determined by the cloud server according to the first page and the operation event, and may include images, videos, audios and other information.
[0108] Optionally, the chip may or may not include a network component. The network component may be provided externally to the chip. The network component may be used to establish a network connection between the electronic device and the cloud server.
[0109] In an optional embodiment, the streaming information corresponding to the operation event can be obtained in the following manner: the connection component calls the network component to send the operation event to the cloud server; and the connection component calls the network component to receive the streaming information sent by the cloud server.
[0110] Optionally, the cloud server may include the first page. After receiving the operation event, the cloud server may determine corresponding streaming information according to the operation event and the first page.
[0111] For example, if the first page is Figure 3 As shown, if the operation event is a click event 1 on a jump control, the electronic device can call the network component through the connection component to send the click event 1 to the cloud server. After receiving the click event 1, the cloud server can determine the corresponding streaming information 1 based on the click event 1 and the first page, and send the streaming information 1 to the electronic device. The electronic device can call the network component through the connection component to receive the streaming information 1 sent by the cloud server.
[0112] S204: Process the streaming information through the display component to display a second page corresponding to the streaming information.
[0113] The display component may have a corresponding display component interface, and the electronic device may call the display component through the display component interface.
[0114] The second page may be a page determined by the electronic device according to the streaming information.
[0115] In an optional embodiment, the second page corresponding to the streaming information can be displayed in the following manner: determining a display component interface corresponding to the display component; calling the display component through the display component interface to process the streaming information through the display component to obtain the second page; and displaying the second page on the display screen of the electronic device.
[0116] Optionally, the electronic device may include an image processing device. The image processing device includes at least one of a graphics processing unit (GPU) and an artificial intelligence (AI) computing unit.
[0117] In an optional embodiment, the second page may be obtained in the following manner: an image processing device in the electronic device may be called through the display component to process the streaming information through the image processing device to obtain the second page.
[0118] Next, combine Figure 4 , describe the second page.
[0119] Figure 4A schematic diagram of the second page provided in an embodiment of the present application. For example, after the electronic device receives the streaming information 1 sent by the cloud server, it can determine the display component interface corresponding to the display component, and call the display component through the display component interface, and then call the image processing device through the display component to decode the streaming information 1, obtain the second page corresponding to the streaming information 1, and display the second page on the display screen, such as Figure 4 shown.
[0120] In an embodiment of the present application, a chip may be provided in an electronic device, and the chip may include a display component, an interactive component, and a connection component. The electronic device may display a first page of a cloud application through the display component, and obtain an operation event on the first page from the peripheral hardware through the interactive component. The electronic device may obtain streaming information corresponding to the operation event from the cloud server through the connection component, and may process the streaming information through the display component to display a second page corresponding to the streaming information. Since the streaming information can be processed by the chip, that is, the streaming information can be processed at the hardware layer, the performance of the cloud application is improved compared to processing the streaming information at the application layer.
[0121] Below, in Figure 2 Based on the embodiment shown, combined Figure 5 , further explains the processing method of the above cloud applications.
[0122] Figure 5 A flowchart of another method for processing a cloud application provided by an exemplary embodiment of this application. Figure 5 , the method may include:
[0123] S501. Obtain the identifier and connection parameters of the cloud application through the control component.
[0124] Optionally, for any cloud application, the cloud application may have a unique identity (ID).
[0125] Optionally, the connection parameters may include initial parameters such as the Internet Protocol (IP) address and port of the cloud server, and the image quality and frame rate of the cloud application.
[0126] In an optional embodiment, the chip may further include a control component, and the electronic device may obtain the identifier and connection parameters of the cloud application through the control component in the chip.
[0127] For example, the electronic device can obtain the identifier of cloud application 1 as identifier 1 through the control component in the chip, the network address 1 of the cloud server is 2001:0DB8:0000:0000:0008:0800:200C:417A, the port number is 65532, the image quality is high definition, the frame rate is 30fps, etc.
[0128] S502: Call the network component through the connection component to send a network connection request to the cloud server.
[0129] Optionally, the network connection request may include an identifier of the cloud application and connection parameters.
[0130] For example, if the cloud application's identifier is identifier 1, and the connection parameters include the cloud server's network address 1, which is 2001:0DB8:0000:0000:0008:0800:200C:417A, the port number is 65532, the image quality is high definition, the frame rate is 30 fps, etc., then the electronic device can call the network component through the connection component to send a network connection request 1 to the cloud server. The network connection request 1 may include the cloud application's identifier 1, the cloud server's network address 1, which is 2001:0DB8:0000:0000:0008:0800:200C:417A, the port number is 65532, the image quality is high definition, the frame rate is 30 fps, etc.
[0131] S503: Call the network component through the connection component to receive the network connection response sent by the cloud server to establish a network connection with the cloud server.
[0132] Optionally, after the cloud server receives the network connection request sent by the electronic device, the cloud server may send a network connection response corresponding to the network connection request to the electronic device. The electronic device may call the network component through the connection component and receive the network connection response sent by the cloud server to establish a network connection with the cloud server.
[0133] S504: Display the first page of the cloud application through the display component.
[0134] It should be noted that the specific execution process of step S504 can refer to the execution process of step S201, which will not be repeated here.
[0135] S505: Obtain an operation event on the first page from peripheral hardware corresponding to the electronic device through the interaction component.
[0136] It should be noted that the specific execution process of step S505 can refer to the execution process of step S202, which will not be repeated here.
[0137] S506: Obtain streaming information corresponding to the operation event from the cloud server through the connection component.
[0138] It should be noted that the specific execution process of step S506 can refer to the execution process of step S203, which will not be repeated here.
[0139] S507: Process the streaming information through the display component to display a second page corresponding to the streaming information.
[0140] It should be noted that the specific execution process of step S507 can refer to the execution process of step S204, which will not be repeated here.
[0141] In an embodiment of the present application, a chip may be provided in the electronic device, and the chip may include a display component, an interactive component, a connection component, and a control component. The electronic device may obtain the identifier and connection parameters of the cloud application through the control component, and may call the network component through the connection component to send a network connection request to the cloud server. The electronic device may call the network component through the connection component to receive a network connection response sent by the cloud server to establish a network connection with the cloud server. The electronic device displays the first page of the cloud application through the display component, and obtains an operation event for the first page from the peripheral hardware through the interactive component. The electronic device may obtain streaming information corresponding to the operation event from the cloud server through the connection component, and may process the streaming information through the display component to display a second page corresponding to the streaming information. Since the streaming information can be processed by the chip, that is, the streaming information can be processed at the hardware layer, the performance of the cloud application is improved compared to processing the streaming information in the application layer.
[0142] Next, based on any of the above embodiments, Figure 6 , explaining the chip structure.
[0143] Figure 6 This is a schematic diagram of the structure of a chip provided by an exemplary embodiment of this application. Figure 6 The chip may include a control component, a connection component, a display component, and an interaction component. The control component may be connected to the connection component, the display component, and the interaction component respectively.
[0144] The display component can be used to display the first page of the cloud application and can also process the streamed information to obtain a second page. Optionally, the display component can call an image processing device in the electronic device to process the streamed information through the image processing device to obtain the second page. The image processing device includes at least one of a graphics processing unit (GPU) and an artificial intelligence (AI) computing unit.
[0145] The interaction component can be used to obtain an operation event on the first page from the peripheral hardware corresponding to the electronic device.
[0146] The connection component can be used to call the network component to send an operation event to the cloud server, and call the network component to receive streaming information sent by the cloud server. Optionally, the network component can be set in the chip or outside the chip.
[0147] Optionally, the connection component may also call the network component to send a network connection request to the cloud server, and call the network component to receive a network connection response sent by the cloud server, so as to establish a network connection with the cloud server.
[0148] The control component can be used to control the operation of the connection component, display component, and interaction component. The control component can also be used to obtain the identity and connection parameters of the cloud application.
[0149] It should be noted that the control component, connection component, display component and interaction component in the chip can be a hardware structure in the chip, or a structure composed of hardware and software.
[0150] Optionally, developers can develop cloud applications based on the chip. Since the chip already has streaming technology functions such as network connection and processing streaming information, it can reduce the workload of developers in developing cloud applications and improve development efficiency. The chip is also compatible with different operating systems, reducing the development cost of cloud applications.
[0151] In an embodiment of the present application, the chip may include a display component, an interactive component, a connection component, and a control component. The identification and connection parameters of the cloud application can be obtained through the control component, and the network component can be called through the connection component to send a network connection request to the cloud server. The network component can be called through the connection component to receive a network connection response sent by the cloud server to establish a network connection with the cloud server. The first page of the cloud application can be displayed through the display component, and the operation event for the first page can be obtained from the peripheral hardware through the interactive component. The streaming information corresponding to the operation event can be obtained from the cloud server through the connection component, and the streaming information can be processed through the display component to display the second page corresponding to the streaming information. Since the chip can provide cross-system, high-performance, high-efficiency and high-security streaming services, compared with processing the streaming information at the application layer, the development cost of the cloud application is reduced and the performance of the cloud application is improved.
[0152] It should be noted that Figure 6 The chip shown in the embodiment can execute each step in the method embodiment, and its beneficial effects and principles are similar, which will not be described again here.
[0153] Figure 7 This is a schematic diagram of the structure of an electronic device provided by an exemplary embodiment of the present application. Figure 7The electronic device may include a chip, which may include a control component, a connection component, a display component, and an interaction component. The control component is connected to the connection component, the display component, and the interaction component respectively. The control component can be used to control the operation of the connection component, the display component, and the interaction component.
[0154] The electronic device may also include an image processing device, a peripheral bus, peripheral hardware, and a network component. The image processing device may include a GPU and / or AI.
[0155] Electronic devices can obtain the identification and connection parameters of cloud applications through the control components in the chip.
[0156] The connection component in the chip can connect to the network component to call the network component to send a network connection request to the cloud server and call the network component to receive the network connection response sent by the cloud server to establish a network connection with the cloud server. This can realize the network connection function at the hardware layer and improve connection efficiency. The connection component can also call the network component to send operation events to the cloud server and call the network component to receive the streaming information corresponding to the operation events sent by the cloud server. Optionally, the network component can be set up in the chip or outside the chip.
[0157] The display component in the chip can be used to display a first page of a cloud application on a display screen. Optionally, the display component can be connected to an image processing device. The electronic device can determine the display component's corresponding display component interface and call the display component through the display component interface. The display component then calls the image processing device to process the streamed information to obtain a second page, which is then displayed on the display screen. This enables processing of streamed information at the hardware layer, improves processing efficiency, and simplifies the complexity of the cloud application. Furthermore, since the streamed information can be processed at the hardware layer, the involvement of the cloud application is reduced, improving security performance.
[0158] The interactive component in the chip can be connected to the peripheral hardware via a peripheral bus. Operation events can be generated by the peripheral hardware and sent to the peripheral bus, allowing the interactive component to obtain the operation events for the first page from the peripheral bus. Because the interactive component can be connected to the peripheral hardware via the peripheral bus, lower latency and better compatibility can be achieved.
[0159] In an embodiment of the present application, a chip may be provided in the electronic device, and the chip may include a display component, an interactive component, a connection component, and a control component. The electronic device may obtain the identifier and connection parameters of the cloud application through the control component, and may call the network component through the connection component to send a network connection request to the cloud server. The electronic device may call the network component through the connection component to receive the network connection response sent by the cloud server to establish a network connection with the cloud server. The electronic device displays the first page of the cloud application through the display component, and obtains the operation event of the first page from the peripheral hardware through the interactive component. The electronic device may obtain the streaming information corresponding to the operation event from the cloud server through the connection component, and may process the streaming information through the display component to display the second page corresponding to the streaming information. Since the various functions corresponding to the streaming technology can be encapsulated in the chip, the streaming information can be processed by the chip, that is, the streaming information can be processed at the hardware layer, which improves the performance of the cloud application compared to processing the streaming information in the application layer.
[0160] It should be noted that Figure 7 The electronic device shown in the embodiment can execute each step in the method embodiment, and its beneficial effects and principles are similar, which will not be described again here.
[0161] Next, based on any of the above embodiments, Figure 8 , further details are given on the processing method of the above cloud applications.
[0162] Figure 8 A flowchart of another method for processing a cloud application provided by an exemplary embodiment of the present application. Figure 8 , the method may include:
[0163] S801. The electronic device obtains the identifier and connection parameters of the cloud application.
[0164] Optionally, the electronic device may include a chip, and the chip may include a control component, an interaction component, a connection component and a display component.
[0165] Electronic devices can obtain the identification and connection parameters of cloud applications through the control components in the chip.
[0166] For example, the electronic device can obtain the identifier of cloud application 1 as identifier 1 through the control component in the chip, the network address 1 of the cloud server is 2001:0DB8:0000:0000:0008:0800:200C:417A, the port number is 65532, the image quality is high definition, the frame rate is 30fps, etc.
[0167] S802: The electronic device sends a network connection request to the cloud server.
[0168] Optionally, the chip may further include a network component; alternatively, the chip may not include a network component, and the network component may be provided outside the chip.
[0169] Optionally, the electronic device may call the network component through the connection component in the chip to send a network connection request to the cloud server through the network component. The network connection request may include the identifier and connection parameters of the cloud application.
[0170] Optionally, the network connection request may further include an identifier of the electronic device.
[0171] For example, if the electronic device is identified as electronic device 1, the cloud application is identified as identification 1, and the connection parameters include the cloud server's network address 1 being 2001:0DB8:0000:0000:0008:0800:200C:417A, the port number being 65532, the image quality being high definition, the frame rate being 30 fps, etc., then the electronic device can invoke the network component through the connection component to send a network connection request 1 to the cloud server. The network connection request 1 may include the electronic device 1, the cloud application's identification 1, the cloud server's network address 1 being 2001:0DB8:0000:0000:0008:0800:200C:417A, the port number being 65532, the image quality being high definition, the frame rate being 30 fps, etc.
[0172] S803: The cloud server determines a network connection response based on the network connection request.
[0173] After receiving the network connection request sent by the electronic device, the cloud server can determine a corresponding network connection response based on the network connection request.
[0174] For example, if the network connection request 1 includes the identifier of the electronic device as electronic device 1, the identifier of the cloud application as identifier 1, and connection parameters, the cloud server can determine the corresponding network connection response 1 based on the network connection request 1.
[0175] S804: The cloud server sends a network connection response to the electronic device.
[0176] After the cloud server determines the network connection response, it can send the network connection response to the electronic device, so that the electronic device calls the network component through the connection component in the chip, receives the network connection response, and establishes a network connection.
[0177] For example, the cloud server may send a network connection response 1 to the electronic device 1 , and the electronic device 1 may call the network component through the connection component in the chip, receive the network connection response 1 , and establish a network connection with the cloud server.
[0178] S805: The electronic device displays the first page of the cloud application.
[0179] Optionally, after the electronic device establishes a network connection with the cloud server, the first page of the cloud application can be displayed. The first page is the current page of the cloud application. For example, the first page can be as follows: Figure 3 shown.
[0180] S806: The electronic device obtains an operation event on the first page from the peripheral hardware corresponding to the electronic device through the interaction component.
[0181] For example, if the first page is Figure 3 As shown, the peripheral hardware is a mouse. When a user clicks a jump control in a cloud application with the mouse, a click event 1 may be generated by the mouse, and the electronic device may obtain the click event 1 from the mouse through the interactive component.
[0182] S807: The electronic device sends an operation event to the cloud server.
[0183] Optionally, after the electronic device obtains the operation event on the first page, it can call the network component through the connection component in the chip to send the operation event to the cloud server.
[0184] For example, if the first page is Figure 3 As shown, the operation event is a click event 1 on the jump control, and the electronic device can call the network component through the connection component to send the click event 1 to the cloud server.
[0185] S808. The cloud server determines corresponding streaming information according to the first page and the operation event.
[0186] Optionally, after receiving the operation event sent by the electronic device, the cloud server may perform calculations and processing based on the first page and the operation event to determine corresponding streaming information.
[0187] For example, if the first page is Figure 3 As shown, the operation event is a click event 1 on the jump control. After receiving the click event 1, the cloud server can perform calculations and processing based on the click event 1 and the first page to determine the corresponding streaming information 1.
[0188] S809: The cloud server sends streaming information to the electronic device.
[0189] Optionally, after determining the streaming information, the cloud server may send the streaming information to the electronic device, so that the electronic device calls the network component through the connection component to receive the streaming information.
[0190] For example, if the cloud server sends streaming information 1 to the electronic device, the electronic device can call the network component through the connection component to receive the streaming information 1 sent by the cloud server. The streaming information 1 may include information such as video and images.
[0191] S810: The electronic device processes the streaming information to display a second page corresponding to the streaming information.
[0192] Optionally, after receiving the streaming information, the electronic device may determine a display interface corresponding to the display component and call the display component through the display component interface. The electronic device may call the image processing device through the display component to decode the streaming information to obtain a second page and display the second page on the display screen.
[0193] For example, if the streaming information received by the electronic device is streaming information 1, which may include information such as video and images, the electronic device may call the image processing device through the display component to decode the streaming information 1 to obtain a second page, and display the second page on the display screen, such as Figure 4 shown.
[0194] In an embodiment of the present application, a chip may be provided in the electronic device, and the chip may include a display component, an interactive component, and a connection component. The electronic device may obtain an identifier and connection parameters of the cloud application, and may send a network connection request to the cloud server. After receiving the network connection request, the cloud server may determine a network connection response, and send the network connection response to the electronic device. The electronic device may display the first page of the cloud application through the display component, and obtain an operation event for the first page from the peripheral hardware through the interactive component. The electronic device may send an operation event to the cloud server, and the cloud server may determine the corresponding streaming information based on the first page and the operation event, and send the streaming information to the electronic device. After the electronic device obtains the streaming information, it may process the streaming information through the display component to display a second page corresponding to the streaming information. Since the streaming information can be processed by the chip, that is, the streaming information can be processed at the hardware layer, the performance of the cloud application is improved compared to processing the streaming information in the application layer.
[0195] Next, based on any of the above embodiments, through specific examples, combined with Figure 9 , further details are given on the processing method of the above cloud applications.
[0196] Figure 9 A process diagram of a cloud application processing method provided by an exemplary embodiment of this application. Figure 9 , including electronic devices and servers. The process of the cloud application processing method may include steps ①②③④⑤⑥⑦.
[0197] An electronic device may include a chip, image processing device, display screen, peripheral bus, peripheral hardware, and network components. The chip may include control components, connection components, display components, and interaction components.
[0198] Optionally, the electronic device may include multiple cloud applications. For example, the multiple cloud applications may be cloud application 1, cloud application 2, cloud application 3, ..., cloud application n.
[0199] The control component in the chip can obtain the cloud application's identifier and connection parameters through step ①. For example, the control component can obtain the identifier 1 of cloud application 1, as well as connection parameters including the cloud server's network address 1: 2001:0DB8:0000:0000:0008:0800:200C:417A, port number 65532, HD quality, and 30fps frame rate.
[0200] The connection component in the chip can call the network component to send a network connection request to the cloud server through the network component, which is step ②. The network connection request can include the identifier and connection parameters of the cloud application.
[0201] Optionally, the cloud server may include multiple cloud applications. For example, the multiple cloud applications may be Cloud Application 1, Cloud Application 2, Cloud Application 3, ..., Cloud Application M. After receiving the network connection request, the cloud server may determine a corresponding network connection response based on the network connection request and send the network connection response to the electronic device, i.e., step ③. For example, if Network Connection Request 1 includes an identifier of the cloud application as Identifier 1 and connection parameters, the cloud server may determine a corresponding Network Connection Response 1 based on Network Connection Request 1 and send the Network Connection Response 1 to the electronic device.
[0202] The electronic device can call the network component through the connection component and receive the network connection response sent by the cloud server to establish a network connection with the cloud server. Since the network component can be directly called through the connection component, the network performance of the cloud application is improved.
[0203] If the electronic device's display screen currently displays the first page of the cloud application, the interactive component in the chip can obtain an operation event for the first page from the peripheral hardware via the peripheral bus, i.e., step 4. After the electronic device obtains the operation event for the first page, it can call the network component through the connection component in the chip to send the operation event to the cloud server, i.e., step 5. Because the interactive component in the chip can directly obtain the operation event for the first page from the peripheral hardware via the peripheral bus, the interactive performance of the cloud application is improved.
[0204] After receiving the operation event, the cloud server may perform calculations and processing based on the first page and the operation event to determine corresponding streaming information, and send the streaming information to the electronic device, i.e., step ⑥.
[0205] The electronic device can call the network component via the connection component in the chip to receive the streaming information, and can then call the image processing device via the display component to process the streaming information to obtain a second page (step 7). After determining the second page, the electronic device can display the second page on the display screen. Because the display component can directly call the image processing device to process the streaming information, cloud applications can achieve better image performance.
[0206] In an embodiment of the present application, a chip may be provided in the electronic device, and the chip may include a display component, an interactive component, and a connection component. The electronic device may obtain an identifier and connection parameters of the cloud application, and may send a network connection request to the cloud server. After receiving the network connection request, the cloud server may determine a network connection response, and send the network connection response to the electronic device. The electronic device may display the first page of the cloud application through the display component, and obtain an operation event for the first page from the peripheral hardware through the interactive component. The electronic device may send an operation event to the cloud server, and the cloud server may determine the corresponding streaming information based on the first page and the operation event, and send the streaming information to the electronic device. After the electronic device obtains the streaming information, it may process the streaming information through the display component to display a second page corresponding to the streaming information. Since the streaming information can be processed by the chip, that is, the streaming information can be processed at the hardware layer, the performance of the cloud application is improved compared to processing the streaming information in the application layer.
[0207] Accordingly, an embodiment of the present application provides a computer-readable storage medium, which stores computer-executable instructions. When the computer-executable instructions are executed by a processor, they are used to implement the cloud application processing method described in the above method embodiment.
[0208] Accordingly, an embodiment of the present application may also provide a computer program product, including a computer program, which, when executed by a processor, can implement the cloud application processing method shown in the above method embodiment.
[0209] It will be understood by those skilled in the art that embodiments of the present invention may be provided as methods, systems, or computer program products. Thus, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0210] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowcharts and / or block diagrams, as well as combinations of processes and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowcharts and / or block diagrams. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0211] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.
[0212] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.
[0213] In a typical configuration, a computing device includes one or more processors (CPUs), input / output interfaces, network interfaces, and memory.
[0214] Memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.
[0215] Computer-readable media includes permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. The information can be computer-readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer-readable media does not include transitory computer-readable media (transitory media), such as modulated data signals and carrier waves.
[0216] It should also be noted that the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, commodity, or apparatus that includes a series of elements includes not only those elements but also other elements not explicitly listed, or includes elements inherent to such process, method, commodity, or apparatus. In the absence of further limitations, an element defined by the phrase "comprises a ..." does not exclude the presence of other identical elements in the process, method, commodity, or apparatus that includes the element.
[0217] The foregoing is merely an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application should all be included within the scope of the claims of the present application.
Claims
1. A method for processing a cloud application, characterized in that: Applied to an electronic device, the electronic device is provided with a chip, the chip includes an interaction component, a connection component, a display component and a control component, the method includes: displaying a first page of the cloud application by the display component; Acquiring, through the interaction component, an operation event on the first page from peripheral hardware corresponding to the electronic device; Obtaining streaming information corresponding to the operation event from a cloud server through the connection component, where the streaming information is determined by the cloud server based on the first page and the operation event; Processing the streaming information by the display component to display a second page corresponding to the streaming information specifically includes: Determining a display component interface corresponding to the display component; calling the display component through the display component interface to process the streaming information through the display component to obtain a second page; Displaying the second page on a display screen of the electronic device; Obtaining streaming information corresponding to the operation event from the cloud server through the connection component includes: Sending the operation event to the cloud server by calling a network component through the connection component, wherein the network component is arranged in the chip or the network component is arranged outside the chip; Calling the network component through the connection component to receive the streaming information sent by the cloud server; Before displaying the first page of the cloud application through the display component, the method further includes: obtaining, through the control component, an identifier and connection parameters of the cloud application; Calling a network component through the connection component to send a network connection request to the cloud server, wherein the network connection request includes an identifier and connection parameters of the cloud application; The connection component calls the network component to receive the network connection response sent by the cloud server, so as to establish a network connection with the cloud server.
2. The method according to claim 1, characterized in that Processing the streaming information by the display component to obtain a second page includes: calling an image processing device in the electronic device through the display component to process the streaming information through the image processing device to obtain the second page; The image processing device includes at least one of a graphics processing unit (GPU) and an artificial intelligence (AI) computing unit.
3. The method according to any one of claims 1-2, characterized in that The interactive component is connected to the peripheral hardware via a peripheral bus; and obtaining an operation event on the first page from the peripheral hardware corresponding to the electronic device via the interactive component includes: Generate the operation event through the peripheral hardware and send the operation event to the peripheral bus; The operation event is obtained from the peripheral bus through the interaction component.
4. A chip, characterized in that: The chip includes an interactive component, a connection component, a display component and a control component, wherein the control component is connected to the connection component, the display component and the interactive component respectively, and the control component is used to control the operation of the connection component, the display component and the interactive component; wherein, The display component is used to control the display of the first page of the cloud application; The interaction component is used to obtain an operation event on the first page from peripheral hardware corresponding to the electronic device; The connection component is used to obtain streaming information corresponding to the operation event from the cloud server, where the streaming information is determined by the cloud server based on the first page and the operation event; The display component is configured to process the streaming information to control the display of a second page corresponding to the streaming information, specifically including: Determining a display component interface corresponding to the display component; calling the display component through the display component interface to process the streaming information through the display component to obtain a second page; Displaying the second page on a display screen of the electronic device; Obtaining streaming information corresponding to the operation event from the cloud server through the connection component includes: Sending the operation event to the cloud server by calling a network component through the connection component, wherein the network component is arranged in the chip or the network component is arranged outside the chip; Calling the network component through the connection component to receive the streaming information sent by the cloud server; Before displaying the first page of the cloud application through the display component, the method further includes: obtaining, through the control component, an identifier and connection parameters of the cloud application; Calling a network component through the connection component to send a network connection request to the cloud server, wherein the network connection request includes an identifier and connection parameters of the cloud application; The connection component calls the network component to receive the network connection response sent by the cloud server, so as to establish a network connection with the cloud server.
5. An electronic device, characterized in that: The device comprises a display screen and a chip, wherein the chip comprises an interactive component, a connection component, a display component and a control component, wherein the control component is linked to the connection component, the display component and the interactive component respectively, and the control component is used to control the operation of the connection component, the display component and the interactive component; wherein, The display component is used to control the display of the first page of the cloud application on the display screen; The interaction component is used to obtain an operation event on the first page from the peripheral hardware corresponding to the electronic device; The connection component is used to obtain streaming information corresponding to the operation event from the cloud server, where the streaming information is determined by the cloud server based on the first page and the operation event; The display component is configured to process the streaming information to control display of a second page corresponding to the streaming information on the display screen, specifically including: Determining a display component interface corresponding to the display component; calling the display component through the display component interface to process the streaming information through the display component to obtain a second page; Displaying the second page on a display screen of the electronic device; Obtaining streaming information corresponding to the operation event from the cloud server through the connection component includes: Sending the operation event to the cloud server by calling a network component through the connection component, wherein the network component is arranged in the chip or the network component is arranged outside the chip; Calling the network component through the connection component to receive the streaming information sent by the cloud server; Before displaying the first page of the cloud application through the display component, the method further includes: obtaining, through the control component, an identifier and connection parameters of the cloud application; Calling a network component through the connection component to send a network connection request to the cloud server, wherein the network connection request includes an identifier and connection parameters of the cloud application; The connection component calls the network component to receive the network connection response sent by the cloud server, so as to establish a network connection with the cloud server.
6. The electronic device according to claim 5, characterized in that The electronic device further includes at least one of an image processing device, a network component, peripheral hardware, and a peripheral bus, wherein: The chip is connected to the image processing device and the network component respectively; The chip is also connected to the peripheral hardware via the peripheral bus.
7. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the cloud application processing method according to any one of claims 1 to 3.
8. A computer program product, comprising a computer program, which, when executed by a processor, implements the cloud application processing method according to any one of claims 1 to 3.
Citation Information
Patent Citations
Browser-based cloud gaming
US20170354878A1
Method and apparatus for performing client side latency enhancement with aid of cloud game server side image orientation control
US20200376375A1