Data processing

Abstract

Provided in the embodiments of the present disclosure are a data processing method, a computing device, a computer storage medium, and a computer program product. The data processing method is applied to a server at which a target cloud side application is deployed. The method comprises: acquiring a start instruction sent by a first client; transmitting application content of a target cloud side application to the first client; acquiring behavior data from the first client, wherein the behavior data is generated by the first client in response to at least one interaction behavior operation executed on the application content; and in response to the start instruction, storing the behavior data until an end instruction sent by the first client is obtained. The technical solution provided in the embodiments of the present disclosure ensures the validity of behavior data.

Description

[0001] Data processing technology field

[0002]

[0001] The present disclosure relates to the field of data processing technology, and more particularly to data processing.

[0003]

[0002] In the related art, there are some recording software that can record the interactive behavior operations performed by users on applications through the mouse or keyboard, so that the behavior data generated by the recording can be played back, so that these interactive behavior operations can be automatically performed on the application based on the behavior data without the need for user participation.

[0004]

[0003] In the process of implementing the concepts of the present disclosure, the inventors discovered that the same application may have some differences in different operating environments. For example, in two different resolution modes, 1080p (a video resolution standard, referring to a video with an image height of 1080 pixels) and 4K (a high-resolution video standard, referring to a video with a minimum horizontal pixel count of 3840 pixels and a minimum vertical pixel count of 2160 pixels), the interface layout of the same application may be different. Behavior data is generated based on the coordinates of the interactive behavior operations reflected in the interface. In this case, once the operating environment changes, the behavior data recorded and generated using the recording software may become invalid, resulting in unusability. SUMMARY OF THE INVENTION

[0005]

[0004] The embodiments of the present disclosure provide a data processing method, apparatus, computing device, computer storage medium, and computer program product.

[0006]

[0005] In a first aspect, an embodiment of the present disclosure provides a data processing method, which is applied to a server on which a target cloud instance application is deployed, and the method includes: obtaining a start instruction sent by a first client; transmitting application content of the target cloud instance application to the first client; obtaining behavior data from the first client, wherein the behavior data is generated by the first client in response to at least one interactive behavior operation performed on the application content; and in response to the start instruction, saving the behavior data until an end instruction sent by the first client is obtained.

[0007]

[0006] In a second aspect, an embodiment of the present disclosure provides a data processing method, which is applied to a first client, and the method includes: sending a start instruction to a server; obtaining application content of a target cloud application sent by the server, and outputting the application content; generating behavior data based on at least one interactive behavior operation performed on the application content, and sending the behavior data to the server; the start instruction is used to instruct the server to save the behavior data; and sending an end instruction to the server, wherein the end instruction is used to instruct the server to end the operation of saving the behavior data.

[0008]

[0007] In a third aspect, an embodiment of the present disclosure provides a data processing device, which can be applied to a server on which a target cloud application is deployed. The data processing device includes: an instruction acquisition module, used to acquire a start instruction sent by a first client; a content transmission module, used to transmit the application content of the target cloud application to the first client; a data acquisition module, used to acquire behavior data from the first client, wherein the behavior data is generated by the first client in response to at least one interactive behavior operation performed on the application content; a storage module, used to save the behavior data in response to the start instruction until an end instruction sent by the first client is obtained.

[0008] In a fourth aspect, an embodiment of the present disclosure provides a data processing device, which can be applied to a first client. The data processing device may include: an instruction sending module, which is used to send a start instruction to a server; a content acquisition module, which is used to acquire application content of a target cloud application sent by the server and output the application content; a behavior data generation module, which is used to generate behavior data based on at least one interactive behavior operation performed on the application content, and send the behavior data to the server; a start instruction is used to instruct the server to save the behavior data; an end instruction sending module, which is used to send an end instruction to the server, and the end instruction is used to instruct the server to end the behavior data saving operation.

[0009]

[0009] In a fifth aspect, an embodiment of the present disclosure provides a computing device, comprising a processing component and a storage component; the storage component stores one or more computer instructions; the one or more computer instructions are used to be called and executed by the processing component to implement the data processing method provided by the embodiment of the present disclosure.

[0010]

[0010] In a sixth aspect, an embodiment of the present disclosure provides a computer storage medium storing a computer program. When the computer program is executed by a computer, the data processing method provided by the embodiment of the present disclosure is implemented.

[0011]

[0011] In a seventh aspect, an embodiment of the present disclosure provides a computer program product, which includes a computer program code. When the computer program code is executed by a computer, the data processing method provided by the embodiment of the present disclosure is implemented.

[0012] In the disclosed embodiments, by cloudifying applications, a local first client is solely responsible for displaying the application content of a target cloud application, sensing user interactions with the application content, generating behavioral data, and transmitting the behavioral data to a server, which then stores the behavioral data. Because the cloud application is deployed on the server, the server can provide a unified operating environment. Thus, the application content displayed by the first client is not affected by the local operating environment, ensuring the stability of the operating environment and the validity of the behavioral data.

[0013]

[0013] These and other aspects of the present disclosure will become more readily apparent in the following description of the embodiments.

[0014]

[0014] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or related technologies, the following briefly introduces the drawings required for use in the embodiments or related technology descriptions. Obviously, the drawings described below are some embodiments of the present disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0015]

[0015] FIG1a schematically shows a flow chart of a data processing method provided by one embodiment of the present disclosure;

[0016]

[0016] FIG1b schematically shows a schematic diagram of a cloud computing system provided by an embodiment of the present disclosure;

[0017] FIG2 schematically shows a schematic diagram of a data processing method provided by an embodiment of the present disclosure;

[0018] FIG3 schematically shows a schematic diagram of a data processing method provided by an embodiment of the present disclosure;

[0019] FIG4 schematically shows a user interface according to an embodiment of the present disclosure;

[0020]

[0020] FIG5 schematically shows a flow chart of a data processing method provided by another embodiment of the present disclosure;

[0021] FIG6 schematically shows a block diagram of a data processing device provided by one embodiment of the present disclosure;

[0022] FIG7 schematically shows a block diagram of a data processing device provided by another embodiment of the present disclosure;

[0023] FIG8 schematically shows a block diagram of a computing device provided by an embodiment of the present disclosure.

[0023]

[0024] In order to enable those skilled in the art to better understand the solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present disclosure.

[0024]

[0025] Some processes described in the specification and claims of this disclosure, as well as in the aforementioned figures, include multiple operations that appear in a specific order. However, it should be understood that these operations may be executed out of the order in which they appear herein or in parallel. Operation numbers, such as 101 and 102, are merely used to distinguish between different operations and do not represent any specific order of execution. Furthermore, these processes may include more or fewer operations, and these operations may be executed sequentially or in parallel. It should be noted that terms such as "first" and "second" are used herein to distinguish between different messages, devices, modules, etc., and do not imply a sequential order, nor do they limit "first" and "second" to different types.

[0025]

[0026] The technical solutions of the embodiments of the present disclosure can be applied to scenarios where user interaction operations when using an application (English: Application, abbreviated: App) are recorded and corresponding processing is performed based on the recorded behavior data. The interaction operations can be implemented based on mouse clicks, keyboard input, voice control, touch, etc.

[0026]

[0027] As can be seen from the description of the background technology, the current method of using recording software to record interactive behavior operations may cause the recorded behavior data to become invalid once the operating environment changes, making it unusable. In addition, the recording software also relies on the local operating environment, and the generated behavior data cannot be migrated, making standardized batch deployment impossible.

[0027]

[0028] To ensure the validity of behavior data, the inventors developed the technical solution of the present disclosure after extensive research. In this embodiment, by cloudifying applications, the local instance's first client is solely responsible for displaying the target cloud instance's application content, detecting user interactions with the application content, generating behavior data, and transmitting this data to the server, which then stores it. Because the cloud instance application is deployed on the server, the server provides a unified runtime environment. Therefore, the application content displayed by the first client is unaffected by the local runtime environment, ensuring the stability of the runtime environment and the validity of the behavior data.

[0028]

[0029] The target cloud instance application referred to in the embodiments of the present disclosure is a cloud computing service provided by a cloud computing provider, which is used to achieve terminal device slimming. Program products that originally ran on the terminal and primarily relied on the terminal's computing power are now implemented by cloud instance products configured on the server. The target cloud instance application referred to in the embodiments of the present disclosure can be a cloud application installed directly on the server, or an application installed in a cloud desktop deployed on the server.

[0029]

[0030] Cloud computing is one of the fastest-growing trends in computer technology. It involves providing hosted services over the internet. Cloud computing environments offer computing and storage resources as services to end users. End users can request processing from the provided services. The processing capacity of the services is typically limited by the configured resources.

[0030]

[0031] Cloud computing is a service delivery model that enables on-demand network access to a shared pool of configurable computing resources (e.g., networks, network bandwidth, servers, processing, memory, storage, applications, virtual machines, and services) that can be rapidly provisioned and released with minimal management effort or interaction with the service provider.

[0031]

[0032] Among them, cloud desktop, also known as desktop virtualization or cloud computer, is a new model that replaces traditional computers. After adopting cloud desktop, users no longer need to purchase a computer host. The CPU (processor), memory, hard disk and other components contained in the host are all virtualized in the back-end server. The terminal device can use a thin client (also known as the host side) to connect to the monitor, keyboard and / or mouse. After the user installs the thin client, the user accesses the cloud desktop on the server through a unique communication protocol to realize interactive operations, achieving the same experience as a computer. At the same time, cloud desktop not only supports the replacement of traditional computers, but also supports other smart devices such as mobile phones and tablets to access on the Internet. It is the latest solution for mobile office.

[0032]

[0033] Cloud applications are the embodiment of cloud computing technology at the application layer. Compared with locally installed applications, cloud applications have advantages such as no need for downloading and installation, ready-to-use, low device capability requirements, and cross-platform compatibility. Cloud applications stream generated application content to terminal devices in real time. Terminal devices only need to display the application content to achieve the purpose of smooth use of cloud applications. Interactions between users and terminal devices are also handled by cloud applications.

[0033]

[0034] In cloud computing, the term "user" in this article refers to a tenant. Users can purchase resources from a cloud computing provider to build cloud applications that meet their needs. Users register accounts with the provider, and the provider uses these accounts to distinguish between different users.

[0034]

[0035] It should be noted that the embodiments of the present disclosure may involve the use of user data. In actual applications, user-specific personal data may be used in the solutions described herein within the scope permitted by applicable laws and regulations of the country in which the use is carried out (for example, with the user's explicit consent, effective notification to the user, etc.).

[0035]

[0036] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions, and corresponding operation portals are provided for users to choose to authorize or refuse.

[0036]

[0037] The following will provide a clear and complete description of the technical solutions in the embodiments of the present disclosure, in conjunction with the accompanying drawings. Obviously, the described embodiments are only some of the embodiments of the present disclosure, and are not exhaustive. All other embodiments derived by those skilled in the art based on the embodiments of the present disclosure without inventive effort are intended to fall within the scope of protection of the present disclosure.

[0037]

[0038] FIG1a schematically illustrates a flow chart of a data processing method provided by an embodiment of the present disclosure. This data processing method can be executed by a server deployed with a target cloud application. In practical applications, the technical solutions of the embodiments of the present disclosure can be applied to a cloud computing system including the server. As shown in FIG1b , the cloud computing system can include a server 10 and a terminal 20. The server 10 can be implemented as a distributed server cluster consisting of multiple servers or as a single server. The server can also be a server in a distributed system or a server integrated with blockchain. The server can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), big data and artificial intelligence platforms, or an intelligent cloud computing server or intelligent cloud host equipped with artificial intelligence technology, although this disclosure does not limit this. The terminal 20 is located in the local area 1 and may refer to a local device used by a user and having the computing, Internet access, communication, and other functions required by the user. It may be various electronic devices with a display screen and supporting web browsing, including but not limited to smartphones, tablet computers, e-book readers, MP3 players (Moving Picture Experts Group, Audio Layer III), MP4 players (Moving Picture Experts Group 4), laptop computers, desktop computers, and the like.

[0038]

[0039] Users can use terminals 20 to connect to server 10 via wired or wireless means. They can be physically or virtually grouped in one or more networks, such as private, community, public, or hybrid clouds, or a combination thereof. This allows cloud computing systems to provide infrastructure, platforms, and / or software as services, without requiring users to maintain resources on their terminals.

[0039]

[0040] The terminal 20 may be configured with a local client corresponding to the cloud application / cloud desktop, i.e., a thin client, which has only basic computing, processing, input and output capabilities, and can connect to the cloud application / cloud desktop and display multimedia content generated by the cloud application or cloud desktop.

[0040]

[0041] The server 10 can deploy one or more cloud applications / cloud desktops and provide an operating system on which the cloud applications / cloud desktops depend. The deployed cloud applications / cloud desktops can connect to multiple local clients.

[0041]

[0042] As shown in FIG. 1a, the data processing method may specifically include the following steps.

[0042]

[0043] 101: Obtain a start instruction sent by a first client.

[0043]

[0044] In an embodiment of the present disclosure, the first client may be deployed in the above-mentioned terminal. When the target cloud instance application is an application deployed in a cloud desktop, the first client may refer to a local client corresponding to the cloud desktop.

[0044]

[0045] The first client may be connected to the server via a network protocol, such as HTTP (Hypertext Transfer Protocol), HTTPS (HTTP Secure), TCP / IP (Transmission Control Protocol / Internet Protocol), WebSocket (a full-duplex communication protocol), etc.

[0045]

[0046] The start instruction may be generated and sent to the server based on a user operation. The start instruction may be used to instruct the server to perform a recording operation to ensure behavioral data. For example, the start instruction may be sent to the server as a specific request to trigger the server to execute corresponding recording logic.

[0046]

[0047] The first client can call an API (Application Programming Interface) provided by the server to send a request with an indication parameter to the server. After receiving the request, the server can start recording according to the indication parameter.

[0047]

[0048] 102: Transmit the application content of the target cloud instance application to the first client.

[0048]

[0049] The server can provide a unified operating environment for the target cloud instance application. The operating environment can include resolution, initial state, application version, application startup parameters, etc. The target cloud instance application can be uniformly operated, maintained and managed by the server.

[0049]

[0050] In an embodiment of the present disclosure, the server may start the target cloud application after receiving the start instruction sent by the first client, and transmit the application content of the target cloud application to the first client, so that the first client can display the application content.

[0050]

[0051] Alternatively, after receiving a launch instruction from the first client, the server may launch the target cloud instance application and transmit the target cloud instance application's application content to the first client. The launch instruction may be generated by the first client in response to a start instruction or based on a selection operation for a target cloud instance application, which is not limited in this disclosure. A user may request, through the first client, that one or more cloud instance applications be deployed on the server. The first client may provide selection prompts corresponding to the multiple cloud instance applications, allowing the user to select a target cloud instance application, thereby triggering the launch of the target cloud instance application.

[0051]

[0052] The application content may include an application interface. The first client may display the application interface using a display screen provided by the terminal. The user may perform interactive operations on the application interface through mouse clicks, keyboard input, voice control, touch, etc., to achieve human-computer interaction.

[0052]

[0053] In an optional embodiment, the first client may have a pre-set binding relationship with the target cloud instance application, that is, after receiving the start instruction sent by the first client, the server can directly use the pre-set binding relationship to determine the target cloud instance application corresponding to the first client without the need for specification by the first client, and transmit the application content of the target cloud instance application to the first client.

[0053]

[0054] In another optional embodiment, the server may run multiple cloud rule applications, each with its own identification information. The start instruction may carry the application identification information of the desired cloud rule application. Therefore, upon receiving the start instruction, the server may parse the start instruction, obtain the application identification information carried in the start instruction, and identify the cloud rule application that matches the application identification information as the target cloud rule application. The server then transmits the application content of the target cloud rule application to the first client.

[0054]

[0055] In one possible implementation of the present disclosure, the application content of the target cloud instance may be transmitted to the first client using a streaming transmission protocol.

[0055]

[0056] In addition, in addition to including the application interface, the application content can also be used to transmit other streaming media data, such as sound.

[0056]

[0057] 103: Obtain behavior data from the first client.

[0057]

[0058] The behavior data is generated by the first client in response to at least one interactive behavior operation performed on the application content.

[0058]

[0059] Interactive behavior operations can refer to various operations and interactions between users and application content, including clicking, scrolling, input, selection, etc. These operations can be recorded and processed in different ways.

[0059]

[0060] In the first client, the user's interactive behavior operations can be captured by detecting the user's interactive events. For example, mouse events, keyboard events, touch events, etc. are detected, and corresponding records or processing are performed when the user performs interactive behavior operations such as clicks and inputs.

[0060]

[0061] In one possible implementation, JavaScript (a programming language) can be used to process interactive behaviors. By embedding JavaScript code in the first client, user interactive behaviors can be captured. For example, by binding a button click event, when a user clicks the button, the corresponding event processing function is triggered, and the corresponding recording logic is executed in the function.

[0061]

[0062] In an embodiment of the present disclosure, the behavior data may be a result obtained by recording the user's interactive behavior operations.

[0062]

[0063] When users interact with app content, relevant data is captured and recorded, forming behavioral data. This behavioral data can include information such as click coordinates, number of clicks, dwell time, browsing path, and input content.

[0064] The behavior data may be recorded by the first client and sent to the server.

[0063]

[0065] 104: In response to the start instruction, save the behavior data until receiving the end instruction sent by the first client.

[0064]

[0066] Users usually desire to record a series of interactive behavior operations with application content. This series of interactive behavior operations may start with a start instruction and end with an end instruction.

[0065]

[0067] After receiving the start instruction, the server may store the received behavior data, and end the storage of the behavior data when receiving the end instruction sent by the first client.

[0066]

[0068] The end instruction can be generated based on the user operation and sent to the server.

[0067]

[0069] In the disclosed embodiments, by cloud-hosting applications and transmitting the application content to a first client when a user needs to record their behavior, users can interact with the application content displayed on the first client, generating behavioral data. This behavioral data is then transmitted to a server for recording. Because the application runs on the server, the server provides a unified operating environment for the application. As a result, the application content displayed on the first client is not affected by the hardware parameters of the terminal running the first client, ensuring the stability of the operating environment and the validity of the behavioral data.

[0068]

[0070] In some embodiments, in response to a start instruction, saving the behavior data until obtaining an end instruction sent by the first client can be implemented as follows: in response to the start instruction, based on the behavior data, executing at least one interactive behavior operation corresponding to the behavior data on the cloud application; capturing at least one interactive behavior operation to generate behavior data and recording it in the memory; and in response to the end instruction sent by the first client, persistently storing the behavior data recorded in the memory.

[0069]

[0071] In the embodiments of the present disclosure, interactive behavior operations may refer to various operations and interactions performed by a user with application content, including clicking, scrolling, inputting, selecting, etc. Behavior data may be the result obtained by recording the user's interactive behavior operations.

[0070]

[0072] Therefore, after receiving the behavior data, the server can restore the interactive behavior operations corresponding to the behavior data through the behavior data, and replay these interactive behavior operations for the cloud rule application on the server.

[0071]

[0073] During the replay of interactive behavior operations for cloud application, these interactive behavior operations can be recorded on the server side and the corresponding behavior data can be generated again.

[0072]

[0074] Before the user's behavior recording process ends, the generated behavior data can be temporarily stored in the cache, and after the behavior recording ends, that is, after receiving the end instruction, the behavior data stored in the memory is persistently stored.

[0073]

[0075] In some embodiments, based on the behavior data, executing at least one interactive behavior operation corresponding to the behavior data on the cloud instance application can be implemented by injecting the behavior data into the cloud instance operating system to execute at least one interactive behavior operation corresponding to the behavior data on the cloud instance application.

[0074]

[0076] Among them, the Yunjia 1 operating system can refer to the operating system provided by the server. The Yunjia 1 operating system can be used to support the operation of the Yunjia 1 application and provide resources for the operation of the Yunjia 1 application. The resources may include computing resources, storage resources, network resources, etc.

[0075]

[0077] After injecting the behavior data into the Yunjia 1 operating system, the Yunjia 1 operating system can automatically perform corresponding interactive behavior operations based on the behavior data, such as launching applications, clicking, scrolling, inputting, selecting, etc.

[0078] Capturing at least one interactive behavior operation to generate behavior data and record it in the memory may include: using a hook technology to capture the interactive behavior operation to generate behavior data and record it in the memory.

[0076]

[0079] Hooking technology can be an operating system programming technique used to intercept, modify, and process events and messages within the operating system. Hooking technology can inject code into the operating system to respond to specific system events and messages. In embodiments of the present disclosure, hooking technology can be used to intercept interactive behavior operations performed by the cloud operating system using behavior data injected into the operating system.

[0077]

[0080] For ease of understanding, FIG2 schematically shows a schematic diagram of scene interaction in a practical application of the present disclosure.

[0078]

[0081] The server 201 and the first client 202 can communicate based on a streaming protocol. The server 201 can receive a startup instruction sent by the first client 202 and start the target cloud instance application 203. The first client 202 can also send a start instruction to the server 201.

[0079]

[0082] After the server 201 starts the target cloud instance application 203 , the server 201 may transmit the application content of the target cloud instance application 203 to the first client 202 using a streaming protocol.

[0080]

[0083] The first client 202 may detect a series of interactive behavior operations performed by the user on the application content, such as interactive behavior operations triggered by mouse clicks or keyboard inputs.

[0081]

[0084] The first client 202 may record user interaction operations to generate behavior data, and send the behavior data to the server 201 .

[0082]

[0085] The server 201 may deploy a message forwarding unit 2001 and a user behavior capturing unit 2002. The message forwarding unit 2001 and the user behavior capturing unit 2002 may be pre-configured code programs to implement corresponding operations.

[0083]

[0086] Among them, the message forwarding unit 2001 can receive the behavior data sent by the first client 202 and inject the received behavior data into the cloud rule operating system.

[0084]

[0087] The user behavior capturing unit 2002 can utilize hook technology to intercept interactive behavior operations of the Yunjia 1 operating system, capture corresponding user input, generate behavior data, and save it in memory.

[0085]

[0088] Furthermore, after receiving the end instruction, the behavior data stored in the memory can be stored in the network storage system 204. As can be seen from the foregoing description, transmitting the application content of the target cloud instance application to the first client can be specifically implemented as follows: in response to a start instruction sent by the first client, starting the target cloud instance application; the start instruction is generated based on a selection operation on the target cloud instance application; and transmitting the application content of the target cloud instance application to the first client.

[0086]

[0089] In an embodiment of the present disclosure, multiple cloud rule applications may be running on the server, each with its own identification information. A start instruction may carry the application identification information of the desired cloud rule application. Therefore, upon receiving the start instruction, the server may parse the start instruction, obtain the application identification information carried in the start instruction, and identify the cloud rule application that matches the application identification information as the target cloud rule application. The server then transmits the application content of the target cloud rule application to the first client.

[0087]

[0090] In a possible implementation of the present disclosure, the first client may display selection prompt information of one or more cloud instance applications, and the user may trigger a selection operation on a target cloud instance application based on the selection prompt information.

[0088]

[0091] After the selection operation is completed, the application identification information of the cloud instance application selected by the selection operation can be determined, and then the application identification information can be written into the startup instruction.

[0089]

[0092] In some embodiments, the method may further include: obtaining an installation program uploaded by the first client; and installing the cloud instance application based on the installation program.

[0090]

[0093] The installer may refer to a package file used to install the cloud example application in the cloud example operating system. The installer may include an installation wizard that can be used to complete the cloud example application installation process, including steps such as file copying and registry settings. The installer may be provided by a user and uploaded to the server via the first client.

[0091]

[0094] After receiving the installer, the server can check whether it matches the Yunjia1 operating system. For example, the software and hardware configuration of the Yunjia1 operating system meet the software installation requirements. If the installer matches the Yunjia1 operating system, the Yunjia1 application installation operation can be executed.

[0092]

[0095] In the disclosed embodiment, the user only needs to provide an installation program to install any application for which the user desires to record behavior data on the server, thereby achieving the goal of cloud-based application. With the help of cloud computing technology, a stable operating environment can be provided for the application, and the goal of preserving behavior data can be achieved to ensure the validity of the behavior data.

[0093]

[0096] In a practical application, the technical solutions of the embodiments of the present disclosure can be applied to a process orchestration scenario, where a first client is a client that implements process orchestration. In some embodiments, in response to a start instruction, saving behavior data until receiving an end instruction sent by the first client can be specifically implemented as follows: in response to the start instruction, generating process orchestration information based on at least one interactive behavior operation corresponding to the behavior data; in response to the end instruction sent by the first client, sending the process orchestration information to the first client for displaying the process orchestration information; and in response to a confirmation operation on the process orchestration information, saving the process orchestration information.

[0094]

[0097] The process arrangement information may be used to represent an operation process composed of at least one interactive behavior operation. If multiple interactive behavior operations have a sequence, the process arrangement information may sort the multiple interactive behavior operations according to the sequence.

[0095]

[0098] When the first client sends the end instruction, it indicates that all the operation processes that the user wishes to record have been completed. At this time, the server can send the generated process arrangement information to the first client and display the process arrangement information on the first client, so that the user can confirm the accuracy of the server's behavior recording based on the process arrangement information.

[0096]

[0099] When the process orchestration information is consistent with the operation performed by the user, the user can perform a confirmation operation on the process orchestration information, so that the server can perform persistent storage of the process orchestration information.

[0097]

[0100] The process arrangement information may include at least one process control corresponding to each interactive behavior operation.

[0098]

[0101] In some embodiments, the method may further include: updating the process orchestration information in response to an update request for the process orchestration information.

[0099]

[0102] The update request is generated by the first client based on an update operation on the process orchestration information. In embodiments of the present disclosure, the first client may also provide a manual orchestration function. The first client may provide multiple process controls, allowing users to perform operations such as adding, deleting, and replacing process controls on the process orchestration information, as well as changing the order of operations on the process controls.

[0100]

[0103] The process orchestration information can be used to replay the at least one interactive behavior operation or to prompt other users about the at least one interactive behavior operation. Therefore, as an optional approach, the method may further include: when sending the application content of the target cloud instance application to the second client, generating operation prompt information corresponding to the at least one interactive behavior operation based on the process orchestration information, and sending the operation prompt information to the second client.

[0101]

[0104] In the embodiment of the present disclosure, the second client may be the same client as the first client, but is not limited thereto. The second client may also be another client different from the first client.

[0102]

[0105] When the second client is a client different from the first client, sending the application content of the target cloud application to the second client means that the pre-generated process orchestration information can be used to provide operation prompts for other users for operations on the target cloud application, thereby helping other users to use the cloud application simply and efficiently.

[0103]

[0106] In an embodiment of the present disclosure, the process orchestration information may record multiple interactive actions in a sequential order. Therefore, upon detecting that a user has performed an interactive action, the next interactive action immediately preceding the interactive action may be searched for in the process orchestration information. The next interactive action to be performed may then be displayed on the second client as an operation prompt, thereby reminding the user of the next interactive action to be performed.

[0104]

[0107] For example, when the application interface of the target cloud application is a login interface, the process orchestration information can be: 1. Click the account input box; 2. Enter the account; 3. Click the password input box; 4. Enter the password; 5. Click the login button.

[0105]

[0108] The above five interactive behavior operations may be sequentially sent as operation prompt information to the second client.

[0106]

[0109] For example, in the initial state where the user has not performed any interactive operations, step 1, clicking the account input box, can be used as an operation prompt to guide the user to click the account input box in the application interface. After detecting that the user has clicked the account input box, step 2, entering the account number, can be used as an operation prompt to guide the user to enter the account number in the account input box. This process can be repeated in this way until all operations are completed.

[0107]

[0110] FIG3 schematically shows a diagram of a data processing method provided by an embodiment of the present disclosure.

[0108]

[0111] Figure 3 shows the target cloud application interface. The process flow information can be: 1. Click the account input box; 2. Enter the account; 3. Click the password input box; 4. Enter the password; 5. Click the login button.

[0109]

[0112] For example, in Figure 3, the user has completed the second step, which is to enter the account number. According to the process arrangement information, the next step should be 3. Click the password input box.

[0110]

[0113] In this case, the operation prompt information "Please click the password input box" can be displayed in the application interface. Furthermore, the position of the password input box in the application interface can be highlighted, emphasized, etc. to prompt the user.

[0111]

[0114] As another optional manner, the method may further include: when the application content of the target cloud instance application is sent to the second client, performing at least one interactive behavior operation on the application content according to the process orchestration information.

[0112]

[0115] In the embodiment of the present disclosure, the second client may be the same client as the first client, but is not limited thereto. The second client may also be another client different from the first client.

[0113]

[0116] In the case where the second client is the same client as the first client, after the application content of the first cloud application is sent to the second client, the second client can obtain the process orchestration information and automatically execute the operations included in the process orchestration information to achieve replay of the operation behavior.

[0114]

[0117] In one embodiment of the present disclosure, in operations related to input, the server may also record the input content corresponding to the input operation, and automatically fill the input content into the input box when input is required, so as to simplify user operations.

[0115]

[0118] In some embodiments, persistently storing the behavior data recorded in the memory may be specifically implemented by saving the behavior data to a network storage system or sending the behavior data to the first client for local storage by the first client.

[0116]

[0119] As shown in FIG. 2 , the user behavior capturing unit 2002 in the server 201 may store the behavior data stored in the memory into the network storage system 204 .

[0117]

[0120] According to an embodiment of the present disclosure, the target cloud instance application may be a cloud application installed in the server, and the method may further include: sending the user interface to the first client, so that the first client displays the user interface.

[0118]

[0121] The start instruction may be generated in response to a start trigger operation executed on the user interface; the end instruction may be generated in response to an end trigger operation executed on the user interface; and the application interface in the application content is used to be displayed on the user interface.

[0119]

[0122] As can be seen from the foregoing description, the first client may provide multiple process controls in the user interface; wherein the start instruction may be generated based on a selection operation on the start control, and the end instruction may be generated based on a selection operation on the end control.

[0120]

[0123] Optionally, the user interface may include an orchestration area and a display area; the process orchestration information may include a process control corresponding to at least one interactive behavior operation; the orchestration area is used to display the process control corresponding to at least one interactive behavior operation; and the display area is used to display application content and perceive at least one interactive behavior operation.

[0121]

[0124] FIG4 schematically illustrates a user interface provided by an embodiment of the present disclosure. As shown in FIG4 , the user interface may include an arrangement area 401 and a display area 402.

[0122]

[0125] The arrangement area 401 may include at least one process control, which is generated by sensing the user's operation in the display area 402.

[0123]

[0126] In FIG4 , the flow controls may include, for example, Click 1, Click 2, Input 1, Click 3, Input 2, and Click 4. Click 1, Click 2, and Click 3 may be generated by clicking any location in display area 402, respectively. For example, Click 1 may be generated by clicking the coordinates (963, 579) of display area 402, Click 2 may be generated by clicking the coordinates (1266, 479) of display area 402, and Click 3 may be generated by clicking the coordinates (1261, 556) of display area 402. Input 1 may be generated by entering "1234," and Input 2 may be generated by entering "hhhh."

[0124]

[0127] According to an embodiment of the present disclosure, the server is deployed with a cloud desktop, the target cloud instance application may be installed in the cloud desktop, and third-party recording software may also be installed in the cloud desktop. The method may further include: transmitting an operation interface of the third-party recording software to the first client.

[0125]

[0128] The start instruction may be generated by the first client in response to a recording start operation executed on the operation interface. The end instruction may be generated by the first client in response to a recording end operation executed on the operation interface.

[0126]

[0129] The third-party recording software may be pre-installed in the cloud desktop at the user's request. Therefore, in some embodiments, the method may further include: obtaining a first installation program of the third-party recording software uploaded by the first client; and installing the third-party recording software based on the first installation program.

[0127]

[0130] Users can install third-party recording software on the server in advance. Third-party recording software can run on the server.

[0128]

[0131] The first client may send a launch request for the third-party recording software to the server. The launch request may be used to request the server to launch the third-party recording software and transmit its corresponding operation interface to the first client. Optionally, after the third-party recording software is installed in the cloud desktop, a desktop icon for the third-party recording software may be provided in the user interface of the cloud desktop. The launch request for the third-party recording software may be generated by the first client in response to a launch operation, such as a click, triggered by the desktop icon for the third-party recording software.

[0129]

[0132] In addition, the target cloud instance application can also be pre-installed in the cloud desktop by user request. Therefore, in some embodiments, the method can also include: obtaining a second installation program of the target cloud instance application uploaded by the first client; and installing the target cloud instance application in the cloud desktop based on the second installation program.

[0130]

[0133] After the target cloud rule application is installed in the cloud desktop, a desktop icon of the target cloud rule application may be provided in the user interface of the cloud desktop. The start operation triggered by the desktop icon of the target cloud rule application may start the target cloud rule application.

[0131]

[0134] In an embodiment of the present disclosure, the server may transmit the operating interface of the third-party recording software to the first client using a streaming media transmission protocol.

[0132]

[0135] In the operation interface of the third-party recording software, a recording start control may be displayed, and the user may trigger the recording start control to execute the recording start operation.

[0133]

[0136] In response to the start instruction, saving the behavior data until receiving the end instruction sent by the first client includes: in response to the start instruction, calling third-party recording software to save the behavior data until receiving the end instruction from the first client; the end instruction is generated by the first client in response to the recording end operation performed on the operation interface.

[0134]

[0137] FIG5 schematically illustrates a flow chart of a data processing method provided by another embodiment of the present disclosure. This data processing method can be applied to a first client. In practical applications, the technical solutions of this embodiment of the present disclosure can be applied to a cloud computing system including the server. As shown in FIG1b , the cloud computing system can include a server 10 and a terminal 20. The server 10 can be implemented as a distributed server cluster consisting of multiple servers, or as a single server. The server can also be a server in a distributed system or a server integrated with blockchain. The server can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms, or an intelligent cloud computing server or intelligent cloud host equipped with artificial intelligence technology, although this disclosure does not limit this. The terminal 20 is located in the local area 1 and may refer to a local device used by a user and having the computing, Internet access, communication, and other functions required by the user. It may be various electronic devices with a display screen and supporting web browsing, including but not limited to smartphones, tablet computers, e-book readers, MP3 players (Moving Picture Experts Group Audio Layer III), MP4 players (Moving Picture Experts Group Audio Layer IV), laptop computers, desktop computers, and the like.

[0135]

[0138] Users can use terminals 20 to connect to server 10 via wired or wireless means. They can be physically or virtually grouped in one or more networks, such as private, community, public, or hybrid clouds, or a combination thereof. This allows cloud computing systems to provide infrastructure, platforms, and / or software as services, without requiring users to maintain resources on their terminals.

[0136]

[0139] The terminal 20 may be configured with a local client corresponding to the cloud application / cloud desktop, i.e., a thin client, which has only basic computing, processing, input and output capabilities, and can connect to the cloud application / cloud desktop and display multimedia content generated by the cloud application or cloud desktop.

[0137]

[0140] The server 10 can deploy one or more cloud applications / cloud desktops and provide an operating system on which the cloud applications / cloud desktops depend. The deployed cloud applications / cloud desktops can connect to multiple local clients.

[0138]

[0141] As shown in FIG5 , the data processing method may specifically include the following steps.

[0139]

[0142] 501: Send a start command to the server.

[0140]

[0143] 502: Obtain the application content of the target cloud instance application sent by the server and output the application content.

[0141]

[0144] 503: Based on at least one interactive behavior operation performed on the application content, generate behavior data, and send the behavior data to the server. The start instruction is used to instruct the server to save the behavior data.

[0142]

[0145] 504: Send an end instruction to the server, which is used to instruct the server to end the operation of saving the behavior data.

[0143]

[0146] In an embodiment of the present disclosure, the first client may be deployed in the above-mentioned terminal. When the target cloud instance application is an application deployed in a cloud desktop, the first client may refer to a local client corresponding to the cloud desktop.

[0144]

[0147] The first client may be connected to the server via a network protocol, such as HTTP (Hypertext Transfer Protocol), HTTPS (HTTP Secure), TCP / IP (Transmission Control Protocol / Internet Protocol), WebSocket (a full-duplex communication protocol), etc.

[0145]

[0148] The start instruction may be generated and sent to the server based on a user operation. The start instruction may be used to instruct the server to perform a recording operation to ensure behavioral data. For example, the start instruction may be sent to the server as a specific request to trigger the server to execute corresponding recording logic.

[0146]

[0149] The first client can call an API (Application Programming Interface) provided by the server to send a request with an indication parameter to the server. After receiving the request, the server can start recording according to the indication parameter.

[0147]

[0150] The server provides a unified runtime environment for the target cloud instance application. This runtime environment can include resolution, initial state, application version, and application startup parameters. The target cloud instance application can be centrally operated, maintained, and managed by the server.

[0148]

[0151] In an embodiment of the present disclosure, the server may start the target cloud application after receiving the start instruction sent by the first client, and transmit the application content of the target cloud application to the first client, so that the first client can display the application content.

[0149]

[0152] Alternatively, after receiving a launch instruction from the first client, the server may launch the target cloud instance application and transmit the target cloud instance application's application content to the first client. The launch instruction may be generated by the first client in response to a start instruction or based on a selection operation for the target cloud instance application, which is not limited in this disclosure. A user may request, through the first client, that one or more cloud instance applications be deployed on the server. The first client may provide selection prompts corresponding to the multiple cloud instance applications, allowing the user to select a target cloud instance application, thereby triggering the launch of the target cloud instance application.

[0150]

[0153] The application content may include an application interface. The first client may display the application interface using a display screen provided by the terminal. The user may perform interactive operations on the application interface through mouse clicks, keyboard input, voice control, touch, etc., to achieve human-computer interaction.

[0151]

[0154] In an optional embodiment, the first client may have a pre-set binding relationship with the target cloud instance application, that is, after receiving the start instruction sent by the first client, the server can directly use the pre-set binding relationship to determine the target cloud instance application corresponding to the first client without the need for the first client to specify, and transmit the application content of the target cloud instance application to the first client.

[0152]

[0155] In another optional embodiment, the server may run multiple cloud rule applications, each with its own identification information. The start instruction may carry the application identification information of the desired cloud rule application. Therefore, upon receiving the start instruction, the server may parse the start instruction, obtain the application identification information carried in the start instruction, and identify the cloud rule application that matches the application identification information as the target cloud rule application. The server then transmits the application content of the target cloud rule application to the first client.

[0153]

[0156] In one possible implementation of the present disclosure, the application content of the target cloud instance may be transmitted to the first client using a streaming transmission protocol.

[0154]

[0157] In addition, in addition to including the application interface, the application content can also be used to transmit other streaming media data, such as sound.

[0155]

[0158] The behavior data is generated by the first client in response to at least one interactive behavior operation performed on the application content.

[0156]

[0159] Interactive behavior operations can refer to various operations and interactions between users and application content, including clicking, scrolling, input, selection, etc. These operations can be recorded and processed in different ways.

[0157]

[0160] In the first client, the user's interactive behavior operations can be captured by detecting user interaction events. For example, mouse events, keyboard events, touch events, etc. are detected, and corresponding records or processing are performed when the user performs interactive behavior operations such as clicks and inputs.

[0158]

[0161] In one possible implementation, JavaScript (a programming language) can be used to process interactive behaviors. By embedding JavaScript code in the first client, user interactive behaviors can be captured. For example, by binding a button click event, when a user clicks the button, a corresponding event processing function is triggered, and the corresponding recording logic is executed in the function.

[0159]

[0162] In an embodiment of the present disclosure, the behavior data may be a result obtained by recording the user's interactive behavior operations.

[0160]

[0163] When users interact with app content, relevant data is captured and recorded, forming behavioral data. This behavioral data can include information such as click coordinates, number of clicks, dwell time, browsing path, and input content.

[0161]

[0164] The behavior data may be recorded by the first client and sent to the server.

[0165] Users usually desire to record a series of interactive behavior operations with application content. This series of interactive behavior operations may start with a start instruction and end with an end instruction.

[0162]

[0166] After receiving the start instruction, the server may store the received behavior data, and end the storage of the behavior data when receiving the end instruction sent by the first client.

[0163]

[0167] The end instruction can be generated based on the user operation and sent to the server.

[0164]

[0168] In the disclosed embodiments, by cloud-hosting applications and transmitting the application content to a first client when a user needs to record their behavior, users can interact with the application content displayed on the first client, generating behavioral data. This behavioral data is then transmitted to a server for recording. Because the application runs on the server, the server provides a unified operating environment for the application. As a result, the application content displayed on the first client is not affected by the hardware parameters of the terminal running the first client, ensuring the stability of the operating environment and the validity of the behavioral data.

[0165]

[0169] In some embodiments, the data processing method may further include: providing multiple process controls in a user interface; generating a start instruction based on a selection operation on a start control; displaying process orchestration information generated based on the behavior data in the user interface; the process orchestration information including at least one process control corresponding to each interactive behavior operation; generating an end instruction based on a selection operation on an end control; and sending a save instruction to a server in response to a confirmation operation triggered by the user, wherein the save instruction is used to instruct the server to save the process orchestration information.

[0166]

[0170] In some embodiments, the data processing method further includes: updating the process orchestration information in response to an add operation and / or a delete operation on the process control.

[0167]

[0171] In some embodiments, the application content includes an application interface, and the user interface includes an editing area and a display area.

[0168]

[0172] In some embodiments, outputting the application content may be specifically implemented by displaying the application interface in the display area.

[0169]

[0173] In some embodiments, the process orchestration information generated based on the behavior data is displayed in the user interface; and the process orchestration information is displayed in the orchestration area.

[0170]

[0174] The process arrangement information may be used to represent an operation process composed of at least one interactive behavior operation. If multiple interactive behavior operations have a sequence, the process arrangement information may sort the multiple interactive behavior operations according to the sequence.

[0171]

[0175] In some embodiments, the first client is a local client corresponding to the cloud desktop, and the target cloud application and third-party recording software are installed in the cloud desktop. The sending of a start instruction to the server can be specifically implemented as follows: displaying the operation interface of the third-party recording software; detecting a recording start operation performed on the operation interface, and sending a start instruction to the server; the sending of an end instruction to the server includes: detecting a recording end operation performed on the operation interface, and sending an end instruction to the server, so that the server responds to the start instruction and calls the third-party recording software to save the behavior data until the end instruction is obtained.

[0172]

[0176] Users can install third-party recording software on the server in advance. Third-party recording software can run on the server.

[0173]

[0177] The first client may send a launch request for the third-party recording software to the server. The launch request may be used to request the server to launch the third-party recording software and transmit its corresponding operation interface to the first client. Optionally, after the third-party recording software is installed in the cloud desktop, a desktop icon for the third-party recording software may be provided in the user interface of the cloud desktop. The launch request for the third-party recording software may be generated by the first client in response to a launch operation, such as a click, triggered by the desktop icon for the third-party recording software.

[0174]

[0178] In an embodiment of the present disclosure, the server may transmit the operating interface of the third-party recording software to the first client using a streaming media transmission protocol.

[0175]

[0179] In the operation interface of the third-party recording software, a recording start control may be displayed, and the user may trigger the recording start control to execute the recording start operation.

[0176]

[0180] In response to the start instruction, saving the behavior data until receiving the end instruction sent by the first client includes: in response to the start instruction, calling third-party recording software to save the behavior data until receiving the end instruction from the first client; the end instruction is generated by the first client in response to the recording end operation performed on the operation interface.

[0177]

[0181] Figure 6 schematically shows a block diagram of a data processing device provided by an embodiment of the present disclosure. The data processing device 600 can be applied to a server on which a target cloud application is deployed. The data processing device 600 includes: an instruction acquisition module 601, for acquiring a start instruction sent by a first client; a content transmission module 602, for transmitting the application content of the target cloud application to the first client; a data acquisition module 603, for acquiring behavior data from the first client, wherein the behavior data is generated by the first client in response to at least one interactive behavior operation performed on the application content; a storage module 604, for saving the behavior data in response to the start instruction until an end instruction sent by the first client is obtained.

[0178]

[0182] In some embodiments, the storage module 604 includes: an execution submodule, which is used to respond to a start instruction and, based on the behavior data, perform at least one interactive behavior operation corresponding to the behavior data on the target cloud 1 application; a capture submodule, which is used to capture at least one interactive behavior operation to generate behavior data and record it in the memory; and a storage submodule, which is used to respond to an end instruction sent by the first client and persistently store the behavior data recorded in the memory.

[0179]

[0183] In some embodiments, the execution submodule includes: a data injection unit, configured to inject behavior data into the cloud instance operating system to implement at least one interactive behavior operation corresponding to the behavior data for executing the target cloud instance application.

[0180]

[0184] In some embodiments, the capture submodule includes: a capture unit, configured to capture interactive behavior operations using a hooking technique to generate behavior data and record the data into a memory.

[0181]

[0185] In some embodiments, the interface transmission module 602 includes: an application startup submodule, which is used to start the cloud rule application in response to a startup instruction sent by the first client; the startup instruction is generated according to a selection operation for the cloud rule application; and a transmission submodule, which is used to transmit the application content of the cloud rule application to the first client.

[0182]

[0186] In some embodiments, the data processing device 600 further includes: an installation program acquisition module, configured to acquire an installation program uploaded by the first client; and an application installation module, configured to install a target cloud application based on the installation program.

[0183]

[0187] In some embodiments, the storage module 604 includes: an orchestration information generation submodule, configured to generate process orchestration information in response to a start instruction and based on at least one interactive behavior operation corresponding to the behavior data; an orchestration information sending submodule, configured to send the process orchestration information to the first client in response to an end instruction sent by the first client, so that the first client can display the process orchestration information; and an orchestration information storage submodule, configured to save the process orchestration information in response to a confirmation operation on the process orchestration information.

[0184]

[0188] In some embodiments, the data processing apparatus 600 further includes: a first updating module, configured to update the process orchestration information in response to an update operation on the process orchestration information.

[0185]

[0189] In some embodiments, the data processing device 600 further includes: a prompt information processing module configured to generate operation prompt information corresponding to at least one interactive behavior operation according to process arrangement information when sending the application content of the target cloud application to the second client, and send the operation prompt information to the second client.

[0186]

[0190] In some embodiments, the data processing device 600 further includes: an execution module configured to execute at least one interactive behavior operation on the application content according to the process orchestration information when the application content of the target cloud application is sent to the second client.

[0187]

[0191] In some embodiments, the storage submodule includes: a storage unit, configured to save the behavior data to a network storage system or send the behavior data to the first client for local storage by the first client.

[0188]

[0192] In some embodiments, the target cloud instance application is a target cloud application installed in the server.

[0189]

[0193] In some embodiments, the data processing device 600 further includes: a user interface sending module, configured to send the user interface to the first client so that the first client can display the user interface; a start instruction is generated in response to a start trigger operation performed on the user interface; an end instruction is generated in response to an end trigger operation performed on the user interface; and application content is used to be displayed on the user interface.

[0190]

[0194] In some embodiments, a cloud desktop is deployed on the server, a target cloud recording application is installed in the cloud desktop, and third-party recording software is installed in the cloud desktop.

[0191]

[0195] In some embodiments, the data processing device 600 further includes: an operation interface transmission module, configured to transmit the operation interface of the third-party recording software to the first client; and the start instruction is generated by the first client in response to a recording start operation executed on the operation interface.

[0192]

[0196] In some embodiments, the storage module 604 includes: a saving unit, configured to, in response to a start instruction, call a third-party recording software to save the behavior data until receiving an end instruction from the first client; the end instruction is generated by the first client in response to a recording end operation executed on the operation interface.

[0193]

[0197] The data processing device of FIG6 can execute the data processing method of the embodiment shown in FIG1a. Its implementation principles and technical effects are not further described. The specific manner in which the various modules and units of the data processing device in the above-described embodiment perform operations has been described in detail in the embodiment related to the method and will not be further elaborated here.

[0194]

[0198] Figure 7 schematically shows a block diagram of a data processing device provided by another embodiment of the present disclosure. The data processing device 700 can be applied to the first client. As shown in Figure 7, the data processing device 700 may include: an instruction sending module 701, used to send a start instruction to the server; a content acquisition module 702, used to acquire the application content of the target Yunjia 1 application sent by the server, and output the application content; a behavior data generation module 703, used to generate behavior data based on at least one interactive behavior operation performed on the application content, and send the behavior data to the server; the start instruction is used to instruct the server to save the behavior data; the end instruction sending module 704, used to send an end instruction to the server, and the end instruction is used to instruct the server to end the behavior data saving operation.

[0195]

[0199] In some embodiments, the data processing device 700 further includes: a control providing unit, configured to provide a plurality of process controls on a user interface; a start instruction generating unit, configured to generate a start instruction based on a selection operation on the start control; an information display module, configured to display process orchestration information generated based on the behavior data on the user interface; the process orchestration information includes at least one process control corresponding to each interactive behavior operation; an end instruction generating unit, configured to generate an end instruction based on a selection operation on the end control; and a save instruction sending unit, configured to send a save instruction to a server based on a confirmation operation triggered by a user, wherein the save instruction is used to instruct the server to save the process orchestration information.

[0196]

[0200] In some embodiments, the data processing device 700 further includes: a second updating module, configured to update the process orchestration information in response to an add operation and / or a delete operation on the process control.

[0197]

[0201] In some embodiments, the application content includes an application interface, and the user interface includes an editing area and a display area.

[0198]

[0202] In some embodiments, the interface acquisition module 702 includes: an interface display unit, configured to display the application interface in the display area; display process orchestration information generated based on the behavior data in the user interface; and display the process orchestration information in the orchestration area.

[0199]

[0203] In some embodiments, the first client is a local client corresponding to the cloud desktop, and the cloud desktop has a target cloud application and a third-party recording software installed therein.

[0200]

[0204] In some embodiments, the instruction sending module 701 includes: a third-party interface display unit, configured to display the operation interface of the third-party recording software; and an instruction sending unit, configured to detect a recording start operation executed on the operation interface and send a start instruction to the server.

[0201]

[0205] In some embodiments, the end instruction sending module 704 includes: an end instruction sending unit, configured to detect a recording end operation performed on the operation interface, and send an end instruction to the server, so that the server can respond to the start instruction and call the third-party recording software to save the behavior data until the end instruction is obtained.

[0202]

[0206] The data processing device of FIG. 7 can execute the data processing method of the embodiment shown in FIG. 5 , and its implementation principles and technical effects are not further described. The specific manner in which the various modules and units of the data processing device in the above-described embodiment perform operations has been described in detail in the embodiment related to the method and will not be further elaborated here.

[0203]

[0207] In one possible design, the data processing apparatus provided in the embodiments of the present disclosure may be implemented as a computing device. As shown in FIG8 , the computing device may include a storage component 801 and a processing component 802. The storage component 801 stores one or more computer instructions, wherein the one or more computer instructions are invoked and executed by the processing component 802 to implement the data processing method provided in the embodiments of the present disclosure.

[0204]

[0208] Of course, a computing device may also include other components, such as input / output interfaces and communication components. The input / output interface provides an interface between the processing component and peripheral interface modules, which may be output devices, input devices, etc. The communication component is configured to facilitate wired or wireless communication between the computing device and other devices.

[0205]

[0209] The computing device may be a physical device or an elastic computing host provided by a cloud computing platform. In this case, the computing device may refer to a cloud server, and the processing components, storage components, etc. may be basic server resources rented or purchased from the cloud computing platform.

[0206]

[0210] When the computing device is a physical device, it can be implemented as a distributed cluster consisting of multiple servers or terminal devices, or as a single server or a single terminal device.

[0207]

[0211] The embodiments of the present disclosure further provide a computer-readable storage medium storing a computer program. When the computer program is executed by a computer, the data processing method provided by the embodiments of the present disclosure can be implemented.

[0208]

[0212] The embodiments of the present disclosure further provide a computer program product, including a computer program. When the computer program is executed by a computer, the data processing method provided by the embodiments of the present disclosure can be implemented.

[0209]

[0213] The processing components in the above embodiments may include one or more processors to execute computer instructions to complete all or part of the steps in the above methods. Of course, the processing components may also be implemented as one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0210]

[0214] The storage component is configured to store various types of data to support operations in the device. The storage component can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM).

[0211] (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0212]

[0215] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0213]

[0216] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units. That is, they may be located in one place or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of the solutions in this embodiment. Persons of ordinary skill in the art can understand and implement the solutions without inventive effort.

[0214]

[0217] Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented using software plus a necessary general-purpose hardware platform, or alternatively, hardware. Based on this understanding, the essence of the above technical solution, or the portion that contributes to the relevant art, can be embodied in the form of a software product. This software product can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, or an optical disk, and includes instructions for enabling a computer device (such as a personal computer, server, or network device) to execute the methods described in each embodiment or portions thereof.

[0215]

[0218] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present disclosure, rather than to limit them. Although the present disclosure has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some of the technical features therein with equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present disclosure.

Claims

Claims 1. A data processing method, applied to a server on which a target cloud application is deployed, comprising: Obtaining a start instruction sent by the first client; Transmitting the application content of the target cloud instance application to the first client; Obtaining behavior data from the first client, wherein the behavior data is generated by the first client in response to at least one interactive behavior operation performed on the application content; and in response to the start instruction, saving the behavior data until receiving an end instruction sent by the first client.

2. The method according to claim 1, wherein: The transmitting of the application content of the target cloud instance application to the first client includes: starting the target cloud instance application in response to a startup instruction sent by the first client; the startup instruction is generated according to a selection operation for the target cloud instance application; and transmitting the application content of the target cloud instance application to the first client.

3. The method according to claim 2, further comprising: Obtaining the installation program uploaded by the first client; Based on the installation program, the target cloud instance application is installed.

4. The method according to claim 1, wherein: The step of saving the behavior data in response to the start instruction until receiving an end instruction sent by the first client includes: generating process orchestration information according to at least one interactive behavior operation corresponding to the behavior data in response to the start instruction; sending the process orchestration information to the first client in response to the end instruction sent by the first client, so that the first client can display the process orchestration information; and saving the process orchestration information in response to a confirmation operation on the process orchestration information.

5. The method according to claim 4, further comprising: When the application content of the target cloud instance application is sent to the second client, operation prompt information corresponding to the at least one interactive behavior operation is generated according to the process arrangement information, and the operation prompt information is sent to the second client; Alternatively, when the application content of the target cloud instance application is sent to the second client, the at least one interactive behavior operation for the application content is performed according to the process orchestration information.

6. The method according to claim 1, wherein: The application content includes an application interface; the target cloud instance application is a cloud application installed in the server; the method also includes: sending the user interface to the first client so that the first client can display the user interface; the start instruction is generated in response to a start trigger operation performed on the user interface; the end instruction is generated in response to an end trigger operation performed on the user interface; the application interface is used to be displayed on the user interface.

7. The method according to claim 1, wherein: The server is deployed with a cloud desktop, the target cloud instance application is installed in the cloud desktop, and third-party recording software is installed in the cloud desktop; The method further includes: transmitting an operation interface of the third-party recording software to a first client; generating the start instruction by the first client in response to a recording start operation executed on the operation interface; The step of saving the behavior data in response to the start instruction until obtaining the end instruction sent by the first client includes: in response to the start instruction, calling the third-party recording software to save the behavior data until obtaining the end instruction from the first client; the end instruction is generated by the first client in response to the recording end operation performed on the operation interface.

8. The method according to claim 1, wherein: The step of saving the behavior data in response to the start instruction until obtaining the end instruction sent by the first client includes: in response to the start instruction, executing the at least one interactive behavior operation corresponding to the behavior data on the target cloud rule application according to the behavior data; capturing the at least one interactive behavior operation to generate the behavior data and recording it in the memory; and in response to the end instruction sent by the first client, persistently storing the behavior data recorded in the memory.

9. A data processing method, applied to a first client, comprising: Send a start command to the server; Obtaining the application content of the target cloud instance application sent by the server, and outputting the application content; generating behavior data based on at least one interactive behavior operation performed on the application content, and sending the behavior data to the server; the start instruction is used to instruct the server to save the behavior data; Send an end instruction to the server, where the end instruction is used to instruct the server to end the saving operation of the behavior data.

10. The method according to claim 9, further comprising: Provide multiple process controls in the user interface; Based on the selection operation on the start control, generating the start instruction; Displaying process orchestration information generated based on the behavior data in the user interface; The process orchestration information includes process controls corresponding to the at least one interactive behavior operation; generating the end instruction based on a selection operation on the end control; and sending a save instruction to the server according to a confirmation operation triggered by the user, wherein the save instruction is used to instruct to save the process orchestration information.

11. The method according to claim 10, further comprising: In response to an add operation and / or a delete operation on the process control, the process orchestration information is updated.

12. The method according to claim 10, wherein: The application content includes an application interface, and the user interface includes an arrangement area and a display area; Outputting the application content includes: displaying the application interface in the display area; displaying process orchestration information generated based on the behavior data in the user interface; and displaying the process orchestration information in the orchestration area.

13. The method according to claim 12, wherein: The first client is a local client corresponding to a cloud desktop, and the cloud desktop has a target cloud application and third-party recording software installed therein. The sending of a start instruction to the server includes: displaying an operation interface of the third-party recording software; detecting a recording start operation executed on the operation interface, and sending a start instruction to the server; The sending of the end instruction to the server includes: detecting a recording end operation performed on the operation interface, sending an end instruction to the server, so that the server responds to the start instruction and calls the third-party recording software to save the behavior data until the end instruction is obtained.

14. A computing device comprising a processing component and a storage component; wherein: The storage component stores one or more computer instructions; the one or more computer instructions are used to be called and executed by the processing component to implement the data processing method according to any one of claims 1 to 8, or to implement the data processing method according to any one of claims 9 to 13.

15. A computer storage medium storing a computer program, wherein: When the computer program is executed by a computer, the data processing method according to any one of claims 1 to 8 or the data processing method according to any one of claims 9 to 13 is implemented.

16. A computer program product, wherein: The computer program product includes computer program code, and when the computer program code is executed by a computer, the computer program product implements the data processing method according to any one of claims 1 to 8, or executes the data processing method according to any one of claims 9 to 13.

Images