Display control method and client device

Abstract

The invention discloses a display control method and user side equipment, and the method at least comprises the steps: responding to an obtained target task, and monitoring the execution state of the target task; and controlling the user side equipment to display a target interaction interface matched with the execution state so as to present a processing process of the target task, wherein the target interaction interface comprises a virtual image of the client device and at least one processing device in the target device group, and the client device belongs to or does not belong to the target device group; in different execution states, display parameters of the virtual image in the corresponding interactive interface are different.

Description

Technical Field

[0001] The present application relates to the field of display control technology, and is related to but not limited to display control methods and user terminal devices. Background Art

[0002] With the rapid development of computer technology, the demand for interactivity of applications is becoming increasingly higher.

[0003] In related technologies, during communication and interaction, the interactive interface is usually beautified to enhance the fun of interaction and make the interaction process more entertaining.

[0004] However, simply beautifying the interactive interface cannot create an immersive and realistic experience, and the user experience is low. Summary of the Invention

[0005] The embodiments of the present application provide a display control method and a user terminal device. The technical solution of the present application is implemented as follows:

[0006] In a first aspect, the present application provides a display control method, comprising:

[0007] In response to obtaining the target task, monitoring the execution status of the target task;

[0008] Control the user terminal device to display the target interactive interface that matches the execution state to present the processing process of the target task;

[0009] The target interaction interface includes a virtual image of the user terminal device and at least one processing device in the target device group, and the user terminal device may belong to or not belong to the target device group;

[0010] In different execution states, the display parameters of the virtual image in the corresponding interactive interface are different.

[0011] In a second aspect, the present application provides a display control device, comprising:

[0012] a monitoring unit, configured to monitor an execution status of the target task in response to obtaining the target task;

[0013] A control unit, configured to control the user terminal device to display a target interactive interface that matches the execution state, so as to present the processing process of the target task;

[0014] The target interaction interface includes a virtual image of the user terminal device and at least one processing device in the target device group, and the user terminal device may belong to or not belong to the target device group;

[0015] In different execution states, the display parameters of the virtual image in the corresponding interactive interface are different.

[0016] In a third aspect, the present application provides a user terminal device comprising at least one processor and at least one processing model capable of running on the processor, wherein the processing model can be called by a target application to perform at least one of the following operations:

[0017] In response to obtaining the target task, monitoring the execution status of the target task;

[0018] Display the target interactive interface that matches the execution status to present the processing process of the target task;

[0019] The target interaction interface includes a virtual image of a user terminal device and at least one processing device in a target device group, and the user terminal device may or may not belong to the target device group; in different execution states, the display parameters of the virtual image in the corresponding interaction interface are different.

[0020] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the method provided in the first aspect is implemented.

[0021] In a fifth aspect, the present application provides a computer program product, which includes a computer program. When the computer program is executed by a processor, it implements the method provided in the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 A schematic diagram of a first optional flow chart of the display control method provided in an embodiment of the present application;

[0023] Figure 2 A second optional flow chart of the display control method provided in the embodiment of the present application;

[0024] Figure 3 A third optional flow chart of the display control method provided in the embodiment of the present application;

[0025] Figure 4A A fourth optional flow chart of the display control method provided in the embodiment of the present application;

[0026] Figure 4B An optional schematic diagram of the interactive interface switching process provided in an embodiment of the present application;

[0027] Figure 5 A fifth optional flow chart of the display control method provided in the embodiment of the present application;

[0028] Figure 6 An optional schematic diagram of a download interface provided in an embodiment of the present application;

[0029] Figure 7An optional schematic diagram of the initial login interface provided in an embodiment of the present application;

[0030] Figure 8 An optional schematic diagram of the login guide interface provided in an embodiment of the present application;

[0031] Figure 9 An optional schematic diagram of the main interface before interaction provided in an embodiment of the present application;

[0032] Figure 10 An optional schematic diagram of adding a device entry interface to the main interface provided in an embodiment of the present application;

[0033] Figure 11 An optional schematic diagram of an interface for viewing device details provided in an embodiment of the present application;

[0034] Figure 12 An optional schematic diagram of the interactive process interface provided in the embodiment of the present application;

[0035] Figure 13 An optional schematic diagram of the raw image completion interface provided in an embodiment of the present application;

[0036] Figure 14 An optional schematic diagram of a large image viewing interface provided in an embodiment of the present application;

[0037] Figure 15 A schematic diagram of an optional structure of the display control device provided in an embodiment of the present application;

[0038] Figure 16 This is a schematic diagram of an optional structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0039] To make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the specific technical solutions of the application will be further described in detail below in conjunction with the drawings in the embodiments of the present application. The following embodiments are used to illustrate the present application but are not intended to limit the scope of the present application.

[0040] In the following description, reference is made to “some embodiments”, which describes a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.

[0041] In the following description, the terms "first, second, and third" are used merely as examples to distinguish between different objects and do not represent a specific order or precedence for the objects. It is understood that the specific order or precedence of "first, second, and third" can be interchanged where permitted, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described herein.

[0042] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which this application pertains. The terms used herein are for the purpose of describing the embodiments of this application only and are not intended to limit this application.

[0043] The embodiments of the present application may provide a display control method, apparatus, device, storage medium, and computer program product. In practical applications, the display control method may be implemented by a display control apparatus, and the functional entities in the display control apparatus may be collaboratively implemented by hardware resources of the electronic device, such as computing resources such as a processor, and communication resources (e.g., for supporting various communication methods such as optical cables and cellular communications).

[0044] In a first aspect, an embodiment of the present application provides a display control method, which is applied to a user terminal device.

[0045] The present application embodiment does not limit the specific type of user terminal device, and can be configured according to actual needs. For example, the user terminal device may include but is not limited to any of the following: a mobile phone, a tablet computer, a smart wearable device (such as a smart watch, smart glasses, etc.) or a computer, etc.

[0046] refer to Figure 1 The display control method may include but is not limited to Figure 1 S101 and S102 shown.

[0047] S101 : In response to obtaining a target task, monitoring the execution status of the target task.

[0048] The target task is a task triggered on the user device based on a specific operation or meeting a specific condition. The embodiment of the present application does not limit the type of target task and can be configured according to actual needs. For example, the target task can be any of the following: a task of generating an image, a task of generating text, or a task of generating a video, a task of image processing, a task of making a presentation (PowerPoint, PPT), a task of summarizing a summary, a task of beautifying an image, etc.

[0049] The embodiment of the present application does not limit the method for obtaining the target task, and can be configured according to actual needs. In one possible implementation, the target task can be obtained based on the user's specific operation on the user-end device, voice command input, etc. For example, for a mobile phone raw image application, after the user opens the raw image application, he enters "generate a picture of a grassland" in the input box of the raw image application. In response to this input, the user-end device obtains a raw image task.

[0050] The execution status of the target task may include at least one of the following: the status of establishing a communication connection between the user terminal device and other processing devices, the issuance status of the target task, the processing status of the target task, the transmission status of the processing result, and the display status of the processing result.

[0051] The execution status of the target task may also include: adjusting the association relationship between devices (between the user terminal and other devices, or between multiple other devices), task status changes caused by changes in device operating status, or target task completion, etc.

[0052] S101 can be implemented as follows: in response to obtaining the target task, the user terminal device monitors the execution status of the target task and obtains various execution statuses during the execution of the target task. Here, the execution status can be actively reported by the target processing device or periodically obtained by the user device.

[0053] S102: Control the user terminal device to display a target interactive interface that matches the execution state to present the processing process of the target task.

[0054] The user-end device is the device that triggers the target task. The user-end device here may or may not be the device that executes the target task. That is, the user device may or may not have artificial intelligence (AI) processing capabilities. If the user-end device does not have AI processing capabilities or cannot provide AI services, it will only issue the target task and display the task processing results.

[0055] There is no limit on the number of execution states and target interactive interfaces, and they can be configured according to actual needs. In the case of multiple execution states, each execution state has a corresponding target interactive interface. The interactive interfaces corresponding to different execution states can be the same or different.

[0056] The target interaction interface includes a virtual image of the user terminal device and at least one processing device in the target device group, and the user terminal device may belong to or not belong to the target device group;

[0057] The target interactive interface is an interactive interface that matches the execution status of the target task. Here, as the target task is processed, the corresponding execution status will change, and the interactive objects and their display parameters in the corresponding interactive interface will also change accordingly.

[0058] The target interactive interface can present the target task processing process in real time. However, the user can choose to switch the application to the background, or after the user opens a new application, the interactive interface can be overwritten, that is, overwriting the target interactive interface.

[0059] The target device group refers to a cluster of devices that have AI processing capabilities and can perform target tasks, which can be managed by the user-end device or the first device in the group.

[0060] The embodiment of the present application does not limit the type of target device group and can be determined based on actual circumstances. For example, the target device group can be a group consisting of other artificial intelligence (AI) processing devices in the home environment where the user terminal device is located. For example, in a home environment, multiple mobile phones, tablets, desktop computers, etc. connected via a home wireless network constitute a target device group.

[0061] The target device group may also be a group of other devices in an office environment. For example, in an office environment, multiple computers and servers connected via the office's local area network constitute a target device group.

[0062] The target device group may also be a group of cloud processing devices in a specific network environment. For example, the target device group may also be a group of multiple cloud processing devices.

[0063] The present embodiment of the present application does not limit the number of processing devices included in the target device group, and can be configured according to actual needs. The processing devices herein can be fixed devices that have been added. Of course, the processing devices in the target device group can also be managed (added, deleted, modified, etc.) according to actual circumstances.

[0064] The target device group includes at least one processing device, including: a device that triggers the generation of the target task (user-end device) and a device that provides computing power to execute the computing task (AI device). It may also include other devices in the network (capable of executing the target task, but may currently be in a non-working state or not selected to process the target task).

[0065] The embodiments of this application do not limit the virtual image of the processing device and can be configured according to actual needs. For example, the virtual image of the processing device can be a planet, an image of the device's appearance, etc. The target interactive interface can also include a dynamic background. For example, it can include a dynamic background such as a nebula in the universe where the planet is located.

[0066] The virtual image representing the user terminal device or processing device may be similar to or different from the appearance of the device.

[0067] The user-end device can be an AI device that provides computing power, or an ordinary device that does not provide computing power.

[0068] When the user is an AI device, the user terminal device belongs to the target device group; when the user terminal device is a non-AI device, it may not belong to the target device group.

[0069] In different execution states, the display parameters of the virtual images of the user terminal device and the processing devices in the target device group in the corresponding interactive interface are different.

[0070] For example, in different execution states, the display size, position layout, display state, display theme and other parameters of the virtual images of the user terminal device and the processing device that jointly processes the target task may be different.

[0071] S102 can be implemented as follows: when the execution status changes, control the user-end device to display the target interaction interface that matches the execution status (display size, position layout, display status, display theme, and other display parameters of the virtual image of the user-end device and the processing device that collaboratively processes the target task). As the target task is processed, the corresponding execution status will be updated, and the target interaction interface will be updated accordingly, thereby presenting the processing process of the target task in real time.

[0072] A display control method provided by an embodiment of the present application includes: in response to obtaining a target task, monitoring the execution status of the target task; controlling a user-end device to display a target interaction interface matching the execution status to present the processing process of the target task; wherein the target interaction interface includes a virtual image of the user-end device and at least one processing device in a target device group, and the user-end device belongs to or does not belong to the target device group; under different execution states, the display parameters of the virtual image in the corresponding interaction interface are different.

[0073] It can be seen that in this embodiment, on the one hand, the method can display the processing process of the target task through the target interaction interface, so that the user can clearly and intuitively perceive the various stages of the target task processing, thereby improving the user experience; on the other hand, the target interaction interface can also present a virtual image of at least one processing device in the target device group, that is, the user can also perceive the devices in the target device group used to execute the target task, further improving the user experience.

[0074] The display control method provided by this embodiment is described below through Example 1.

[0075] Example 1: Assume the user's end device is a mobile phone at home. The phone is connected to the home Wi-Fi network, along with a tablet and two computers. This means the target device cluster for the home Wi-Fi network includes the phone, tablet, and two computers. The user's phone does not have any image generation applications or processing models installed, but does have an application installed that allows for shared AI computing power.

[0076] First, the user clicks on the icon of the application for sharing AI computing power to enter the initial interactive interface, which includes: the virtual image of the mobile phone (planet) and background animation.

[0077] Next, the user enters "Generate a picture of a grassland" into the app's input box, obtaining the target task (generating a grassland image). The phone then establishes a communication connection with a tablet or computer on the home network, sending the target task to two computers in the target device cluster group on the home WiFi network for processing. The corresponding interactive interface changes from the task transmission state to the task processing state. In this task processing state, a dynamic background animation plays, simulating the task processing process, and the virtual images of the two computers are displayed simultaneously, indicating that the two computers are executing the target task (generating a grassland image).

[0078] Next, the raw image is completed and the interactive interface of the raw image is presented. The interactive interface of the raw image completion includes a picture of a grassland and the raw image equipment (two virtual images of computers).

[0079] It can be seen that in this raw image application, different target interaction interfaces correspond to the processing process of the target task under different execution states, allowing users to perceive the processing process of the target task intuitively and immersively through the display of the target interaction interface, and the user experience is good.

[0080] In another embodiment, reference Figure 2 The display control method may include but is not limited to Figure 2 S201 to S204 shown.

[0081] S201: After establishing a first connection with a first device, obtain device information of each processing device in a target device group where the first device is located.

[0082] The first device is a device that manages the target device group. For example, the first device can be a host on the public network, or any server on the public network.

[0083] The user terminal device establishes a first connection with the first device, that is, the user logs in to the first device (public network host) through the user terminal device (mobile phone or tablet (pad)), that is, the user terminal device is connected to the public network host through the network.

[0084] The target device group where the first device is located is an intranet device group or cluster managed by the first device.

[0085] Each processing device in the target device group can also be called an intranet device, that is, an AI device that can provide AI functions or services.

[0086] The embodiment of the present application does not limit the type of device information of each processing device, and can be configured according to actual needs. For example, the device information may include: device identification, device network address, device configuration information, device load status, etc.

[0087] First, the user-end device needs to establish a connection with the first device (for example, by logging in), that is, the user-end device is connected to the public network host through the network. Since the first device is the device that manages the target device group, the device information of each processing device in the target device group where the first device is located can be obtained through the first device.

[0088] S202: Establish a second connection with a target processing device in the target device group based on the device information, and send the target task to the target processing device through the second connection.

[0089] The first connection is different from the second connection, and the user terminal device and the processing device are in the same network or different networks.

[0090] The first and second connections have different communication protocols. The first connection focuses on obtaining device information about processing devices in the target device group, while the second connection focuses on establishing a point-to-point communication connection with the target processing device in the target device group for data transmission, such as distributing target tasks or receiving feedback on task processing results.

[0091] The target processing device is the device in the target device group used to execute the target task. In addition to the target processing device, the target device group may also include other processing devices, which may be offline or busy. The present embodiment does not limit the specific method for determining the target processing device in the target device group, and configuration is possible based on actual needs.

[0092] For example, the target processing device can be determined based on the computing power requirements of the target task and the computing power resources of each processing device in the target device group. Here, if the computing power requirements of the target task are small, a suitable processing device is selected as the target processing device to prevent waste of computing power resources caused by selecting too much. If the computing power requirements of the target task are large, one or more processing devices in a ready state are selected as the target processing device after sorting them from largest to smallest in terms of remaining computing power.

[0093] The target processing device can be the AI ​​device with the strongest computing power, the least available resources, and the best network status in the target device group that is used to perform the target task. For example, the target processing device can be the first device.

[0094] The second connection between the user terminal device and the target processing device can be a peer-to-peer (P2P) network direct connection or a wireless fidelity direct connection (WiFi direct) connection established based on the device identification information or device network address information in the device information.

[0095] After the second connection with the target processing device is established, the target task may be directly sent to the target processing device based on the second connection.

[0096] Alternatively, the target task may be encrypted before being sent, and the encrypted target task may be sent to the target processing device. This can improve the privacy of user data, prevent tampering, and improve security.

[0097] Among them, the mobile phone or tablet operated by the user (user terminal device) can be in the same network as the AI ​​device used to perform the target processing task (target processing device), such as both are in the home network; or they can be in different network environments, such as the user using his own AI office computer at home, or the AI ​​server provided by the company.

[0098] S202 may be implemented as follows: first determining the target processing device based on the device information of each processing device in the target device group, then establishing a second connection between the user terminal device and the target processing device, and sending the target task or encrypted target task to the target processing device through the second connection.

[0099] S203 : In response to obtaining the target task, monitor the execution status of the target task.

[0100] The implementation of S203 may refer to the detailed description of monitoring the execution status of the target task in response to obtaining the target task in S101, which will not be described in detail here.

[0101] S204: Control the user terminal device to display a target interactive interface that matches the execution state to present the processing process of the target task.

[0102] The implementation of S204 may refer to the specific description of the process of controlling the user terminal device to display the target interactive interface matching the execution state in S102 to present the processing of the target task, which will not be repeated here.

[0103] In this embodiment, the user terminal device can send the target task to the target processing device in the target group so that the target task can be processed by the target processing device. In this way, the computing power of the target processing device can be shared to realize the processing of the target task, thereby improving the processing efficiency, and the determination method of the target group device can be configured according to actual needs, thereby achieving flexibility.

[0104] Based on Example 1, in Example 2, first, the user clicks on the icon of the raw image application or the AI ​​computing power sharing application to enter the initial interaction interface, which includes: the virtual image of the mobile phone (planet) and the background animation.

[0105] Secondly, the user logs in in the application and establishes a connection with the first device, thereby obtaining the device information of each device in the target device group where the first device is located. Correspondingly, the interactive interface becomes an interactive interface for establishing a connection, such as the establishment of a path between the two planets representing the user-end device and the target processing device in the interface to prepare for data transmission. In the interactive interface for establishing a connection, it includes: a virtual image (planet) of a mobile phone, as well as virtual images of a tablet and two computers (such as two planets and the data transmission path established between the two), and background animation. Among them, the two computers and the tablet are respectively connected to the planets of the mobile phone to present the connection relationship between the devices.

[0106] Secondly, the user enters "generate a picture of a grassland" in the input box of the application, and obtains the target task (generate a picture of a grassland). The user sends the target task to two computers in the target device cluster group where the home WiFi network is located through the mobile phone for processing (it can be sent to the two computers separately, or it can be sent to the first computer, and the first computer spontaneously assigns the task to the second computer). The corresponding interactive interface becomes the interactive interface for task issuance. In the interactive interface for task issuance, the background animation plays dynamically, and the connection between the mobile phone and the first computer and / or the second computer is highlighted or displayed in a breathing manner, indicating that the mobile phone is issuing the target task (generating a picture of a grassland) to at least one of the two computers.

[0107] After receiving the target task (generating a grassland image), the two computers proceed with the task, and the corresponding interactive interface changes to the task processing state. In this task processing state, a dynamic background animation plays, simulating the task processing process. Simultaneously, the avatars of the two computers breathe or flicker, indicating that the two computers are executing the target task (generating a grassland image).

[0108] Finally, the raw image is completed and the interactive interface of the raw image is presented. The interactive interface of the raw image completion includes a picture of a grassland and the raw image equipment (two virtual images of computers).

[0109] As can be seen, in this image generation application, different target interaction interfaces correspond to different execution states for the target task processing process, such as the initial interaction interface, the connection establishment interaction interface, the task dispatching interaction interface, the task processing interaction interface, and the image generation completion interaction interface. This allows users to intuitively and immersively perceive the various stages of the target task processing through the display of the target interaction interface, providing a good user experience.

[0110] The following describes the process of monitoring the execution status of the target task in S101 , which may include but is not limited to at least one of the following cases A1 to A5 .

[0111] Case A1: obtaining communication connection information between the user terminal device and the processing device in the target device group, and determining the execution status of the target task based on the communication connection information.

[0112] The processing device here may be the first device or a target processing device determined to execute the target task.

[0113] The status of the target task can be determined by the communication connection information between the user terminal device and the processing device. The communication connection information may include: information on establishing the connection (whether connected), operation information of the communication module (working status, ready status), communication connection status change information, etc.

[0114] In a possible implementation, if the connection establishment information indicates that the connection between the user terminal device and the processing device is successful, it can be determined that the task execution preparation state has been entered; if it indicates that the connection is not successfully established, it can be determined that the task is in the unexecuted state.

[0115] For example, based on the connection establishment information, it can be determined which processing device has established a P2P connection between the user terminal device and the processing device, and at this time, it can be determined that the target task has not yet entered the task execution state. For another example, based on the operation information of the communication module, it can be determined whether the target processing device is in the working state or the standby state; if it is in the working state, it is determined that the target task is in the task execution state; if it is in the standby state, it is determined that the target task has not yet entered the task execution state.

[0116] In case A1, the execution status of the target task can be determined based on the connection information. In this way, even if there is no task status feedback, the connection information can be used to assist in determining the execution status of the target task, which is simple and reliable to implement.

[0117] Case A2: obtaining transmission data between the user terminal device and the target processing device in the target device group, and determining the execution status of the target task based on the transmission data.

[0118] The embodiment of the present application does not limit the content of the transmitted data and can be configured according to actual needs. For example, the transmitted data may include but is not limited to at least one of the following: task content data, task processing result data, and device connection data.

[0119] For example, if the transmission data obtained between the user device and the target processing device is device connection data, it is determined to be in the device connection state; if the transmission data obtained between the user device and the target processing device is task content data, the task distribution state is determined; if the transmission data obtained between the user device and the target processing device is task result data, it is in the task result feedback state.

[0120] In this way, the execution status of the target task can be determined based on the data content or type of the transmitted data, and the status of each processing stage during the execution of the target task can be obtained, which has the characteristics of simple and convenient implementation.

[0121] Case A3: obtaining operation information of the user terminal device and / or the target processing device in the target device group, and determining the execution status of the target task based on the operation information.

[0122] The embodiment of the present application does not limit the specific type of operation information, and can be configured according to actual needs. The operation information of the target processing device may include one or more of the following: running application, running model, running processor, running power consumption, and running time.

[0123] The start time of the task can be determined based on the operating information of the user terminal device and / or the target processing device in the target device group, and the amount of task executed by the target processor can be determined according to the running processor and running time of the processing device, thereby inferring the execution progress of the target task.

[0124] Operation information also includes: changes in the operating status of the device, such as switching from off to on, or from on to off, etc., so as to determine whether a device has been added or whether a device is offline, and to re-evaluate the target task completion (execution progress) accordingly.

[0125] In case A3, the execution status of the target task is inferred based on the running information, which is simple and convenient to implement.

[0126] Case A4: obtaining the target user's operation data on the target interactive interface, and determining the execution status of the target task based on the operation data.

[0127] Target user refers to the user who performs operations on the user-end device.

[0128] The operation data acting on the target interactive interface can be user input tasks, such as input data for image generation tasks, operation data for adding processing equipment on the interactive interface, or data for configuring task execution status.

[0129] In this way, based on the operational data, it can be determined at which processing stage the target task is and which devices are processing it.

[0130] Case A5: Obtain task information of the target task and device information of the processing device that executes the target task, and determine the execution status of the target task based on the task information and the device information.

[0131] Task information may include: task content, amount of task data to be processed, etc. Device information may include: device configuration, idleness, processing capacity, etc.

[0132] Based on the device information, the processing efficiency (processing capacity) of the target processing device can be determined. Based on the task information, the data volume of the task to be processed can be determined, thereby inferring the processing progress of the task to be processed with this data volume at this processing efficiency, that is, the task completion degree can be determined.

[0133] In practice, one or more of the situations A1 to A5 can be selected according to specific needs to determine the execution status of the target task, so as to achieve flexibility and meet the needs of various scenarios.

[0134] In another embodiment, reference Figure 3 The display control method may include but is not limited to Figure 3 S301 to S304 shown.

[0135] S301 : In response to obtaining a target task, monitor the execution status of the target task.

[0136] The implementation of S301 may refer to the detailed description of monitoring the execution status of the target task in response to obtaining the target task in S101, which will not be described in detail here.

[0137] S302: Obtain a corresponding virtual image based on device information of the user terminal device and the processing device in the target device group.

[0138] Here, the virtual images of the processing devices may be the same or different.

[0139] The device information here can include the device's hardware configuration information, processing capability information, or device ID, etc. For example, for a device with a specific ID, a corresponding avatar is obtained. The avatars of the user-end device and the processing device can be similar to the device's appearance, or abstract images that differ from the device's appearance, such as using planets to represent devices, and using the size of the planets to represent the computing power or processing capabilities of different devices.

[0140] In one possible implementation, the size or type of the avatar corresponding to the processing device can be determined based on the processing capability in the device configuration information. For example, the avatar size of a processing device with high processing capability may be larger, while the avatar size of a processing device with low processing capability may be smaller.

[0141] The virtual image here can be configured, or it can be a preset virtual image obtained from a local library or the server side of the application, or it can be generated using a local processing model based on device information.

[0142] The embodiment of the present application does not limit the virtual image, and can be determined according to actual needs. For example, the virtual image here can be a planet, a robot image, or other virtual images.

[0143] Furthermore, when determining the avatar, the user's profile information can also be considered, and based on the user profile information, the user's preferred or preferred avatar type or avatar style can be obtained. For example, if the user's profile is a cartoon, a cartoon-style image can be obtained as the avatar of the processing device.

[0144] S302 may be implemented as follows: first obtaining device information based on the user terminal device and the processing devices in the target device group, and then obtaining a corresponding virtual image based on the device information of the user terminal device and the processing devices in the target device group.

[0145] S303: Obtain target background content that matches the virtual image.

[0146] The target background content is the background content that matches the avatar. The present embodiment does not limit the type of target background content and can be configured according to actual needs. For example, a background animation or a background image. In one possible implementation, the background animation can be an animation of a three-dimensional model moving according to preset rules.

[0147] In one possible implementation, the target background content may be generated or filtered based on one or more of the following information: the type of task content, user profile information, current environment information, task purpose, etc.

[0148] For example, when the type of the task content is a grassland picture, the target background content may be a landscape type background, for example, the target background may be a landscape painting, etc. The water here may also be flowing.

[0149] For example, when the user portrait information is a cartoon portrait, the target background content may be a cartoon-type background, such as a cartoon landscape painting.

[0150] For example, when the current environment information is night, the target background content may be a dark background, such as a dark landscape painting.

[0151] For example, when the purpose of the task is to share a report, the target background content can be a brief introduction of the sharer, a brief introduction of the sharing company, a brief introduction of the person being shared, a brief introduction of the company being shared, and so on.

[0152] S304: Configure display parameters of the virtual image and target background content based on the execution state to display a target interaction interface that matches the execution state.

[0153] The display parameters of the virtual image and the target background content include: the display size, display position, display layout parameters between the virtual images, and the change rate of the virtual images, etc.; the playback rate, viewing angle, distance, zoom level, etc. of the target background content.

[0154] The specific values ​​of the parameters here can be configured according to actual needs. In practice, you can select some of these display parameters to configure, and of course you can configure more display parameters.

[0155] In this embodiment, the target interaction interface corresponding to different execution states may include virtual objects and target background content, and different execution states are displayed through different display parameters of the virtual objects and target background content to achieve enrichment.

[0156] The following describes the process of obtaining target background content that matches the virtual image in S303. This process may include but is not limited to at least one of the following cases B1 to B4.

[0157] Case B1: Obtain task information of the target task, and obtain target background content that matches the virtual image based on the task information.

[0158] The target task's task information, i.e., the task content. For example, tasks could include generating images, generating text, generating videos, generating audio, or beautifying images. Correspondingly, tasks could include generating a grassland image or a year-end summary PPT. In this case, the target background content could be something that matches a grassland image or a year-end summary.

[0159] The target background content can be selected from a background library or generated based on the task's content. For example, in a raw image task, a color palette or paint palette-related background can be displayed; for a raw text task, the background can be something related to movable type printing; for a generated audio task, the background can be elements related to musical notes or tape.

[0160] The task information may also be the purpose of the task, such as whether it is for sharing or completing a report, and the corresponding background may be related to the sharer or the defendant.

[0161] Similarly, in addition to planets, corresponding virtual images may also include elemental images related to mission content or goals.

[0162] In case B1, the target background content is obtained from the task information of the target task and matches the virtual image. Such target background content can match the task content and the virtual image, making it more beautiful and harmonious.

[0163] Case B2: Obtain user portrait information of the target user, and obtain target background content that matches the virtual image based on the user portrait information.

[0164] The target background content can also be related to the user portrait. Since the user portrait can reflect the user's habits or preferences for images to a certain extent, the target background content related to the user portrait is more in line with the user's aesthetic needs and provides a good user experience.

[0165] The user profile here can be determined based on historical user data. For example, if most user profiles are cartoon-like, the target background can also be configured as a cartoon-like type to match the user's aesthetic taste.

[0166] Case B3: obtaining configuration information of the target device group, and obtaining target background content matching the virtual image based on the configuration information.

[0167] For example, if the target device group is a group set up in a home environment, the configured target background content may be a background composed of elements related to the home environment.

[0168] For example, if the target device group is a group established in a work environment, the configured target background content may be a background composed of elements related to the work environment.

[0169] For example, if the target device group is a rented cloud device group, the configured target background content may be a background composed of elements related to the cloud planet.

[0170] In case B3, the target background content can present the environment of the target device group so that the target background content is consistent with the actual environment, so that the user perception is more real. When the environment of the target device group changes, the target background content can also change accordingly to give the user a different perception.

[0171] Case B4: obtaining environmental information of the environment in which the user terminal device is located, and obtaining target background content that matches the virtual image based on the environmental information.

[0172] The environment here can be used to influence the style of the target background. For example, a low-brightness environment corresponds to a dark background style, and a high-brightness environment corresponds to a light background style.

[0173] The environment can also be used to influence the complexity of the background content. For example, if the current environment is noisy, the background selected or generated can be cluttered or decentralized; if the current environment is quiet, the background selected or generated can be neat, clean, or minimalist.

[0174] In case B4, the style of the target background content may reflect the current environment so as to match the style of the environment.

[0175] The following describes the process of displaying the target interaction interface that matches the execution state in S304. This process may include but is not limited to the following S3041 and S3042.

[0176] S3041. Use the virtual image and target background content as the foreground layer and background layer respectively to form an initial interactive interface.

[0177] The foreground layer can be used to display the avatar and respond to user actions on the avatar. In one possible implementation, the foreground layer acts as the interaction layer. The background layer displays the target background content and assists in presenting the task execution status. The foreground and background layers together form the initial interaction interface.

[0178] The initial interactive interface is obtained by integrating the virtual image as the foreground and the background content as the background layer. The virtual image may initially include only the user-end device, and then the virtual images of more processing devices are updated based on the communication connection status and displayed on the first interactive interface; or, when the user-end device establishes communication with the target device group, the user-end device and other devices in the device group may be displayed on the initial interactive interface.

[0179] S3042: Update the display parameters of the virtual image and target background content in the initial interaction interface based on the execution status to obtain a corresponding target interaction interface.

[0180] The update of display parameters of the virtual image and target background content may include but is not limited to: display position, display size, display color, display layout, dynamic change rate, etc. The specific configuration can be based on actual needs.

[0181] The following describes the process of controlling the user terminal device to display the target interactive interface matching the execution state in S102 from the perspective of the interactive interface. This process may include but is not limited to at least one of the following cases C1 to C4.

[0182] Case C1: controlling the user terminal device to display an initial interaction interface matching the first execution state.

[0183] The first execution state is a state corresponding to a situation where the user terminal device has not established a second connection with the target device group, and the initial interaction interface at least includes a virtual image of the user terminal device.

[0184] Since the client has not yet established a second connection with the target device group in the first execution state, the corresponding initial interaction interface may include a virtual image and background of the client device.

[0185] For example, the initial interactive interface corresponding to the first execution state may include a virtual image (small planet) of the user terminal device and a background (galaxy or nebula). The large planet here can rotate to achieve an animation effect.

[0186] Case C2: controlling the user terminal device to display a second interactive interface matching the second execution state.

[0187] The second execution state is the state corresponding to the case where the user-end device establishes a second connection with the target processing device in the target device group. The second interactive interface presents the virtual images of the user-end device and at least one processing device in the target device group, as well as the connection status between the virtual image of the user-end device and the virtual image of the target processing device.

[0188] For example, the second interactive interface corresponding to the second execution state may include: a virtual image of the user-end device (small planet), a virtual image of at least one processing device in the target device group (big planet), the connection status between the virtual image of the user-end device (small planet) and the virtual image of the target processing device (big planet) (the connection relationship between the small planet and the big planet).

[0189] In this way, the connection relationship between the user terminal devices and the processing devices can be intuitively observed through the connection relationship between the planets.

[0190] Case C3: controlling the user terminal device to display a third interactive interface matching the third execution state.

[0191] The third execution state is a state in which target task data is transmitted between the user terminal device and the target processing device in the target device group. The third interactive interface at least presents virtual images of the user terminal device and the target processing device and a data transmission state between them.

[0192] For example, the third interactive interface corresponding to the third execution state may include: the virtual image of the user-end device (small planet), the virtual image of at least one processing device in the target device group (big planet), the connection status between the virtual image of the user-end device (small planet) and the virtual image of the target processing device (big planet) (the connection relationship between the small planet and the big planet), and the virtual images of the user-end device and the target processing device and the data transmission status between them; that is, the small planet of the user-end device and the planet of the target processing device flash through the connection line and display the direction of data flow to indicate that data transmission is in progress.

[0193] In this way, the data transmission status between the user terminal device and the processing device can be intuitively observed through the flashing of the connection relationship between the planets.

[0194] Case C4: controlling the user terminal device to display a fourth interactive interface matching the fourth execution state.

[0195] The fourth execution state is a state in which the target task is completed, and the fourth interactive interface at least presents the processing result of the target task.

[0196] For example, the fourth interactive interface corresponding to the fourth execution state may include: the processing result of the target task (such as a picture), and may also include a large planet of the target processing device, so that the user can intuitively feel the target processing device that has obtained the processing result.

[0197] In this way, the target task result can be output through the processing result, and the user can intuitively observe the target processing device that obtains the processing result through the big planet of the target processing device.

[0198] The process of controlling the user terminal device to display the target interaction interface matching the execution state in S102 may also include a processing process when the execution state changes.

[0199] refer to Figure 4A The process may include but is not limited to the following S401 to S404.

[0200] S401 : When a change in the execution state of a target task is detected, the user terminal device is controlled to switch from displaying the current interactive interface to displaying the target interactive interface through filtering animation.

[0201] When the state is switched, a transition animation is used to switch to the corresponding interactive interface angle or perspective. In this way, the interface switching can be achieved through animation switching, which provides a high experience.

[0202] For example, the interactive interface switching process can refer to Figure 4B As shown in the content, when the interactive interface of the task processing state (including the virtual image 401 and background 402 of the target processing device) needs to be switched to the interactive interface of the task output state (including the virtual image 401, background 402, and task output result 403 of the target processing device), the switching process can be: the virtual image 401 of the target processing device gradually moves to the left, simulating the switching process, and gradually and dynamically switches to the interactive interface of the task output state.

[0203] S402: Control the target virtual image in the target interactive interface to be displayed and output in a first display mode, and control the target background content in the target interactive interface to be displayed and output in a second display mode.

[0204] The first display mode is different from the second display mode.

[0205] The target virtual image is a virtual image of the processing device that performs the target task, that is, a virtual image that represents the target processing device.

[0206] The first display mode may include: showing that the target processing device is in a working state by means of a bright and dark breathing light.

[0207] The target background content can be output by playing a background animation. The refresh rates of the first display mode and the second display mode can be the same or different.

[0208] The specific playback rate may be related to processing efficiency. The faster the processing efficiency, the faster the playback rate.

[0209] S403 : Control the target interactive interface to output the target virtual image of the target processing device that performs the target task and the virtual image of the device that does not perform the target task with different display parameters.

[0210] The target virtual image of the target processing device that performs the target task and the virtual image of the device that does not perform the target task are distinguished by different display parameters, so that the user can intuitively feel which devices are in the target device cluster and which are the devices that perform the target task.

[0211] The distinction between the two can be achieved through display color, display status, etc. For example, a device in a dim gray state is a non-target processing device; a device in a highlighted or breathing display state is a target processing device.

[0212] S404: Adjust the display layout parameters of the virtual image and / or the playback parameters of the target background content based on the change information of the execution state to display the target interactive interface corresponding to the viewing angle.

[0213] Here you can adjust only the display layout parameters of the avatar, only the playback parameters of the target background content, or both at the same time.

[0214] The display control method provided in the embodiment of the present application may also include processes such as adjusting the target interactive interface. Figure 5 The process may include but is not limited to the following S501 to S504.

[0215] S501 : In response to obtaining a target task, monitor the execution status of the target task.

[0216] The implementation of S501 may refer to the detailed description of monitoring the execution status of the target task in response to obtaining the target task in S101, which will not be described in detail here.

[0217] S502: Control the user terminal device to display a target interaction interface that matches the execution state to present the processing process of the target task.

[0218] The implementation of S502 may refer to the specific description of the process of controlling the user terminal device to display the target interactive interface matching the execution state in S102 to present the processing of the target task, which will not be repeated here.

[0219] S503: In response to obtaining a target interaction operation acting on a target interaction interface, adjust display parameters of at least one virtual image in the target interaction interface.

[0220] The target interactive interface can be used to respond to user interactions. The embodiment of the present application does not limit the type of interaction, and can be configured according to actual needs. For example, the interaction here can be used to add devices to the target device cluster, delete devices, view device information in the target device cluster, etc.

[0221] For example, a user may click on a virtual image of a processing device in the target device cluster to view the device information of the processing device.

[0222] For another example, the user may click on a virtual image of a processing device in the target device cluster and choose to delete the processing device.

[0223] For another example, the user can click the add control in the target device cluster to perform the adding process of the device.

[0224] The interactive operation based on the target interactive interface can adjust the display parameters of the virtual image of the target interactive interface to facilitate user operation.

[0225] S504: Output the target processing result for the target task fed back by the target processing device in the target device group through the second connection.

[0226] The target processing result can be transmitted from the target processing device to the user terminal device through the second connection and then output.

[0227] Here, the target processing result may be output only to the user terminal device, or the target processing result may be synchronized to other devices in the target cluster where the user terminal device is located for output.

[0228] Output can be done directly in plaintext or after decrypting encrypted results. Whether decryption is required depends on whether the data is encrypted before transmission from the target processing device to the user device. Encrypted transmission and decryption before output can improve user privacy and the security of output transmission.

[0229] The method of directly outputting to the user-end device is simple to implement, and outputting to other devices simultaneously can meet the needs of viewing on multiple devices. In practice, it can be configured according to needs, which is flexible and convenient.

[0230] Next, the process of outputting the target processing result for the target task fed back by the target processing device in the target device group through the second connection in S504 will be described.

[0231] This process may include but is not limited to any one of the following cases D1 to D3.

[0232] Case D1: decrypt the target processing result fed back by the target processing device using the key data exchanged with the target processing device, and display the decrypted processing result on the window interface of the first application or the current display interface of the user terminal device.

[0233] In one possible implementation, encryption and decryption of the output target processing result can be achieved through public-private key encryption. The target processing device transmits its public key to the client device in advance, then encrypts the target processing result using its private key and transmits it back to the client device. After receiving the encrypted target processing result, the client device decrypts it using the target processing device's public key to obtain the plaintext target processing result, which is then output for display.

[0234] Of course, it can also be achieved through other encryption and decryption methods, which are not listed here one by one.

[0235] The output display here can display the output on the window interface of the first application (the application to which the target task belongs), or can also display the output on the current display interface of the user terminal device.

[0236] Case D2: When the target task is not unique, the corresponding non-unique processing results are respectively given to the same input area or different input areas of the user terminal device, and the different input areas may belong to the same application or not.

[0237] If the target task is not unique, the corresponding target processing result is also unique. That is, in the case of multiple target tasks, each target task will have its own target processing result.

[0238] In this case, the output area for display output can be the session window of the current session application, a different session window of a different application, or an editing area. If the non-unique processing tasks are generated for the same interactive object, then the corresponding output area may be the same output area for the same interactive object.

[0239] For example, if the processing task is “generating a picture of a grassland and a picture of a lake”, the output area may also be the same output area.

[0240] Case D3: The target processing result fed back by the target processing device is decrypted using the key data exchanged with the target processing device, and the decrypted processing result is output to the associated device of the user terminal device.

[0241] An associated device is a device that has a third connection with the user-end device. For example, if the user-end device is a mobile phone, the associated device can be the device being projected. If the user-end device is a laptop, the associated device can be an extended screen device, a large screen device, or the like.

[0242] Below, taking the raw image application as an example, the display control method provided in the embodiment of the present application is explained.

[0243] The current development process for 3D interactive scenes in the market includes scene design, object layout, animation creation, user interface design, and physics simulation. Developers need to select an appropriate game engine and write code to implement scene logic and interactive features. This development process is both demanding and challenging, and places high technical demands on developers. 3D interactive users require certain operational skills and an understanding of 3D spatial concepts. Layered interaction design can reduce both the difficulty and workload of developers while providing users with a better interactive experience.

[0244] During the User Experience (UE) design and software development phase:

[0245] 1. The software user interface (UI) development utilizes a layered design, splitting and defining different video layers, UE interaction layers, and pop-up window (Toast) layers. Z-Index is used to support Z-axis switching and mutual masking between layers. UE designers model complex and effective 3D components hierarchically, generating 3D rendered videos with lighting, eye tracking, scene transitions, and switching for each layer. Each interactive scene utilizes independent 3D modeling and rendering elements. Development engineers are responsible for parsing keyframes within each layer using the video codec library to control video playback and the mapping between the Z axis and interactions.

[0246] 2. Since the 3D solution primarily utilizes video codec playback, UI developers can leverage common video codec libraries, combined with current computer hardware acceleration capabilities and multi-layer rendering, to deliver a more complex and effective immersive experience using the 30- or 60-frame scene rendering perspective designed by the interaction designer. The UE interaction layer utilizes a similar color scheme and simulated 3D design to seamlessly blend in with the scene.

[0247] 3. 3D interaction is achieved through two-dimensional interaction. The front layer is implemented through interactive surfaces, while the back layer is implemented through video. While the front layer interacts and moves objects, the back layer simulates 3D interaction by adjusting the video playback rate. Achieving 3D interaction through two-dimensional interaction creates an immersive and realistic experience, optimizing the user's interactive experience with the content. Two-dimensional interaction is more intuitive and easy to understand, eliminating the need for users to master complex 3D spatial concepts and operational skills. This reduces the developer workload and difficulty during the development process.

[0248] The interactive process of generating an application is described below. The process may include but is not limited to the following steps 1 to 8.

[0249] Step 1. Download the application on a device that can generate images, and download the computing power sharing on other personal computers (PCs) to achieve mutual call of AI capabilities between multiple devices, and provide a download link on the software interface.

[0250] Download interface can refer to Figure 6 The content shown in Figure 6 , including a background 601 and an associated device window 602.

[0251] Step 2. Log in to the same user account in the app, associate all devices, click Log in Now to jump to the unified login interface, and jump to the main interface after login is complete.

[0252] The login interface can be referenced Figure 7 and Figure 8 The content shown, Figure 7 This is the initial login interface. Figure 8 This is the login boot interface.

[0253] Step 3: Main interface before interaction.

[0254] Planets are connected through orbits, and are connected to software devices through certain rules and technologies, which are similar in nature. The design interface is completed through 3D modeling, and the development level is implemented through layered interaction. The small planets in the front layer are implemented through plane interaction. The device and planet are combined, and the size of the small planets in the front layer is used to express the size of the device computing power. A small planet represents an associated device, and the size of the planet intuitively reflects the size of the device computing power. The middle one is the current device, and the color is used to distinguish whether the device is available (whether the device is online, whether the AI ​​model is installed), and the available (device is turned on and the AI ​​model is installed) device is connected to the current device through flowing light, and the availability of the device is distinguished by color. The small planets of the associated devices have a gradually darkening and shallowing effect around them, imitating the effect of the device breathing when in standby mode; the slow rotation of the earth and the flickering of the nebula in the back layer are realized in the form of video; the associated device planets are connected by flowing light, and unassociated devices are connected by dotted lines.

[0255] The main interface before interaction can be referenced Figure 9 The content shown includes the local planet 901 (equivalent to the planet of the user-end device), the planet 902 of the available AI device (equivalent to the processing device that has been successfully added to the above-mentioned target device cluster and can perform task processing), the planet 903 of the unavailable device (equivalent to the processing device that has been successfully added to the above-mentioned target device cluster but has a network failure), and the background 904.

[0256] Step 4. Add device entry on the main interface.

[0257] In addition to allowing users to associate devices before entering the main interface, the main interface provides users with a way to associate devices at any time.

[0258] The main interface to add device entry interface can refer to Figure 10 The content shown includes: local planet 901 (equivalent to the planet of the user-end device), planet 902 of available AI devices (equivalent to the processing devices that have been successfully added to the above-mentioned target device cluster and can perform task processing), planet 903 of unavailable devices (equivalent to the processing devices that have been successfully added to the above-mentioned target device cluster but have network failures), background 904, as well as add planet 905 and add window 906.

[0259] Step 5. View device details.

[0260] On the device details page, you can view basic device information such as the device model, graphics processing unit (GPU), central processing unit (CPU), neural processing unit (NPU), random access memory (RAM), whether the device is online, whether the device has an AI model installed, and the types of AI tasks that the installed AI model can complete.

[0261] To view the device details interface, refer to Figure 11 The content shown includes: local planet 901 (equivalent to the planet of the user-end device), planet 902 of available AI devices (equivalent to the processing devices that have been successfully added to the above-mentioned target device cluster and can perform task processing), planet 903 of unavailable devices (equivalent to the processing devices that have been successfully added to the above-mentioned target device cluster but have network failures), background 904, and device details window 907.

[0262] Step 6: Interaction process.

[0263] When the user is using the device to generate images, there are strong light waves around the planet in the image generation device, and the connection between the current device and the image generation device has a flowing transmission effect, giving the user interactive feedback of the image generation. The small planet in the image generation device moves to the left, leaving the main position for the generated image. When the small planet in the front layer moves interactively or zooms in and out, the background plays the earth forward / reverse / upward / downward and other videos accordingly. For example: when the small planet in the front layer moves to the left, the background plays the video of the corresponding speed and the large planet rotating to the left; when the small planet in the front layer moves interactively / zooms in and out in a two-dimensional manner, the background earth follows the movement. Through layered design, the front-layer plane interaction and the background video achieve an integrated experience, and the plane interaction achieves a three-dimensional interactive effect.

[0264] The interactive process interface can be referenced Figure 12 The content shown includes: a planet 902 of a target processing device for executing a target task, and a background 904. The background 904 dynamically rotates to simulate the processing process of the raw image.

[0265] Step 7: The raw image is completed.

[0266] After the raw image is completed and the raw image device planet moves to the left, the large planet in the back layer restores the original video playback rate of the "Associated Device Interface", indicating that the interaction is complete. The image supports save as and copy operations, and users can click the home page in the upper right corner to return to the main interface.

[0267] The raw image completion interface can be referenced Figure 13 The content shown includes: a planet 902 of a target processing device for executing a target task, a background 904 , and a processing result image 908 .

[0268] Step 8. View the larger image.

[0269] After the user clicks on the picture, they can view the larger picture, which supports left and right switching, copying and saving operations.

[0270] For a larger image, please refer to Figure 14 The content shown includes: an enlarged processing result image 9081.

[0271] In the second aspect, in order to implement the above processing method, a display control device according to an embodiment of the present application is deployed on a user terminal device. Figure 15 The structure diagram of the display control device 150 is used for explanation.

[0272] like Figure 15 As shown, the display control device 150 includes: a monitoring unit 1501 and a control unit 1502 .

[0273] The monitoring unit 1501 is configured to monitor the execution status of the target task in response to obtaining the target task;

[0274] The control unit 1502 is used to control the user terminal device to display a target interactive interface that matches the execution state to present the processing process of the target task;

[0275] The target interaction interface includes a virtual image of the user terminal device and at least one processing device in the target device group, and the user terminal device may belong to or not belong to the target device group;

[0276] In different execution states, the display parameters of the virtual image in the corresponding interactive interface are different.

[0277] In some embodiments, the display control device 150 further includes a connection unit, which is configured to execute:

[0278] After establishing a first connection with a first device, device information of each processing device in a target device group where the first device is located is obtained; based on the device information, a second connection is established with a target processing device in the target device group, and a target task is sent to the target processing device through the second connection; wherein the first connection is different from the second connection, and the user-end device and the processing device are in the same network or different networks.

[0279] In some embodiments, the monitoring unit 1501 is further configured to perform at least one of the following:

[0280] Obtaining communication connection information between the user terminal device and the processing device in the target device group, and determining the execution status of the target task based on the communication connection information;

[0281] Obtaining transmission data between the user terminal device and the target processing device in the target device group, and determining the execution status of the target task based on the transmission data;

[0282] Obtaining operation information of the user terminal device and / or the target processing device in the target device group, and determining the execution status of the target task based on the operation information;

[0283] Obtaining the target user's operation data on the target interactive interface, and determining the execution status of the target task based on the operation data;

[0284] Task information of a target task and device information of a processing device that executes the target task are obtained, and an execution status of the target task is determined based on the task information and the device information.

[0285] In some embodiments, the control unit 1502 is also used to: obtain a corresponding virtual image based on the device information of the user terminal device and the processing device in the target device group; obtain the target background content that matches the virtual image; and configure the display parameters of the virtual image and the target background content based on the execution status to display the target interaction interface that matches the execution status.

[0286] In some embodiments, the control unit 1502 is further configured to perform at least one of the following:

[0287] Obtaining task information of a target task, and obtaining target background content that matches the virtual image based on the task information;

[0288] Obtaining user portrait information of the target user, and obtaining target background content that matches the virtual image based on the user portrait information;

[0289] Obtaining configuration information of a target device group, and obtaining target background content that matches the avatar based on the configuration information;

[0290] Obtaining environmental information of the environment in which the user terminal device is located, and obtaining target background content that matches the virtual image based on the environmental information;

[0291] and / or,

[0292] The virtual image and the target background content are used as the foreground layer and the background layer respectively to form an initial interactive interface; and the display parameters of the virtual image and the target background content in the initial interactive interface are updated based on the execution state to obtain a corresponding target interactive interface.

[0293] In some embodiments, the control unit 1502 is further configured to perform at least one of the following:

[0294] Controlling the user terminal device to display an initial interaction interface matching a first execution state, the first execution state being a state corresponding to a case where the user terminal device has not established a second connection with the target device group, the initial interaction interface at least including a virtual image of the user terminal device;

[0295] controlling the user terminal device to display a second interactive interface matching a second execution state, the second execution state being a state corresponding to a situation in which the user terminal device establishes a second connection with a target processing device in the target device group, the second interactive interface presenting virtual images of the user terminal device and at least one processing device in the target device group, and a connection state between the virtual image of the user terminal device and the virtual image of the target processing device;

[0296] Controlling the user terminal device to display a third interactive interface matching a third execution state, wherein the third execution state is a state in which target task data is transmitted between the user terminal device and a target processing device in the target device group, and the third interactive interface at least presents virtual images of the user terminal device and the target processing device and a data transmission status between them;

[0297] The user terminal device is controlled to display a fourth interactive interface matching a fourth execution state, where the fourth execution state is a state where the target task is completed, and the fourth interactive interface at least presents a processing result of the target task.

[0298] In some embodiments, the control unit 1502 is further configured to:

[0299] When a change in the execution status of the target task is monitored, the user-end device is controlled to switch from displaying the current interactive interface to displaying the target interactive interface through filtering animation; the target virtual image in the target interactive interface is controlled to be displayed and output in a first display mode, and the target background content in the target interactive interface is controlled to be displayed and output in a second display mode, and the first display mode is different from the second display mode; the target interactive interface is controlled to output the target virtual image of the target processing device that executes the target task and the virtual image of the device that does not execute the target task with different display parameters; based on the change information of the execution status, the display layout parameters of the virtual image and / or the playback parameters of the target background content are adjusted to display the target interactive interface with the corresponding field of view angle.

[0300] In some embodiments, the control unit 1502 is further configured to perform at least one of the following:

[0301] In response to obtaining a target interaction operation acting on a target interaction interface, adjusting display parameters of at least one avatar in the target interaction interface;

[0302] The target processing result for the target task fed back by the target processing device in the target device group through the second connection is output.

[0303] In some embodiments, the control unit 1502 is further configured to perform at least one of the following:

[0304] Decrypting the target processing result fed back by the target processing device using the key data exchanged with the target processing device, and displaying the decrypted processing result on the window interface of the first application or the current display interface of the user terminal device;

[0305] In the case where the target task is not unique, the corresponding non-unique processing results are respectively given to the same input area or different input areas of the user terminal device, and the different input areas belong to or do not belong to the same application;

[0306] The target processing result fed back by the target processing device is decrypted using the key data exchanged with the target processing device, and the decrypted processing result is output to the associated device of the user terminal device, which is a device having a third connection with the user terminal device.

[0307] It should be noted that the display control device provided in the embodiment of the present application includes the various units included, which can be implemented by a processor in an electronic device; of course, it can also be implemented by a specific logic circuit; in the implementation process, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP) or a field programmable gate array (FPGA), etc.

[0308] The description of the above device embodiment is similar to the description of the above method embodiment and has similar beneficial effects as the method embodiment. For technical details not disclosed in the device embodiment of this application, please refer to the description of the method embodiment of this application for understanding.

[0309] It should be noted that, in the embodiment of the present application, if the above-mentioned processing method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the relevant technology can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the display control method of each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a magnetic disk or an optical disk. In this way, the embodiment of the present application is not limited to any specific combination of hardware and software.

[0310] On the third aspect, in order to implement the above-mentioned processing method, an embodiment of the present application provides an electronic device, including a memory and a processor, the display control memory stores a computer program that can be run on the processor, and the display control processor implements the display control method provided in the above-mentioned embodiment when executing the display control program.

[0311] The following combination Figure 16 The electronic device 160 shown is a block diagram of the electronic device.

[0312] In one example, if Figure 16 As shown, display control electronic device 160 includes: a processor 1601, at least one communication bus 1602, an interface 1603, at least one external communication interface 1604, and a memory 1605. Communication bus 1602 is configured to enable communication between these components. Interface 1603 can be connected to an external display screen, and external communication interface 1604 can include standard wired and wireless interfaces.

[0313] The memory 1605 is configured to store instructions and applications executable by the processor 1601, and can also cache data to be processed or processed by the processor 1601 and various modules in the electronic device (for example, image data, audio data, voice communication data and video communication data), which can be implemented through flash memory (FLASH) or random access memory (RAM).

[0314] In a fourth aspect, an embodiment of the present application provides a storage medium, that is, a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the display control method provided in the first aspect of the above embodiment is implemented.

[0315] In a fifth aspect, an embodiment of the present application provides a computer program product, which includes a computer program. When the computer program is executed by a processor, it implements the display control method provided in the first aspect of the above embodiment.

[0316] It should be noted that the description of the above storage medium and device embodiments is similar to the description of the above method embodiments and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium and device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.

[0317] It should be understood that “one embodiment” or “an embodiment” mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, “in one embodiment” or “in some embodiments” appearing throughout the specification do not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. The above-mentioned serial numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments.

[0318] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.

[0319] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the display control unit is only a logical function division. In actual implementation, there may be other division methods, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0320] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed across multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the scheme of this embodiment.

[0321] In addition, all functional units in the embodiments of the present application can be integrated into one processing unit, or each unit can be a separate unit, or two or more units can be integrated into one unit; the above-mentioned integrated units can be implemented in the form of hardware or in the form of hardware plus software functional units.

[0322] Those skilled in the art will appreciate that all or part of the steps of the above-mentioned method embodiments may be implemented by hardware associated with program instructions, and the aforementioned program may be stored in a computer-readable storage medium. When the program is executed, the program executes the steps of the above-mentioned method embodiments; and the aforementioned storage medium includes various media that can store program codes, such as mobile storage devices, read-only memories (ROMs), magnetic disks, or optical disks.

[0323] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application can be essentially or in other words, the part that contributes to the relevant technology can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the display control method of each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROMs, magnetic disks or optical disks.

[0324] The display control described above is merely an embodiment of the present application, but the scope of protection of this application is not limited thereto. Any variation or substitution that a person skilled in the art can readily conceive within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the display control claim.

Claims

1. A display control method, comprising: In response to obtaining the target task, monitoring the execution status of the target task; Controlling the user terminal device to display a target interaction interface matching the execution state to present the processing process of the target task; The target interaction interface includes a virtual image of the user terminal device and at least one processing device in the target device group, and the user terminal device belongs to or does not belong to the target device group; In different execution states, the display parameters of the virtual image in the corresponding interaction interface are different.

2. The method according to claim 1, wherein: Also includes: After establishing a first connection with a first device, obtaining device information of each processing device in a target device group where the first device is located; Establishing a second connection with a target processing device in the target device group based on the device information, and sending the target task to the target processing device through the second connection; The first connection is different from the second connection, and the user terminal device and the processing device are in the same network or in different networks.

3. The method according to claim 1 or 2, wherein: Monitoring the execution status of the target task includes at least one of the following: Obtaining communication connection information between the user terminal device and a processing device in the target device group, and determining an execution state of the target task based on the communication connection information; Obtaining transmission data between the user terminal device and a target processing device in the target device group, and determining an execution state of the target task based on the transmission data; Obtaining operation information of the user terminal device and / or the target processing device in the target device group, and determining the execution status of the target task based on the operation information; Obtaining operation data of a target user acting on the target interactive interface, and determining an execution state of the target task based on the operation data; The task information of the target task and the device information of the processing device executing the target task are obtained, and the execution status of the target task is determined based on the task information and the device information.

4. The method according to claim 1, wherein: Controlling the user terminal device to display a target interaction interface matching the execution state includes: Obtaining a corresponding virtual image based on device information of the client device and a processing device in the target device group; Obtaining target background content matching the virtual image; Display parameters of the virtual image and the target background content are configured based on the execution state to display a target interaction interface matching the execution state.

5. The method according to claim 4, wherein: Obtaining target background content matching the virtual image includes at least one of the following: Obtaining task information of the target task, and obtaining target background content matching the virtual image based on the task information; Obtaining user portrait information of a target user, and obtaining target background content matching the virtual image based on the user portrait information; Obtaining configuration information of the target device group, and obtaining target background content matching the virtual image based on the configuration information; Obtaining environmental information of an environment in which a user terminal device is located, and obtaining target background content matching the virtual image based on the environmental information; and / or, Displaying a target interactive interface matching the execution state includes: Using the virtual image and the target background content as a foreground layer and a background layer respectively to form an initial interactive interface; as well as, The display parameters of the virtual image and the target background content in the initial interaction interface are updated based on the execution status to obtain a corresponding target interaction interface.

6. The method according to claim 1 or 4, wherein: Controlling the user terminal device to display a target interaction interface matching the execution state includes at least one of the following: Controlling the user terminal device to display an initial interaction interface matching a first execution state, wherein the first execution state is a state corresponding to a case where the user terminal device has not established a second connection with the target device group, and the initial interaction interface at least includes a virtual image of the user terminal device; Controlling the user terminal device to display a second interactive interface matching a second execution state, wherein the second execution state is a state corresponding to a case where the user terminal device establishes a second connection with a target processing device in the target device group, and the second interactive interface presents a virtual image of the user terminal device and at least one processing device in the target device group, and a connection state between the virtual image of the user terminal device and the virtual image of the target processing device; Controlling the user terminal device to display a third interactive interface matching a third execution state, wherein the third execution state is a state of transmitting target task data between the user terminal device and a target processing device in the target device group, and the third interactive interface at least presents virtual images of the user terminal device and the target processing device and a data transmission state between them; The user terminal device is controlled to display a fourth interactive interface matching a fourth execution state, wherein the fourth execution state is a state in which the target task is completed, and the fourth interactive interface at least presents a processing result of the target task.

7. The method according to claim 6, wherein: Controlling the user terminal device to display a target interaction interface matching the execution state also includes: When a change in the execution state of the target task is detected, the user terminal device is controlled to switch from displaying the current interactive interface to displaying the target interactive interface through a filtering animation; Controlling a target virtual image in a target interaction interface to be displayed and output in a first display mode, and controlling a target background content in the target interaction interface to be displayed and output in a second display mode, wherein the first display mode is different from the second display mode; Controlling the target interactive interface to output a target virtual image of a target processing device that executes the target task and a virtual image of a device that does not execute the target task with different display parameters; The display layout parameters of the virtual image and / or the playback parameters of the target background content are adjusted based on the change information of the execution state to display the target interaction interface of the corresponding viewing angle.

8. The method according to claim 1, further comprising at least one of the following: In response to obtaining a target interaction operation acting on the target interaction interface, adjusting display parameters of at least one virtual image in the target interaction interface; Outputting a target processing result for the target task fed back by a target processing device in the target device group through the second connection.

9. The method according to claim 8, wherein: Outputting the target processing result for the target task fed back by the target processing device in the target device group through the second connection includes at least one of the following: Decrypting the target processing result fed back by the target processing device by using the key data exchanged with the target processing device, and displaying and outputting the decrypted processing result on the window interface of the first application or the current display interface of the user terminal device; In the case where the target task is not unique, the corresponding non-unique processing results are respectively given to the same input area or different input areas of the user terminal device, and the different input areas belong to or do not belong to the same application; The target processing result fed back by the target processing device is decrypted using the key data exchanged with the target processing device, and the decrypted processing result is output to an associated device of the user terminal device, where the associated device is a device having a third connection with the user terminal device.

10. A user terminal device, comprising at least one processor and at least one processing model capable of running on the processor, wherein the processing model can be called by a target application to perform at least one of the following operations: In response to obtaining the target task, monitoring the execution status of the target task; Displaying a target interactive interface matching the execution state to present the processing process of the target task; in, The target interaction interface includes a virtual image of the user terminal device and at least one processing device in the target device group, and the user terminal device belongs to or does not belong to the target device group; In different execution states, the display parameters of the virtual image in the corresponding interaction interface are different.

Images