Resource configuration method and related device based on a micro computer host

Abstract

The present application provides a resource configuration method and related device based on a microcomputer host. The method includes: obtaining a plurality of data processing tasks, determining a target placeholder image area according to the screen layout information; executing a second data processing task to obtain a first rendering parameter, and transmitting the first rendering parameter and the target placeholder image area to a second display adapter, receiving first screen update data from the second display adapter, executing a first data processing task according to the first screen update data and a second screen frame to obtain a third screen frame, transmitting the third screen frame to a first display adapter, receiving a data packet from the first display adapter, and pushing the data packet. By reducing the image data required to be transmitted between the second display adapter and the central processing unit, the latency impact caused by bandwidth limitations is reduced, which is beneficial to improving the task working efficiency of the system and the intelligence of resource configuration.

Description

Technical Field

[0001] This application belongs to the field of host resource allocation, and specifically relates to a resource allocation method and related device based on a microcomputer host. Background Art

[0002] Currently, microcomputer hosts are widely used. However, the computing power of microcomputer hosts is limited, and an external graphics card is often connected through a graphics card docking station to improve the computing power of the microcomputer host. At this time, the external graphics card may need to process high-resolution and high-refresh-rate image data. However, due to the transmission protocol and bandwidth limitations of the graphics card docking station, latency problems often occur. Summary of the Invention

[0003] Embodiments of this application provide a resource allocation method and related device based on a microcomputer host.

[0004] In a first aspect, embodiments of this application provide a resource allocation method based on a microcomputer host, which is applied to a central processing unit in the microcomputer host. The microcomputer host includes the central processing unit and a first display adapter. The central processing unit is respectively connected to the first display adapter and a second display adapter in a graphics card docking station, and the second display adapter is connected to a first display. The method includes:

[0005] Obtain a plurality of data processing tasks, where the plurality of data processing tasks include a first data processing task and a second data processing task. The first data processing task includes first task information, and the first task information includes screen layout information;

[0006] Determine a target placeholder image area according to the screen layout information;

[0007] Execute the second data processing task to obtain first rendering parameters, and transmit the first rendering parameters and the target placeholder image area to the second display adapter. The second display adapter is used to perform a rendering operation according to the first rendering parameters to obtain a first frame of the screen, determine first screen update data of the first frame of the screen according to the first frame of the screen and the target placeholder image area, and transmit the first frame of the screen to the first display. The first display is used to display the first frame of the screen;

[0008] Receive the first screen update data from the second display adapter;

[0009] Execute the first data processing task according to the first screen update data and a second frame of the screen. The second frame of the screen is the previous frame of the first frame of the screen cached by the central processing unit;

[0010] Transmit the third video frame to the first display adapter, where the first display adapter is used to encode and encapsulate the third video frame to obtain a data packet;

[0011] Receive the data packet from the first display adapter and push the data packet.

[0012] In a possible example, the determining the target placeholder image area according to the video layout information includes: determining at least one layout element according to the video layout information; screening out a target element from the at least one layout element according to a preset rule; determining target layout parameters of the target element; and determining the target placeholder image area of the target element according to the target layout parameters.

[0013] In a possible example, after transmitting the rendering parameters and the target placeholder image area to the second display adapter, the method further includes: obtaining peripheral operation information of a user; determining whether the peripheral operation information indicates adjusting the layout of the target element; if it is determined that the peripheral operation information indicates adjusting the layout of the target element, generating a video synchronization instruction; and transmitting the video synchronization instruction to the second display adapter, where the video synchronization instruction is used to instruct the second display adapter to transmit the first video frame to the central processing unit.

[0014] In a possible example, the first task information includes device information, and the performing the first data processing task according to the first video update data and the second video frame to obtain a third video frame includes: updating the second video frame according to the first video update data to obtain a fourth video frame; determining a target audio capture device and a target video capture device according to the device information; obtaining audio data from the target audio capture device and obtaining video data from the target video capture device; determining a fifth video frame according to the audio data, the video data, and the video layout parameters in the video layout information; and determining the third video frame according to the fourth video frame and the fifth video frame.

[0015] In a possible example, after performing the first data processing task based on the data updated according to the first screen and the second screen frame to obtain a third screen frame, the method further includes: obtaining the current operation information and historical operation information of the user; predicting the target operation to be implemented by the user according to the current operation information, the historical operation information, and a pre-trained operation prediction model; determining second rendering parameters according to the target operation; transmitting the second rendering parameters to the second display adapter, where the second display adapter is used to determine second screen update data according to the second rendering parameters; receiving the second screen update data from the second display adapter; and determining a sixth screen frame according to the second screen update data and the fourth screen frame.

[0016] In a possible example, predicting the target operation to be implemented by the user according to the current operation information, the historical operation information, and a pre-trained operation prediction model includes: determining a target time window; extracting first feature information of the current operation information; extracting second feature information of the operation data of the historical operation information within the target time window; splicing the first feature information and the second feature information to obtain third feature information; determining the operation label of the user; inputting the third feature information and the operation label into the operation prediction model to obtain multiple probability values of multiple operations; and taking the operation with the largest probability value as the target operation to be implemented by the user.

[0017] In a possible example, determining the target time window includes: determining the target game type corresponding to the second data processing task; determining the target game scene where the game character is currently located according to the second screen frame; and determining the target time window according to the target game type and the target game scene.

[0018] In a second aspect, an embodiment of the present application provides a resource configuration device based on a microcomputer host, which is applied to a central processing unit in the microcomputer host. The microcomputer host includes the central processing unit and a first display adapter. The central processing unit is respectively connected to the first display adapter and a second display adapter in a graphics card expansion dock, and the second display adapter is connected to a first display; the device includes an acquisition unit, a determination unit, a task execution unit, and a transmission unit; where

[0019] The acquisition unit is configured to acquire multiple data processing tasks, where the multiple data processing tasks include a first data processing task and a second data processing task, and the first data processing task includes first task information, and the first task information includes screen layout information;

[0020] The determination unit is configured to determine a target placeholder image area according to the screen layout information;

[0021] The task execution unit is configured to execute the second data processing task to obtain first rendering parameters, and transmit the first rendering parameters and the target placeholder image area to the second display adapter. The second display adapter is configured to perform a rendering operation according to the first rendering parameters to obtain a first frame of the picture, determine first picture update data of the first frame of the picture according to the first frame of the picture and the target placeholder image area, and transmit the first frame of the picture to the first display. The first display is configured to display the first frame of the picture;

[0022] The obtaining unit is further configured to receive the first picture update data from the second display adapter;

[0023] The task execution unit is further configured to execute the first data processing task according to the first picture update data and a second frame of the picture to obtain a third frame of the picture, where the second frame of the picture is the previous frame of the first frame of the picture cached by the central processing unit;

[0024] The transmission unit is configured to transmit the third frame of the picture to the first display adapter. The first display adapter is configured to encode and encapsulate the third frame of the picture to obtain a data packet;

[0025] The obtaining unit is further configured to receive the data packet from the first display adapter and push the data packet.

[0026] A third aspect of the present application provides an electronic device, including: a processor and a memory; and one or more programs, where the one or more programs are stored in the memory and are configured to be executed by the processor, and the programs include instructions for performing some or all of the steps described in the first aspect.

[0027] A fourth aspect of the embodiments of the present application provides a computer-readable storage medium, where the computer-readable storage medium is configured to store a computer program, and the computer program enables a computer to execute instructions for performing some or all of the steps described in the first aspect of the embodiments of the present application.

[0028] A fifth aspect of the embodiments of the present application provides a computer program product, where the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable a computer to execute some or all of the steps described in the first aspect of the embodiments of the present application. The computer program product may be a software installation package.

[0029] It can be seen that in the embodiment of the present application, the central processing unit first obtains multiple data processing tasks, then determines the target placeholder image area according to the screen layout information, then executes the second data processing task to obtain the first rendering parameter, and transmits the first rendering parameter and the target placeholder image area to the second display adapter. The second display adapter is used to perform a rendering operation according to the rendering parameter to obtain the first frame of the screen, determine the first screen update data of the first frame of the screen according to the first frame of the screen and the target placeholder image area, and transmit the first frame of the screen to the first display. The first display is used to display the first frame of the screen. Further, it receives the first screen update data from the second display adapter. Further still, it executes the first data processing task according to the first screen update data and the second frame of the screen to obtain the third frame of the screen. The second frame of the screen is the previous frame of the first frame of the screen. Then, it transmits the third frame of the screen to the first display adapter. The first display adapter is used to encode and encapsulate the third frame of the screen to obtain a data packet. Finally, it receives the data packet from the first display adapter and pushes the data packet. By determining the placeholder image area and determining the required screen update data according to the placeholder image area, the first frame of the screen and the second frame of the screen, compared with the second display adapter transmitting the entire first frame of the screen, it reduces the image data required to be transmitted between the second display adapter and the central processing unit, reduces the latency impact brought by the transmission protocol and bandwidth limitation, is beneficial to improving the task working efficiency of the system, and is beneficial to improving the intelligence of resource allocation. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can be obtained according to these drawings.

[0031] Figure 1 is a schematic diagram of the architecture of a resource configuration system based on a microcomputer host provided by an embodiment of the present application;

[0032] Figure 2 is a schematic flowchart of a resource configuration method based on a microcomputer host provided by an embodiment of the present application;

[0033] Figure 3 is a schematic diagram of a microcomputer host and a graphics card docking station provided by an embodiment of the present application;

[0034] Figure 4 is a schematic diagram of a live broadcast screen provided by an embodiment of the present application;

[0035] Figure 5It is a schematic diagram of another live broadcast screen provided by an embodiment of the present application;

[0036] Figure 6 It is a schematic structural diagram of an electronic device provided by an embodiment of the present application;

[0037] Figure 7 It is a functional unit composition block diagram of a resource configuration device based on a microcomputer host provided by an embodiment of the present application. Detailed implementation manners

[0038] In order to enable those skilled in the art to better understand the solution of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the present application.

[0039] The terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally further includes steps or units not listed, or optionally further includes other steps or units inherent to these processes, methods, products or devices.

[0040] Referring to "embodiment" in this article means that the specific features, structures or characteristics described in connection with the embodiment can be included in at least one embodiment of the present application. The phrase appears in various positions in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art explicitly and implicitly understand that the embodiments described herein can be combined with other embodiments.

[0041] The "and / or" in the embodiments of the present application describes the association relationship of associated objects and indicates that three relationships can exist. For example, A and / or B can represent the following three situations: A exists alone; A and B exist simultaneously; B exists alone. Among them, A and B can be singular or plural.

[0042] In the embodiments of the present application, the symbol " / " can represent that the front and rear associated objects are an "or" relationship. In addition, the symbol " / " can also represent a division sign, that is, perform a division operation. For example, A / B can represent A divided by B.

[0043] The "at least one (piece)" or its similar expression in the embodiments of the present application refers to any combination of these items, including any combination of a single item (piece) or plural items (pieces), meaning one or more, and multiple means two or more. For example, at least one (piece) of a, b, or c can represent the following seven cases: a, b, c, a and b, a and c, b and c, a, b, and c. Each of a, b, and c can be an element or a set containing one or more elements.

[0044] In the embodiments of the present application, "equal to" can be used in combination with "greater than" and is applicable to the technical solutions adopted when it is greater than, or can also be used in combination with "less than" and is applicable to the technical solutions adopted when it is less than. When "equal to" is used in combination with "greater than", it is not used in combination with "less than"; when "equal to" is used in combination with "less than", it is not used in combination with "greater than".

[0045] To better understand the solutions of the embodiments of the present application, the electronic devices, related concepts, and backgrounds that may be involved in the embodiments of the present application will be introduced first below.

[0046] The electronic device in the application embodiment is a device with wireless communication function, which can be called a terminal, user equipment (UE), mobile station (MS), mobile terminal (MT), access terminal device, in-vehicle terminal device, industrial control terminal device, UE unit, UE station, mobile station, remote station, remote terminal device, mobile device, UE terminal device, wireless communication device, UE agent or UE device, etc. The terminal device can be fixed or mobile. It should be noted that the terminal device can support at least one wireless communication technology, such as LTE, new radio (NR), wideband code division multiple access (WCDMA), etc. For example, the terminal device can be a mobile phone, tablet (pad), desktop computer, laptop computer, all-in-one computer, in-vehicle terminal, virtual reality (VR) terminal device, augmented reality (AR) terminal device, wireless terminal in industrial control, wireless terminal in self-driving, wireless terminal in remote medical surgery, wireless terminal in smart grid, wireless terminal in transportation safety, wireless terminal in smart city, wireless terminal in smart home, cellular phone, cordless phone, session initiation protocol (SIP) phone, wireless local loop (WLL) station, personal digital assistant (PDA), handheld device with wireless communication function, electronic device or other processing devices connected to a wireless modem, wearable device, terminal device in a future mobile communication network or terminal device in a future evolved public land mobile network (PLMN), etc. The electronic device can be a microcomputer host.

[0047] Please refer to Figure 1 , Figure 1 which is a schematic architecture diagram of a resource configuration system based on a microcomputer host provided by the embodiment of the present application. As Figure 1As shown in the figure, the resource configuration system 1 based on a microcomputer host includes a microcomputer host 10 and a graphics card docking station 20. The microcomputer host 10 is connected to the graphics card docking station 20. The microcomputer host 10 includes a central processing unit 11 (Central Processing Unit, CPU) and a first display adapter 12. The graphics card docking station 20 includes a second display adapter 21. The central processing unit 11 is respectively connected to the first display adapter 12 and the second display adapter 21.

[0048] Among them, the resource configuration system 1 may further include a first display 30 and a second display 40. The first display 30 is connected to the graphics card docking station 20. The first display 30 is used to display the game frame transmitted by the second display adapter 21. The second display 40 is used to receive the live frame from the microcomputer host 10 and display the live frame.

[0049] Among them, the microcomputer host 10 outputs signals to the graphics card docking station 20 through a Thunderbolt interface. The graphics card docking station 20 may include a Thunderbolt interface and a Thunderbolt to PCIe line. The two ends of the Thunderbolt to PCIe line are respectively connected to the Thunderbolt interface of the graphics card docking station 20 and the second display adapter. The Thunderbolt interface of the microcomputer host 10 can be connected to the Thunderbolt interface of the graphics card docking station 20 through a Thunderbolt cable.

[0050] It is connected to the graphics card docking station 20 through a PCIe (Peripheral Component Interconnect Express) bus. The display interface of the graphics card docking station 20 outputs the video signal of the game frame to the first display 30. The display interface can be an HDMI interface, a DP interface, a VGA interface, etc., which is not limited here.

[0051] Among them, the central processing unit 11 can receive the data processing tasks assigned by the scheduler of the operating system of the microcomputer host 10. The data processing tasks may include game tasks, live tasks, and other tasks. The central processing unit 11 includes multiple threads. The central processing unit 11 can allocate at least one thread to execute the game task and at the same time allocate at least one thread to execute the live task.

[0052] Among them, the central processing unit 11 can cooperate with the streaming software to push the encoded and encapsulated data packets to the live platform server through the network.

[0053] Among them, the central processing unit 11 can also obtain the audio data of the user collected by the sound card and the video data of the user collected by the camera.

[0054] Among them, the first display adapter and the second display adapter can be a graphics card, a graphics processing unit, a video card, etc.

[0055] Among them, the microcomputer host can be a Mini PC.

[0056] In a possible example, the central processing unit 11 first obtains multiple data processing tasks, then determines the target placeholder image area according to the screen layout information. Next, the central processing unit 11 executes the second data processing task to obtain rendering parameters, and transmits the rendering parameters and the target placeholder image area to the second display adapter 21. The second display adapter 21 is used to perform a rendering operation according to the rendering parameters to obtain a first frame of the screen. According to the first frame of the screen and the target placeholder image area, the first screen update data of the first frame of the screen is determined, and the first frame of the screen is transmitted to the first display 30. The first display 30 is used to display the first frame of the screen. Further, the central processing unit 11 receives the first screen update data from the second display adapter 21. Further still, the first data processing task is executed according to the first screen update data and the second frame of the screen to obtain a third frame of the screen. The second frame of the screen is the previous frame of the first frame of the screen. Next, the central processing unit 11 transmits the third frame of the screen to the first display adapter. The first display adapter 12 is used to encode and encapsulate the third frame of the screen to obtain a data packet. Finally, the data packet from the first display adapter 12 is received and the data packet is pushed for streaming. By determining the placeholder image area and determining the required screen update data according to the placeholder image area, the first frame of the screen, and the second frame of the screen, compared with the second display adapter transmitting the entire first frame of the screen, the image data required to be transmitted between the second display adapter 21 and the central processing unit 11 is reduced, the delay impact caused by the transmission protocol and bandwidth limitation is reduced, which is beneficial to improving the task working efficiency of the system and the intelligence of resource allocation.

[0057] Please refer to Figure 2 , Figure 2 FIG. is a schematic flowchart of a resource allocation method based on a microcomputer host provided by an embodiment of the present application, which is applied to a central processing unit in the microcomputer host. The microcomputer host includes the central processing unit and a first display adapter. The central processing unit is respectively connected to the first display adapter and a second display adapter in a graphics card expansion dock. The second display adapter is connected to a first display. The method includes:

[0058] Step S201, obtain multiple data processing tasks. The multiple data processing tasks include a first data processing task and a second data processing task. The first data processing task includes first task information, and the first task information includes screen layout information.

[0059] Among them, the first data processing task can be a live broadcast task, which includes but is not limited to a live broadcast video synthesis task, a streaming task, an audio processing task, a video processing task, and a live broadcast software processing task. For example, the live broadcast video synthesis task can be to synthesize a host video based on the user's audio collected by the sound card and the user's video collected by the camera, and then synthesize a live broadcast video based on the live broadcast video and the game video; the streaming task is to cooperate with the live broadcast software to stream the data packet encoded and encapsulated by the live broadcast video through the network; the audio processing task includes but is not limited to encoding, noise reduction, mixing, etc. of the obtained audio data, and the video processing task includes but is not limited to encoding and other processing of the obtained video data. The second data processing task can be a game task, which includes but is not limited to a game logic operation task, a physical simulation calculation task, an artificial intelligence operation task, and a scene rendering processing task. For example, the game logic operation task can be various attribute calculations of characters in a role-playing game, such as the increase and decrease of health, magic value, and experience value, as well as logical judgments such as character leveling, skill release, and task completion. It can be strategy calculations in a strategy game, including marching routes, battle result prediction, resource production and allocation, etc.; the physical simulation calculation task can be to simulate the physical movement of vehicles in a racing game, including calculations of physical effects such as acceleration, deceleration, steering, and collision, as well as the interaction between vehicles and the track and other vehicles. It can be to calculate physical effects such as the flight trajectory of bullets, hit determination, and recoil of weapons in a shooting game; the artificial intelligence operation task can be to control the behavior and decision-making of non-player characters (NPCs) in the game, for example: intelligent operations on behaviors such as NPC patrol, dialogue, and task release; the scene rendering processing task can be to preprocess data such as models, textures, and lighting in the scene when the game scene is switched or a new scene is loaded, such as model loading, texture decompression and mapping, and lighting effect calculation.

[0060] Among them, the screen layout information includes at least one layout element and layout parameters corresponding to the layout element. The layout element includes at least one of the following: host portrait, text, advertisement, host virtual image, live broadcast video decoration element.

[0061] Step S202, determine the target placeholder image area according to the screen layout information.

[0062] Among them, the target placeholder image area is a partial image area where the layout element is laid out in the live broadcast screen, and the user cannot recognize the game elements covered by this partial image area. In the live broadcast screen, the host portrait, live virtual image, advertisement, etc. are often superimposed on the game screen. In the image area occupied by elements such as the host portrait, live virtual image, and advertisement, when the user watches the live broadcast, they cannot see the game screen under these image areas. For example, the live broadcast screen often includes a host portrait frame, and the host portrait frame is superimposed on the game screen, and the user cannot see the game screen covered by the host portrait frame.

[0063] Step S203, execute the second data processing task to obtain the first rendering parameter, and transmit the first rendering parameter and the target placeholder image area to the second display adapter. The second display adapter is used to perform a rendering operation according to the first rendering parameter to obtain the first frame of the screen, determine the first screen update data of the first frame of the screen according to the first frame of the screen and the target placeholder image area, and transmit the first frame of the screen to the first display. The first display is used to display the first frame of the screen.

[0064] Among them, when the central processing unit executes the second data processing task, such as a scene rendering processing task, it will calculate the rendering parameters. The rendering parameters include but are not limited to game character parameters, action pose parameters, and special effect parameters, etc. For example: the character parameters include the position coordinates where the character is located, the action pose parameters include the action pose of the character, and the special effect parameters include the position, range, etc. of special effects such as skill special effects and scene special effects. This is not limited here. The central processing unit packages the rendering parameters to obtain a rendering parameter data packet, and transmits the rendering parameter data packet to the second display adapter through the PCIe bus. After receiving the rendering parameter data packet, the second display adapter unpacks the rendering parameter data packet and performs corresponding rendering operations based on the rendering parameters to generate the first frame of the current game screen. For example: the rendering operation can be to render the character model, clothing, skin texture, etc. of the game character, render game environment elements such as mountains, forests, lakes, etc., render animations, etc. This is not limited here.

[0065] Among them, the second display adapter is connected to the first display. Compared with the first display being connected to the microcomputer host, the second first display adapter needs to send back the first frame of the screen to the microcomputer host, and the microcomputer host transmits the first frame of the screen to the first display, which is beneficial to reducing the data transmission time.

[0066] Specifically, the second frame is the previous frame of the first frame. Determining the first frame update data includes the following steps: determining the third frame update data of the first frame compared to the second frame according to the first frame and the second frame; removing the frame data in the target image area from the third frame update data to obtain the first frame update data.

[0067] Please refer to Figure 3 , Figure 3 FIG. is a schematic diagram of a microcomputer host and a graphics card docking station provided by an embodiment of the present application. The microcomputer host is respectively connected to a camera, a graphics card docking station, and a second display. The graphics card docking station is connected to a first display. The first display displays a game screen, that is, the first frame. The second display displays a live broadcast screen, and the live broadcast screen includes a game screen and a host portrait.

[0068] For example, please refer to Figures 4 - 5 , Figure 4 FIG. is a schematic diagram of a live broadcast screen provided by an embodiment of the present application. Figure 5 FIG. is a schematic diagram of another live broadcast screen provided by an embodiment of the present application. Figure 4 The shown live broadcast screen is the second frame, and the second frame includes a first character and an environmental scene. Figure 5 The shown live broadcast screen is the first frame. The first frame includes a first character, a second character, and an environmental scene. The first frame is updated with the second character compared to the second frame, and the environmental scene remains unchanged. Then, the frame data corresponding to the first area where the second character is located in the first frame is the third frame update data. And a part of the body of the second character is in the target placeholder image area, and the part of the body in the target placeholder image area cannot be seen by the user. Therefore, the first area can be divided into a second area and a third area. The second area is a part of the area in the target placeholder image area. Optionally, the frame data in the second area in the third frame update data can be removed to obtain the first frame update data.

[0069] Step S204: Receive the first frame update data from the second display adapter.

[0070] Wherein, the second display adapter can transmit the first frame update data to the central processing unit through the PCIe bus.

[0071] Step S205: Execute the first data processing task according to the first frame update data and the second frame to obtain a third frame. The second frame is the previous frame of the first frame cached by the central processing unit.

[0072] Among them, the fourth frame of the game can be obtained by updating the second frame of the screen based on the data of the first screen. The fourth frame of the screen does not include the part of the game screen in the target placeholder image area, and the third frame of the screen also does not include the part of the game screen in the target placeholder image area.

[0073] Among them, the third frame of the screen can be a live broadcast frame.

[0074] Step S206: Transmit the third frame of the screen to the first display adapter, and the first display adapter is used to encode and encapsulate the third frame of the screen to obtain a data packet.

[0075] Among them, when the first display adapter of the microcomputer host performs both the game rendering task and encodes and encapsulates the live broadcast frame at the same time, encoding and encapsulating the live broadcast frame may occupy too much graphics card resources, resulting in phenomena such as game stuttering and frame drops, affecting the game experience and the live broadcast experience. Also, when the second display adapter performs both the game rendering task and encodes and encapsulates the live broadcast frame, the amount of data to be sent back to the central processing unit increases, and the delay has a greater impact. Therefore, the second display adapter is selected to perform the game rendering task, and the first display adapter encodes and encapsulates the live broadcast frame. The first display adapter and the second display adapter perform the live broadcast-related tasks and the game-related tasks respectively, which can improve the stability of the system for running games and live broadcasts.

[0076] Step S207: Receive the data packet from the first display adapter and push the data packet.

[0077] It can be seen that in the embodiments of the present application, the central processing unit first obtains multiple data processing tasks, then determines the target placeholder image area according to the screen layout information, and then executes the second data processing task to obtain the first rendering parameter, and transmits the first rendering parameter and the target placeholder image area to the second display adapter. The second display adapter is used to perform a rendering operation according to the rendering parameter to obtain the first frame of the screen, determine the first screen update data of the first frame of the screen according to the first frame of the screen and the target placeholder image area, and transmit the first frame of the screen to the first display. The first display is used to display the first frame of the screen. Further, it receives the first screen update data from the second display adapter. Further, it performs the first data processing task according to the first screen update data and the second frame of the screen to obtain the third frame of the screen. The second frame of the screen is the previous frame of the first frame of the screen. Then, it transmits the third frame of the screen to the first display adapter. The first display adapter is used to encode and encapsulate the third frame of the screen to obtain a data packet. Finally, it receives the data packet from the first display adapter and pushes the data packet. By determining the placeholder image area and determining the required screen update data according to the placeholder image area, the first frame of the screen and the second frame of the screen, compared with the second display adapter transmitting the entire first frame of the screen, it reduces the image data required to be transmitted between the second display adapter and the central processing unit, reduces the latency impact brought by the transmission protocol and bandwidth limitation, is beneficial to improving the task working efficiency of the system, and is beneficial to improving the intelligence of resource allocation.

[0078] In a possible example, in terms of determining the target placeholder image area according to the screen layout information, the above method may further include the following steps: determining at least one layout element according to the screen layout information; screening out the target element from the at least one layout element according to a preset rule; determining the target layout parameter of the target element; and determining the target placeholder image area of the target element according to the target layout parameter.

[0079] Among them, the target element refers to a layout element that can completely cover the game screen without showing any game elements and can form a certain placeholder area. The target element includes at least one of the host portrait, advertisement, and host virtual image. It is difficult for text to form a certain placeholder area and thus is not used as a target element.

[0080] Among them, the occupied area of the entire target element on the live broadcast screen can be determined according to the layout parameter, and then the target placeholder image area can be determined according to the occupied area. The target placeholder image area is smaller than the occupied area.

[0081] Among them, the shape of the target placeholder image area is not limited. For example, it can be a rectangle, a circle, or an irregular shape. For example: the area where the host portrait is located is often a rectangular area.

[0082] For example, please refer toFigure 3 In the figure, the live broadcast screen displayed on the second display includes a game screen and the portrait of the host. The portrait of the host is located in the lower right corner of the live broadcast screen and is within the occupied area. The target placeholder image area is smaller than the occupied area and is within the occupied area.

[0083] It can be seen that in this example, by screening out the target elements in at least one layout element, then according to the layout parameters of the target elements, first determining the occupied area of the target elements, and further determining the target placeholder image area, and making the target placeholder image area smaller than the occupied area of the target elements, it is beneficial to reduce the risk of abnormal live broadcast screen streaming and improve the task working efficiency of the system.

[0084] In a possible example, after transmitting the rendering parameters and the target placeholder image area to the second display adapter, the above method may include the following steps: obtaining the peripheral operation information of the user; determining whether the peripheral operation information indicates adjusting the layout of the target element; if it is determined that the peripheral operation information indicates adjusting the layout of the target element, generating a screen synchronization instruction; and transmitting the screen synchronization instruction to the second display adapter, where the screen synchronization instruction is used to instruct the second display adapter to transmit the first screen frame to the central processing unit.

[0085] Among them, the peripheral operation information may include the current operations of the user on the mouse and keyboard, mouse position information, and other peripheral operations.

[0086] Optionally, determining whether the peripheral operation information indicates adjusting the layout of the target element may include the following steps: if it is analyzed from the peripheral operation information that there is a tendency for the mouse pointer to approach the target placeholder image area and the position of the mouse pointer is within a preset distance range near the target placeholder image area, it is determined that the peripheral operation information indicates adjusting the layout of the target element.

[0087] Specifically, the moving path of the mouse pointer within a preset time period can be determined according to the peripheral operation information, and it is analyzed whether the mouse pointer has a tendency to approach the target placeholder image area based on the position relationship between the moving path and the target placeholder image area. If it is analyzed that the mouse pointer has a tendency to approach the target placeholder image area and the position of the mouse pointer is always within a preset distance range near the target placeholder image area within the preset time period, it is determined that the peripheral operation information indicates adjusting the layout of the target element.

[0088] Optionally, the target distance between the mouse pointer and the target placeholder image area within a preset time period can be determined in real time. If multiple target distances are determined within the preset time period and it is determined that any target distance is less than or equal to the preset distance, it is determined that the position of the mouse pointer is always within a preset distance range near the target placeholder image area within the preset time period.

[0089] Among them, the preset time period can be set manually or by default in the system, which is not limited here; the preset distance range can be set manually or by default in the system, which is not limited here.

[0090] Optionally, determining whether the peripheral operation information indicates adjusting the layout of the target element may include the following steps: If it is analyzed from the peripheral operation information that the user opens the layout setting page of the target element, it is determined that the peripheral operation information indicates adjusting the layout of the target element.

[0091] Among them, when it is determined that the peripheral operation information indicates adjusting the layout of the target element, it means that the position of the target placeholder image area needs to be changed. At this time, the game screen under the target placeholder image area needs to be displayed. At this time, the central processing unit can transmit a picture synchronization instruction to the second display adapter, instructing the second display adapter to transmit a complete first picture frame to prevent abnormal live broadcast picture streaming.

[0092] It can be seen that in this example, when the central processing unit determines that the peripheral operation information indicates adjusting the layout of the target element, it can timely instruct the second display adapter to resume transmitting a complete first picture frame, which is beneficial to reducing the risks of abnormal live broadcast picture synthesis and streaming, and is beneficial to improving the stability of the central processing unit in synthesizing the live broadcast picture.

[0093] In a possible example, the first task information includes device information. In terms of performing the first data processing task according to the first picture update data and the second picture frame to obtain a third picture frame, the above method may include the following steps: updating the second picture frame according to the first picture update data to obtain a fourth picture frame; determining a target audio acquisition device and a target video acquisition device according to the device information; acquiring audio data from the target audio acquisition device and acquiring video data from the target video acquisition device; determining a fifth picture frame according to the audio data, the video data, and the picture layout parameters in the picture layout information; determining the third picture frame according to the fourth picture frame and the fifth picture frame.

[0094] Among them, the fourth picture frame is obtained by the central processing unit updating the second picture frame using the first picture update data. The fourth picture frame is a game picture frame, which is different from the first picture frame and does not include a part of the game picture in the target placeholder image area.

[0095] Among them, the target audio acquisition device can be a sound card, and the target video acquisition device can be a camera.

[0096] Among them, the audio data includes the host's voice, ambient sound, and time stamps, and the video data includes time stamps and the host's portrait.

[0097] Among them, the fifth screen frame is a live broadcast screen frame. The central processing unit synthesizes the live broadcast screen frame based on the time stamp, the screen layout parameters, the audio data and the video data collected by the sound card, obtains the fifth screen frame, and superimposes the fifth screen frame on the fourth screen frame to synthesize the third screen frame.

[0098] It can be seen that in this example, the central processing unit can update the second screen frame according to the first screen update data to obtain the fourth screen frame, synthesize the fifth screen frame according to the audio data and the video data, and superimpose the fifth screen frame on the fourth screen frame to obtain the third screen frame, which is beneficial to improving the task working efficiency of the system.

[0099] In a possible example, after performing the first data processing task according to the first screen update data and the second screen frame to obtain the third screen frame, the above method may include the following steps: obtaining the current operation information and the historical operation information of the user; predicting the target operation that the user will perform according to the current operation information, the historical operation information and the pre-trained operation prediction model; determining the second rendering parameter according to the target operation; transmitting the second rendering parameter to the second display adapter, and the second display adapter is used to determine the second screen update data according to the second rendering parameter; receiving the second screen update data from the second display adapter; and determining the sixth screen frame according to the second screen update data and the fourth screen frame.

[0100] Among them, the game operations of the user are often multiple and continuous. Therefore, when predicting the user's next operation, the user's historical operations need to be considered at the same time.

[0101] Among them, the current operation information may include the current game operation of the user, the historical operation information may include the game operation history record of the user within a certain time window, and the game operation record may include the movement track of the mouse, the click time, the click position, the key pressing and releasing conditions of the keyboard, the operations of other game peripherals, etc.

[0102] Among them, a training set can be constructed based on the historical operation information, and the neural network model can be trained by using the training set to obtain the trained operation prediction model.

[0103] Among them, the game operation that the user will perform, that is, the target operation, is predicted through the user's current operation information, historical operation information and operation prediction model. In this way, the second display adapter can complete the rendering operation corresponding to the target operation earlier based on the second rendering parameter to obtain the seventh screen frame. The seventh screen frame is the next frame of the predicted first screen frame, and the second screen update data is determined according to the seventh screen frame, the first screen frame and the target placeholder image area. The central processing unit updates the fourth screen frame with the second screen update data to obtain the sixth screen frame.

[0104] Among them, the second screen update data is the screen data updated by the seventh screen frame compared to the first screen frame, and the second screen update data does not include the screen data of the target placeholder image area.

[0105] For example, the current game is a shooting game, and the current operation information of the user is that the user swipes the mouse to the left and clicks the right mouse button. The historical operation information of the user shows that before swiping the mouse to the left and clicking the right mouse button, the user long-pressed the keyboard keys w and shift and clicked the space bar at the same time. Then, based on the current operation information and the historical operation information, the operation prediction model can predict that the user wants to complete a consecutive shooting operation of forward jumping operation, perspective rotation operation, shooting aiming operation, and shooting operation. And the shooting operation is to click the left mouse button. Then, it is finally predicted that the next operation of the user, that is, the target operation, is to click the left mouse button.

[0106] It can be seen that in this example, the target operation that the user will perform can be predicted based on the current operation information and the historical operation information of the user. Furthermore, the second display adapter can execute the rendering operation corresponding to the target operation, determine the second screen update data, and transmit the second screen update data in advance, which is beneficial to improving the task execution efficiency of the system.

[0107] In a possible example, in terms of predicting the target operation that the user will perform according to the current operation information, the historical operation information, and the pre-trained operation prediction model, the above method may include the following steps: determining a target time window; extracting first feature information of the current operation information; extracting second feature information of the operation data of the historical operation information within the target time window; splicing the first feature information and the second feature information to obtain third feature information; determining the operation label of the user; inputting the third feature information and the operation label into the operation prediction model to obtain multiple probability values of multiple operations; and taking the operation with the largest probability value as the target operation that the user will perform.

[0108] Among them, the game operations of the user are often multiple and continuous, and multiple game operations are often completed within a certain time window. Therefore, the historical operations and the current game operations within a certain time window can be selected to predict the game operations that the user will perform.

[0109] Among them, the feature information includes but is not limited to the mean and variance of the operation interval time, the occurrence frequency of a specific operation within a certain time, the two-dimensional distribution of the mouse click position on the screen, the number of mouse clicks, the click duration, the order of multiple mouse operations and / or multiple keyboard key presses, etc., which are not limited here.

[0110] Among them, each operation corresponds to a probability value. For example, if multiple operations are predicted as right-clicking the mouse, left-clicking the mouse, and swiping the mouse to the right, where the probability value of right-clicking the mouse is 10%, the probability value of left-clicking the mouse is 70%, and the probability value of swiping the mouse to the right is 20%, then the probability value of left-clicking the mouse is the largest, and left-clicking the mouse is the target operation.

[0111] Optionally, the game duration, game achievements, and game operation evaluation information of the user playing the current game can be obtained, and the operation label of the user can be determined according to the game duration, game achievements, and game operation evaluation information.

[0112] Among them, when predicting the target operation of the user, the operation label should be considered. For users with good game operations, they can often perform a series of consecutive, complete, and more difficult operations, while for users with poor game operations, they can only perform simpler operations.

[0113] Among them, the game achievement can be an achievement associated with the game operation. The more game achievements, the better the user's game operation. The game operation evaluation information reflects the quality of the user's game operation. The operation label can include a game period sub-label and an operation level sub-label. For example, the game period sub-label includes the novice period, the familiarization period, and the proficiency period, and the operation level sub-label includes the novice level, the intermediate level, the advanced level, and the professional level. The operation level increases from left to right. For users in the novice period, they are not even adapted to the game keys and have poor operation regularity. For users in the proficiency period, they can often perform multiple operations unique to the current game.

[0114] Among them, splicing the first feature information and the second feature information can be directly spliced in chronological order.

[0115] It can be seen that in this example, considering the time window and the operation label when predicting the operation to be performed by the user is beneficial to improving the accuracy of operation prediction.

[0116] In a possible example, in terms of determining the target time window, the above method may include the following steps: determining the target game type corresponding to the second data processing task; determining the target game scene where the game character is currently located according to the second screen frame; and determining the target time window according to the target game type and the target game scene.

[0117] Among them, the time window of multiple consecutive operations of the user is often related to the game type and game scene. For example, for strategy games, users often think while operating, and the time window of multiple operations is longer, while for music games, the user's operation rhythm is faster, and the time window of multiple operations is shorter. For game scenes, for example, in the game boss strategy scene, users often need to frequently click mouse buttons and / or keyboard buttons to release game skills, and the time window of multiple operations is shorter. In the tracking game scene, users often click mouse buttons and / or keyboard buttons at a longer interval, and the time window of multiple operations is longer.

[0118] For example, for music-type games and game scenes that are level challenge scenes, the set time window is shorter, at 0.1 seconds to 0.3 seconds; for strategy-type games and game scenes that are strategy battle scenes, the set time window is longer, at 1 second to 2 seconds.

[0119] Optionally, preset rules may be stored in advance, the preset rules including the correspondence between game types and game scenes and time windows, and the corresponding target time window in the preset rules may be queried based on the target game type and target game scene.

[0120] It can be seen that in this example, the target time window can be determined based on the game type and game scenario, which is beneficial to improving the accuracy of time window determination and the accuracy of operation prediction.

[0121] See also Figure 6 , Figure 6 1 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application, which is applied to a central processing unit in a microcomputer host, wherein the microcomputer host includes the central processing unit and a first display adapter, wherein the central processing unit is respectively connected to the first display adapter and a second display adapter in a graphics card expansion dock, and the second display adapter is connected to a first display; Figure 6 As shown, the electronic device includes a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs are configured to execute the following steps by the processor:

[0122] Acquire multiple data processing tasks, the multiple data processing tasks include a first data processing task and a second data processing task, the first data processing task includes first task information, and the first task information includes screen layout information;

[0123] Determining a target placeholder image area according to the screen layout information;

[0124] Execute the second data processing task to obtain first rendering parameters, and transmit the first rendering parameters and the target placeholder image area to the second display adapter. The second display adapter is configured to perform a rendering operation according to the first rendering parameters to obtain a first frame of the picture, determine first picture update data of the first frame of the picture according to the first frame of the picture and the target placeholder image area, and transmit the first frame of the picture to the first display. The first display is configured to display the first frame of the picture;

[0125] Receive the first picture update data from the second display adapter;

[0126] Execute the first data processing task according to the first picture update data and a second frame of the picture. The second frame of the picture is the previous frame of the first frame of the picture cached by the central processing unit;

[0127] Transmit the third frame of the picture to the first display adapter. The first display adapter is configured to encode and encapsulate the third frame of the picture to obtain a data packet;

[0128] Receive the data packet from the first display adapter and push the data packet.

[0129] It can be seen that in the embodiment of the present application, the central processing unit first obtains a plurality of data processing tasks, then determines the target placeholder image area according to the picture layout information, then executes the second data processing task to obtain the first rendering parameters, and transmits the first rendering parameters and the target placeholder image area to the second display adapter. The second display adapter is configured to perform a rendering operation according to the rendering parameters to obtain a first frame of the picture, determine first picture update data of the first frame of the picture according to the first frame of the picture and the target placeholder image area, and transmit the first frame of the picture to the first display. The first display is configured to display the first frame of the picture. Further, receive the first picture update data from the second display adapter. Further, execute the first data processing task according to the first picture update data and the second frame of the picture to obtain a third frame of the picture. The second frame of the picture is the previous frame of the first frame of the picture. Then, transmit the third frame of the picture to the first display adapter. The first display adapter is configured to encode and encapsulate the third frame of the picture to obtain a data packet. Finally, receive the data packet from the first display adapter and push the data packet. By determining the placeholder image area and determining the required transmitted picture update data according to the placeholder image area, the first frame of the picture and the second frame of the picture, compared with the second display adapter transmitting the entire first frame of the picture, the image data required to be transmitted between the second display adapter and the central processing unit is reduced, the delay impact caused by the transmission protocol and bandwidth limitation is reduced, which is beneficial to improving the task working efficiency of the system and is beneficial to improving the intelligence of resource allocation.

[0130] The above mainly introduced the solution of the embodiments of the present application from the perspective of the execution process on the method side. It can be understood that in order for an electronic device to implement the above functions, it includes the corresponding hardware structures and / or software modules for executing each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments provided in this article, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a certain function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present application.

[0131] The embodiments of the present application can divide the functional units of the electronic device according to the above method examples. For example, each functional unit can be divided corresponding to each function, or two or more functions can be integrated into one processing unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit. It should be noted that the division of units in the embodiments of the present application is illustrative, only a logical function division, and there can be other division methods in actual implementation.

[0132] In the case of dividing each functional module corresponding to each function, Figure 7 a block diagram of the composition of the functional units of a resource configuration device based on a microcomputer host is given, as Figure 7 shown, applied to the central processing unit in the microcomputer host. The microcomputer host includes the central processing unit and a first display adapter. The central processing unit is respectively connected to the first display adapter and a second display adapter in the graphics card expansion dock. The second display adapter is connected to a first display; the device includes an acquisition unit 701, a determination unit 702, a task execution unit 703, and a transmission unit 704; where,

[0133] The acquisition unit 701 is used to acquire a plurality of data processing tasks. The plurality of data processing tasks include a first data processing task and a second data processing task. The first data processing task includes first task information, and the first task information includes screen layout information;

[0134] The determination unit 702 is used to determine a target placeholder image area according to the screen layout information;

[0135] The task execution unit 703 is configured to execute the second data processing task to obtain first rendering parameters, and transmit the first rendering parameters and the target placeholder image area to the second display adapter. The second display adapter is configured to perform a rendering operation according to the first rendering parameters to obtain a first frame of the picture, determine first picture update data of the first frame of the picture according to the first frame of the picture and the target placeholder image area, and transmit the first frame of the picture to the first display. The first display is configured to display the first frame of the picture;

[0136] The obtaining unit 701 is further configured to receive the first picture update data from the second display adapter;

[0137] The task execution unit 703 is further configured to execute the first data processing task according to the first picture update data and a second frame of the picture to obtain a third frame of the picture, where the second frame of the picture is the previous frame of the first frame of the picture cached by the central processing unit;

[0138] The transmission unit 704 is configured to transmit the third frame of the picture to the first display adapter. The first display adapter is configured to encode and encapsulate the third frame of the picture to obtain a data packet;

[0139] The obtaining unit 701 is further configured to receive the data packet from the first display adapter and push the data packet.

[0140] It can be seen that for the resource configuration device based on a micro computer host described in the embodiments of this application, it first obtains multiple data processing tasks, then determines a target placeholder image area according to the screen layout information, then executes a second data processing task to obtain a first rendering parameter, and transmits the first rendering parameter and the target placeholder image area to a second display adapter. The second display adapter is used to perform a rendering operation according to the rendering parameter to obtain a first frame of the screen, determine first screen update data of the first frame of the screen according to the first frame of the screen and the target placeholder image area, and transmit the first frame of the screen to a first display. The first display is used to display the first frame of the screen. Further, it receives the first screen update data from the second display adapter. Still further, it performs a first data processing task according to the first screen update data and a second frame of the screen to obtain a third frame of the screen. The second frame of the screen is the previous frame of the first frame of the screen. Then, it transmits the third frame of the screen to the first display adapter. The first display adapter is used to encode and encapsulate the third frame of the screen to obtain a data packet. Finally, it receives the data packet from the first display adapter and pushes the data packet. By determining the placeholder image area and determining the required screen update data to be transmitted according to the placeholder image area, the first frame of the screen, and the second frame of the screen, compared with the second display adapter transmitting the entire first frame of the screen, it reduces the image data required to be transmitted between the second display adapter and the central processing unit, reduces the latency impact caused by the transmission protocol and bandwidth limitation, is beneficial to improving the task working efficiency of the system, and is beneficial to improving the intelligence of resource configuration.

[0141] It should be noted that all relevant content of each step involved in the above method embodiments can be cited in the function description of the corresponding functional modules, and will not be elaborated here.

[0142] The electronic device provided in this embodiment is used to execute the above resource configuration method based on a micro computer host, so the same effects as those of the above implementation method can be achieved.

[0143] In the case of adopting an integrated unit, the electronic device may include a processing module, a storage module, and a communication module. Among them, the processing module can be used to control and manage the actions of the electronic device. For example, it can be used to support the electronic device in executing the steps performed by the above functional units. The storage module can be used to support the electronic device in executing stored program codes and data, etc. The communication module can be used to support the communication of the electronic device with other devices.

[0144] Among them, the processing module can be a processor or a controller. It can implement or execute various exemplary logic blocks, modules, and circuits described in connection with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, and so on. The storage module can be a memory. The communication module can specifically be a device that interacts with other electronic devices, such as a radio frequency circuit, a Bluetooth chip, a Wi-Fi chip, etc.

[0145] An embodiment of this application also provides a computer storage medium. Among them, this computer storage medium stores a computer program for electronic data exchange, and this computer program enables a computer to execute some or all of the steps of any of the methods described in the foregoing method embodiments. The foregoing computer includes an electronic device.

[0146] An embodiment of this application also provides a computer program product. The foregoing computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the foregoing computer program is operable to enable a computer to execute some or all of the steps of any of the methods described in the foregoing method embodiments. This computer program product can be a software installation package, and the foregoing computer includes a control platform.

[0147] It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations. However, those skilled in the art should know that this application is not limited by the described action sequence, because according to this application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily essential to this application.

[0148] In the above embodiments, the descriptions of each embodiment have their own emphases. For the parts not detailed in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0149] In several embodiments provided by this application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the above division of units is only a logical function division. In actual implementation, there can be other division methods. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the displayed or discussed mutual coupling, direct coupling, or communication connection can be through some interfaces. The indirect coupling or communication connection of the device or unit can be in an electrical or other form.

[0150] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed over multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0151] In addition, in each embodiment of the present application, the various functional units may be integrated in a processing unit, may exist separately as individual physical units, or two or more units may be integrated in one unit. The above integrated units can be implemented in the form of hardware or in the form of software functional units.

[0152] If the above integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application, in essence, or the part that contributes to the prior art, or all or part of this technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the above methods in each embodiment of the present application. And the aforementioned memory includes: USB flash drives, read-only memories (ROM, Read-Only Memory), random access memories (RAM, Random Access Memory), mobile hard disks, magnetic disks, or optical discs and other media that can store program codes.

[0153] Those of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing relevant hardware through a program, and this program can be stored in a computer-readable memory. The memory can include: flash drives, read-only memories, random access memories, magnetic disks, or optical discs, etc.

[0154] The above has introduced the embodiments of the present application in detail. Specific examples are used in this article to elaborate on the principle and implementation manner of the present application. The description of the above embodiments is only used to help understand the method and its core idea of the present application; at the same time, for those of ordinary skill in the art, according to the idea of the present application, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation to the present application.

Claims

1. A resource configuration method based on a microcomputer host, characterized in that: A central processing unit applied to a microcomputer host, the microcomputer host comprising the central processing unit and a first display adapter, the central processing unit being respectively connected to the first display adapter and a second display adapter in a graphics card expansion dock, the second display adapter being connected to a first display, and the microcomputer host being connected to a second display; the method comprising: Acquire multiple data processing tasks, the multiple data processing tasks include a first data processing task and a second data processing task, the first data processing task includes first task information, and the first task information includes screen layout information; According to the screen layout information, at least one layout element is determined; according to a preset rule, a target element is selected from the at least one layout element, where the target element is a layout element that can completely cover the game screen without exposing any game elements and can form a placeholder area, and the target element includes at least one of the following: a host portrait, an advertisement, and a host virtual image; a target layout parameter of the target element is determined; according to the target layout parameter, a target placeholder image area of ​​the target element is determined, where the target placeholder image area is smaller than the occupied area of ​​the target element; executing the second data processing task to obtain a first rendering parameter, and transmitting the first rendering parameter and the target placeholder image area to the second display adapter, the second display adapter being used to perform a rendering operation according to the first rendering parameter to obtain a first picture frame, determining first picture update data of the first picture frame according to the first picture frame and the target placeholder image area, transmitting the first picture frame to the first display, the first display being used to display the first picture frame, the first picture update data not including picture data corresponding to the target placeholder image area; receiving the first picture update data from the second display adapter; Execute the first data processing task according to the first picture update data and the second picture frame to obtain a third picture frame, wherein the second picture frame is a frame of the previous picture of the first picture frame cached by the central processing unit; transmitting the third picture frame to the first display adapter, wherein the first display adapter is used for encoding and encapsulating the third picture frame to obtain a data packet; receiving the data packet from the first display adapter and streaming the data packet; After transmitting the first rendering parameter and the target placeholder image area to the second display adapter, the method further includes: obtaining user's peripheral operation information, the peripheral operation information including user's operation information on the mouse and keyboard and mouse position information; determining whether the peripheral operation information indicates adjusting the layout of the target element; including: determining a movement path of the mouse pointer within a preset time period according to the peripheral operation information; determining a plurality of target distances between the mouse pointer and the target placeholder image area within the preset time period; if it is determined that each target distance is less than or equal to the preset distance, determining that the mouse pointer is within a preset distance range near the target placeholder image area within the preset time period; if it is analyzed according to the movement path and the position of the target placeholder image area that the mouse pointer has a tendency to approach the target placeholder image area and the mouse pointer is within a preset distance range near the target placeholder image area within the preset time period, determining that the peripheral operation information indicates adjusting the layout of the target element; if it is determined that the peripheral operation information indicates adjusting the layout of the target element, generating a screen synchronization instruction; transmitting the screen synchronization instruction to the second display adapter, the screen synchronization instruction being used to instruct the second display adapter to transmit a first screen frame to the central processor.

2. The method according to claim 1, characterized in that: The first task information includes device information, and the first data processing task is performed according to the first screen update data and the second screen frame to obtain a third screen frame, including: updating the second picture frame according to the first picture update data to obtain a fourth picture frame; Determine a target audio acquisition device and a target video acquisition device according to the device information; Acquire audio data from the target audio acquisition device, and acquire video data from the target video acquisition device; Determine a fifth picture frame according to the audio data, the video data and the picture layout parameters in the picture layout information; The third picture frame is determined according to the fourth picture frame and the fifth picture frame.

3. The method according to claim 2, characterized in that After performing the first data processing task according to the first picture update data and the second picture frame to obtain a third picture frame, the method further includes: Get the user's current operation information and historical operation information; Predicting a target operation to be performed by a user based on the current operation information, the historical operation information, and a pre-trained operation prediction model; Determining a second rendering parameter according to the target operation; transmitting the second rendering parameter to the second display adapter, where the second display adapter is used to determine second picture update data according to the second rendering parameter; receiving the second picture update data from the second display adapter; A sixth picture frame is determined according to the second picture update data and the fourth picture frame.

4. The method according to claim 3, characterized in that The predicting the target operation to be performed by the user according to the current operation information, the historical operation information and the pre-trained operation prediction model includes: Determine the target time window; Extracting first characteristic information of the current operation information; Extracting second feature information of operation data of the historical operation information within the target time window; Concatenate the first feature information and the second feature information to obtain third feature information; Determining an operation tag of the user; Inputting the third feature information and the operation label into the operation prediction model to obtain multiple probability values ​​of multiple operations; The operation with the largest probability value is taken as the target operation to be performed by the user.

5. The method according to claim 4, characterized in that Determining the target time window includes: Determining a target game type corresponding to the second data processing task; Determining the target game scene where the game character is currently located according to the second picture frame; The target time window is determined according to the target game type and the target game scene.

6. A resource configuration device based on a microcomputer host, characterized in that: A central processing unit applied to a microcomputer host, the microcomputer host comprising the central processing unit and a first display adapter, the central processing unit being respectively connected to the first display adapter and a second display adapter in a graphics card expansion dock, the second display adapter being connected to a first display, the microcomputer host being connected to a second display, the resource configuration device based on the microcomputer host comprising: an acquisition unit, a determination unit, a task execution unit and a transmission unit, wherein: The acquisition unit is used to acquire a plurality of data processing tasks, wherein the plurality of data processing tasks include a first data processing task and a second data processing task, wherein the first data processing task includes first task information, and the first task information includes screen layout information; The determination unit is used to determine at least one layout element according to the screen layout information; select a target element from the at least one layout element according to a preset rule, the target element being a layout element that can completely cover the game screen without exposing any game elements and can form a placeholder area, and the target element includes at least one of the following: a host portrait, an advertisement, and a host virtual image; determine a target layout parameter of the target element; determine a target placeholder image area of ​​the target element according to the target layout parameter, the target placeholder image area being smaller than the occupied area of ​​the target element; The task execution unit is used to execute the second data processing task, obtain a first rendering parameter, and transmit the first rendering parameter and the target placeholder image area to the second display adapter, the second display adapter is used to perform a rendering operation according to the first rendering parameter to obtain a first picture frame, determine first picture update data of the first picture frame according to the first picture frame and the target placeholder image area, and transmit the first picture frame to the first display, the first display is used to display the first picture frame, and the first picture update data does not include picture data corresponding to the target placeholder image area; The acquisition unit is further configured to receive the first screen update data from the second display adapter; The task execution unit is further used to execute the first data processing task according to the first picture update data and the second picture frame to obtain a third picture frame, wherein the second picture frame is a frame previous to the first picture frame cached by the central processing unit; the transmission unit is further used to transmit the third picture frame to the first display adapter, and the first display adapter is used to encode and encapsulate the third picture frame to obtain a data packet; The acquisition unit is further used to receive the data packet from the first display adapter and stream the data packet; After transmitting the first rendering parameter and the target placeholder image area to the second display adapter, the method further includes: obtaining user's peripheral operation information, the peripheral operation information including user's operation information on the mouse and keyboard and mouse position information; determining whether the peripheral operation information indicates adjusting the layout of the target element; including: determining a movement path of the mouse pointer within a preset time period according to the peripheral operation information; determining a plurality of target distances between the mouse pointer and the target placeholder image area within the preset time period; if it is determined that each target distance is less than or equal to the preset distance, determining that the mouse pointer is within a preset distance range near the target placeholder image area within the preset time period; if it is analyzed according to the movement path and the position of the target placeholder image area that the mouse pointer has a tendency to approach the target placeholder image area and the mouse pointer is within a preset distance range near the target placeholder image area within the preset time period, determining that the peripheral operation information indicates adjusting the layout of the target element; if it is determined that the peripheral operation information indicates adjusting the layout of the target element, generating a screen synchronization instruction; transmitting the screen synchronization instruction to the second display adapter, the screen synchronization instruction being used to instruct the second display adapter to transmit a first screen frame to the central processor.

7. An electronic device, characterized in that: The method comprises a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for executing the steps in the method according to any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that: A computer program for electronic data exchange is stored, wherein the computer program enables a computer to execute the method according to any one of claims 1 to 5.

Images