Resource allocation method based on microcomputer host and related device

Abstract

The invention provides a resource allocation method and related device based on a microcomputer host, and the method comprises the steps: obtaining a plurality of data processing tasks, and determining a target occupied image region according to image layout information; executing the second data processing task to obtain a first rendering parameter, transmitting the first rendering parameter and the target occupied image area to the second display adapter, receiving first picture updating data from the second display adapter, executing the first data processing task according to the first picture updating data and the second picture frame to obtain a third picture frame, and displaying the third picture frame on the second display adapter. And transmitting the third picture frame to the first display adapter, receiving the data packet from the first display adapter, and pushing the data packet. By reducing the image data needing to be transmitted between the second display adapter and the central processing unit, the delay influence caused by bandwidth limitation is reduced, the task working efficiency of the system is improved, and the intelligence of resource configuration is improved.

Description

Technical Field

[0001] The present application belongs to the field of host resource configuration, and specifically relates to a resource configuration method and related devices based on a microcomputer host. Background Art

[0002] At present, microcomputer hosts are widely used, but the computing power of microcomputer hosts is limited. The computing power of microcomputer hosts is often improved through external graphics cards through graphics card expansion docks. At this time, the external graphics card may need to process high-resolution and high-refresh-rate image data, but due to the transmission protocol and bandwidth limitations of the graphics card expansion dock, delays often occur. Summary of the invention

[0003] The embodiment of the present application provides a resource configuration method and related device based on a microcomputer host.

[0004] In a first aspect, an embodiment of the present application provides a resource configuration method based on a microcomputer host, which is applied to a central processing unit in the microcomputer host, wherein the microcomputer host includes the central processing unit and a first display adapter, wherein the central processing unit is respectively connected to the first display adapter and a second display adapter in a graphics card expansion dock, and the second display adapter is connected to a first display; the method includes: Acquire multiple data processing tasks, the multiple data processing tasks include a first data processing task and a second data processing task, the first data processing task includes first task information, and the first task information includes screen layout information; Determining a target placeholder image area according to the screen layout information; executing the second data processing task to obtain a first rendering parameter, and transmitting the first rendering parameter and the target placeholder image area to the second display adapter, the second display adapter being used to perform a rendering operation according to the first rendering parameter to obtain a first picture frame, determining first picture update data of the first picture frame according to the first picture frame and the target placeholder image area, transmitting the first picture frame to the first display, and the first display being used to display the first picture frame; receiving the first picture update data from the second display adapter; Execute the first data processing task according to the first picture update data and the second picture frame to obtain a third picture frame, wherein the second picture frame is a frame of the previous picture of the first picture frame cached by the central processing unit; transmitting the third picture frame to the first display adapter, wherein the first display adapter is used for encoding and encapsulating the third picture frame to obtain a data packet; Receive the data packet from the first display adapter, and stream the data packet.

[0005] In a possible example, determining the target placeholder image area according to the screen layout information includes: determining at least one layout element according to the screen layout information; filtering out a target element from the at least one layout element according to a preset rule; determining a target layout parameter of the target element; and determining a target placeholder image area of ​​the target element according to the target layout parameter.

[0006] In one possible example, after transmitting the rendering parameters and the target placeholder image area to the second display adapter, the method further includes: obtaining peripheral operation information of the user; determining whether the peripheral operation information indicates adjusting the layout of the target element; if it is determined that the peripheral operation information indicates adjusting the layout of the target element, generating a screen synchronization instruction; transmitting the screen synchronization instruction to the second display adapter, the screen synchronization instruction being used to instruct the second display adapter to transmit the first screen frame to the central processing unit.

[0007] In a possible example, the first task information includes device information, and executing the first data processing task according to the first picture update data and the second picture frame to obtain the third picture frame includes: updating the second picture frame according to the first picture update data to obtain a fourth picture frame; determining a target audio acquisition device and a target video acquisition device according to the device information; acquiring audio data from the target audio acquisition device, and acquiring video data from the target video acquisition device; determining a fifth picture frame according to the audio data, the video data and picture layout parameters in the picture layout information; and determining the third picture frame according to the fourth picture frame and the fifth picture frame.

[0008] In one possible example, after executing the first data processing task according to the first screen update data and the second screen frame to obtain the third screen frame, the method further includes: acquiring the user's current operation information and historical operation information; predicting the target operation to be performed by the user according to the current operation information, the historical operation information and a pre-trained operation prediction model; determining second rendering parameters according to the target operation; transmitting the second rendering parameters to the second display adapter, the second display adapter being used to determine the second screen update data according to the second rendering parameters; receiving the second screen update data from the second display adapter; and determining a sixth screen frame according to the second screen update data and the fourth screen frame.

[0009] In a possible example, predicting a target operation to be performed by a user based on the current operation information, the historical operation information and a pre-trained operation prediction model includes: determining a target time window; extracting first feature information of the current operation information; extracting second feature information of operation data of the historical operation information within the target time window; concatenating the first feature information and the second feature information to obtain third feature information; determining an operation label of the user; inputting the third feature information and the operation label into the operation prediction model to obtain multiple probability values ​​for multiple operations; and taking the operation with the largest probability value as the target operation to be performed by the user.

[0010] In one possible example, determining the target time window includes: determining a target game type corresponding to the second data processing task; determining a target game scene in which a game character is currently located based on the second screen frame; and determining the target time window based on the target game type and the target game scene.

[0011] In a second aspect, an embodiment of the present application provides a resource configuration device based on a microcomputer host, which is applied to a central processing unit in a microcomputer host, wherein the microcomputer host includes the central processing unit and a first display adapter, wherein the central processing unit is respectively connected to the first display adapter and a second display adapter in a graphics card expansion dock, and the second display adapter is connected to a first display; the device includes an acquisition unit, a determination unit, a task execution unit, and a transmission unit; wherein, The acquisition unit is used to acquire a plurality of data processing tasks, wherein the plurality of data processing tasks include a first data processing task and a second data processing task, wherein the first data processing task includes first task information, and the first task information includes screen layout information; The determining unit is used to determine a target placeholder image area according to the screen layout information; The task execution unit is used to execute the second data processing task, obtain a first rendering parameter, and transmit the first rendering parameter and the target placeholder image area to the second display adapter, the second display adapter is used to perform a rendering operation according to the first rendering parameter to obtain a first picture frame, determine first picture update data of the first picture frame according to the first picture frame and the target placeholder image area, and transmit the first picture frame to the first display, and the first display is used to display the first picture frame; The acquisition unit is further configured to receive the first screen update data from the second display adapter; The task execution unit is further used to execute the first data processing task according to the first picture update data and the second picture frame to obtain a third picture frame, wherein the second picture frame is a frame previous to the first picture frame cached by the central processing unit; The transmission unit is used to transmit the third picture frame to the first display adapter, and the first display adapter is used to encode and encapsulate the third picture frame to obtain a data packet; The acquisition unit is further used to receive the data packet from the first display adapter and stream the data packet.

[0012] A third aspect of the present application provides an electronic device, comprising: a processor and a memory; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for some or all of the steps described in the first aspect.

[0013] A fourth aspect of an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store a computer program, wherein the computer program enables a computer to execute instructions of some or all of the steps described in the first aspect of the embodiment of the present application.

[0014] A fifth aspect of the embodiments of the present application provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute some or all of the steps described in the first aspect of the embodiments of the present application. The computer program product may be a software installation package.

[0015] It can be seen that in the embodiment of the present application, the central processing unit first obtains multiple data processing tasks, then determines the target placeholder image area according to the screen layout information, and then executes the second data processing task to obtain the first rendering parameter, and transmits the first rendering parameter and the target placeholder image area to the second display adapter, the second display adapter is used to perform the rendering operation according to the rendering parameter to obtain the first picture frame, determine the first picture update data of the first picture frame according to the first picture frame and the target placeholder image area, transmit the first picture frame to the first display, the first display is used to display the first picture frame, further, receive the first picture update data from the second display adapter, and further, execute the first data processing task according to the first picture update data and the second picture frame to obtain the third picture frame, the second picture frame is the previous frame of the first picture frame, and then transmit the third picture frame to the first display adapter, the first display adapter is used to encode and encapsulate the third picture frame to obtain a data packet, and finally, receive the data packet from the first display adapter and push the data packet. By determining a placeholder image area, and determining the screen update data to be transmitted based on the placeholder image area, the first picture frame, and the second picture frame, compared to the second display adapter transmitting the entire first picture frame, the image data to be transmitted between the second display adapter and the central processing unit is reduced, and the delay effect caused by the transmission protocol and bandwidth limitations is reduced, which is beneficial to improving the system's task work efficiency and the intelligence of resource allocation. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0017] Figure 1 It is a schematic diagram of the architecture of a resource configuration system based on a microcomputer host provided in an embodiment of the present application; Figure 2 It is a flow chart of a resource configuration method based on a microcomputer host provided in an embodiment of the present application; Figure 3 It is a schematic diagram of a microcomputer host and a graphics card expansion dock provided in an embodiment of the present application; Figure 4 is a schematic diagram of a live broadcast screen provided in an embodiment of the present application; Figure 5 is a schematic diagram of another live broadcast screen provided in an embodiment of the present application; Figure 6 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application; Figure 7 It is a block diagram of the functional units of a resource configuration device based on a microcomputer host provided in an embodiment of the present application. DETAILED DESCRIPTION

[0018] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0019] The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.

[0020] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0021] In the embodiments of the present application, "and / or" describes the association relationship of the associated objects, indicating that three relationships may exist. For example, A and / or B can represent the following three situations: A exists alone; A and B exist at the same time; B exists alone. Among them, A and B can be singular or plural.

[0022] In the embodiment of the present application, the symbol " / " can indicate that the objects associated with each other are in an "or" relationship. In addition, the symbol " / " can also indicate a division sign, that is, performing a division operation. For example, A / B can indicate A divided by B.

[0023] In the embodiments of the present application, "at least one item" or similar expressions refer to any combination of these items, including any combination of single items or plural items, and refer to one or more, and multiple refers to two or more. For example, at least one item of a, b, or c can represent the following seven situations: a, b, c, a and b, a and c, b and c, a, b, and c. Among them, each of a, b, and c can be an element or a set containing one or more elements.

[0024] In the embodiments of the present application, "equal to" can be used in conjunction with greater than, and is applicable to the technical solution adopted when greater than, and can also be used in conjunction with less than, and is applicable to the technical solution adopted when less than. When equal to is used in conjunction with greater than, it is not used in conjunction with less than; when equal to is used in conjunction with less than, it is not used in conjunction with greater than.

[0025] In order to better understand the solutions of the embodiments of the present application, the electronic devices, related concepts and backgrounds that may be involved in the embodiments of the present application are first introduced below.

[0026] The electronic device of the application embodiment is a device with wireless communication function, which can be called terminal, user equipment (UE), mobile station (MS), mobile terminal (MT), access terminal equipment, vehicle-mounted terminal equipment, industrial control terminal equipment, UE unit, UE station, mobile station, remote station, remote terminal equipment, mobile device, UE terminal equipment, wireless communication equipment, UE agent or UE device, etc. The terminal device can be fixed or mobile. It should be noted that the terminal device can support at least one wireless communication technology, such as LTE, new radio (NR), wideband code division multiple access (WCDMA), etc. For example, the terminal device may be a mobile phone, a tablet computer (pad), a desktop computer, a laptop computer, an all-in-one computer, a vehicle-mounted terminal, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal in industrial control, a wireless terminal in self-driving, a wireless terminal in remote medical surgery, a wireless terminal in smart grid, a wireless terminal in transportation safety, a wireless terminal in smart city, a wireless terminal in smart home, a cellular phone, a cordless phone, a session initiation protocol (SIP) phone, a wireless local loop (WLL) station, a personal digital assistant (PDA), a handheld device with wireless communication function, an electronic device or other processing device connected to a wireless modem, a wearable device, a terminal device in a future mobile communication network, or a terminal device in a future evolving public land mobile network (PLMN), etc. The electronic device may be a microcomputer host.

[0027] See also Figure 1 , Figure 1 Schematic diagram of the architecture of a resource configuration system based on a microcomputer host provided in an embodiment of the present application. Figure 1As shown, the resource configuration system 1 based on the microcomputer host includes a microcomputer host 10 and a graphics card expansion dock 20. The microcomputer host 10 is connected to the graphics card expansion dock 20. The microcomputer host 10 includes a central processing unit (CPU) 11 and a first display adapter 12. The graphics card expansion dock 20 includes a second display adapter 21. The central processing unit 11 is respectively connected to the first display adapter 12 and the second display adapter 21.

[0028] Among them, the resource configuration system 1 can also include a first display 30 and a second display 40. The first display 30 is connected to the graphics card expansion dock 20. The first display 30 is used to display the game screen frame transmitted by the second display adapter 21. The second display 40 is used to receive the live screen frame from the microcomputer host 10 and display the live screen frame.

[0029] Among them, the microcomputer host 10 outputs a signal to the graphics card expansion dock 20 through the Thunderbolt interface. The graphics card expansion dock 20 may include a Thunderbolt interface and a Thunderbolt to PCIe line. The two ends of the Thunderbolt to PCIe line are respectively connected to the Thunderbolt interface of the graphics card expansion dock 20 and the second display adapter. The Thunderbolt interface of the microcomputer host 10 can be connected to the Thunderbolt interface of the graphics card expansion dock 20 through a Thunderbolt cable.

[0030] The graphics card expansion dock 20 is connected to the graphics card expansion dock 20 via a PCIe (Peripheral Component Interconnect Express) bus. The display interface of the graphics card expansion dock 20 outputs the video signal of the game screen frame to the first display 30. The display interface can be an HDMI interface, a DP interface, a VGA interface, etc., which is not limited here.

[0031] Among them, the central processing unit 11 can receive data processing tasks assigned by the scheduler of the operating system of the microcomputer host 10. The data processing tasks may include game tasks, live broadcast tasks and other tasks. The central processing unit 11 includes multiple threads. The central processing unit 11 can separate at least one thread to execute game tasks, and at the same time separate at least one thread to execute live broadcast tasks.

[0032] The central processing unit 11 can cooperate with the streaming software to stream the encoded and encapsulated data packets to the live broadcast platform server through the network.

[0033] The central processor 11 may also obtain the audio data of the user collected by the sound card, and may obtain the video data of the user collected by the camera.

[0034] The first display adapter and the second display adapter may be a graphics card, a graphics processor, a video card, etc.

[0035] The microcomputer host may be a Mini PC.

[0036] In a possible example, the central processor 11 first obtains multiple data processing tasks, and then determines the target placeholder image area according to the screen layout information. The central processor 11 then performs a second data processing task to obtain rendering parameters, and transmits the rendering parameters and the target placeholder image area to the second display adapter 21. The second display adapter 21 is used to perform a rendering operation according to the rendering parameters to obtain a first picture frame, determine the first picture update data of the first picture frame according to the first picture frame and the target placeholder image area, and transmit the first picture frame to the first display 30. The first display 30 is used to display the first picture frame. Further, the central processor 11 receives the first picture update data from the second display adapter 21, and further, performs the first data processing task according to the first picture update data and the second picture frame to obtain a third picture frame, and the second picture frame is the previous frame of the first picture frame. Then, the central processor 11 transmits the third picture frame to the first display adapter, and the first display adapter 12 is used to encode and encapsulate the third picture frame to obtain a data packet. Finally, the data packet from the first display adapter 12 is received and the data packet is pushed. By determining the placeholder image area and determining the screen update data to be transmitted based on the placeholder image area, the first screen frame and the second screen frame, compared with the second display adapter transmitting the entire first screen frame, the image data to be transmitted between the second display adapter 21 and the central processor 11 is reduced, and the delay effect caused by the transmission protocol and bandwidth limitations is reduced, which is beneficial to improving the system's task work efficiency and the intelligence of resource allocation.

[0037] See also Figure 2 , Figure 2 1 is a flow chart of a resource configuration method based on a microcomputer host provided by an embodiment of the present application, which is applied to a central processing unit in a microcomputer host, wherein the microcomputer host includes the central processing unit and a first display adapter, wherein the central processing unit is respectively connected to the first display adapter and a second display adapter in a graphics card expansion dock, wherein the second display adapter is connected to a first display, and wherein the method includes: Step S201, obtaining a plurality of data processing tasks, wherein the plurality of data processing tasks include a first data processing task and a second data processing task, wherein the first data processing task includes first task information, and the first task information includes screen layout information.

[0038] Among them, the first data processing task may be a live broadcast task, which includes but is not limited to live broadcast picture synthesis tasks, streaming tasks, audio processing tasks, video processing tasks, and live broadcast software processing tasks. For example, the live broadcast picture synthesis task may be to synthesize the anchor picture based on the user's audio collected by the sound card and the user's video collected by the camera, and then synthesize the live broadcast picture based on the live broadcast picture and the game picture; the streaming task is to cooperate with the live broadcast software to stream the data packets encoded and encapsulated by the live broadcast picture through the network; the audio processing task includes but is not limited to encoding, noise reduction, mixing, etc. of the acquired audio data; the video processing task includes but is not limited to encoding and other processing of the acquired video data. The second data processing task may be a game task, which includes but is not limited to game logic calculation tasks, physical simulation calculation tasks, artificial intelligence calculation tasks and scene rendering processing tasks. For example, the game logic calculation task may be the calculation of various attributes of a character in a role-playing game, such as the increase or decrease of health points, magic points, and experience points, as well as logical judgments such as character upgrades, skill releases, and task completion. It may be a strategy calculation in a strategy game, including marching routes, battle result predictions, resource production and allocation, etc.; the physical simulation calculation task may be the simulation of the physical movement of a vehicle in a racing game, including the calculation of physical effects such as acceleration, deceleration, steering, and collision, as well as the interaction between the vehicle and the track and other vehicles; it may be the calculation of physical effects such as the flight trajectory of bullets, hit determination, and weapon recoil in a shooting game; the artificial intelligence calculation task may be the control of the behavior and decision of non-player characters (NPCs) in the game, for example, intelligent calculation of NPC patrols, dialogues, and task releases; the scene rendering processing task may be the pre-processing of data such as models, textures, and lighting in the scene when the game scene is switched or a new scene is loaded, such as the loading of models, decompression and mapping of textures, and calculation of lighting effects.

[0039] The screen layout information includes at least one layout element and layout parameters corresponding to the layout element, and the layout element includes at least one of the following: anchor portrait, text, advertisement, anchor virtual image, and live screen decoration element.

[0040] Step S202: determining a target placeholder image area according to the screen layout information.

[0041] Among them, the target placeholder image area is a partial image area where the layout elements are laid out in the live broadcast screen, and the user cannot recognize the game elements covered by this partial image area. In the live broadcast screen, the anchor portrait, live broadcast virtual image, advertisements, etc. are often superimposed on the game screen. In the image area occupied by the anchor portrait, live broadcast virtual image, advertisements and other elements, the user cannot see the game screen under these image areas when watching the live broadcast. For example: the live broadcast screen often includes the anchor portrait frame, the anchor portrait frame is superimposed on the game screen, and the user cannot see the game screen covered by the anchor portrait frame.

[0042] Step S203, execute the second data processing task, obtain the first rendering parameter, and transmit the first rendering parameter and the target placeholder image area to the second display adapter, the second display adapter is used to perform a rendering operation according to the first rendering parameter to obtain a first screen frame, determine the first screen update data of the first screen frame according to the first screen frame and the target placeholder image area, transmit the first screen frame to the first display, and the first display is used to display the first screen frame.

[0043] Among them, the central processing unit performs the second data processing task, such as: scene rendering processing task, and calculates the rendering parameters, which include but are not limited to game character parameters, action posture parameters and special effect parameters, etc. For example, the character parameters include the position coordinates of the character, the action posture parameters include the action posture of the character, and the special effect parameters include the position and range of special effects such as skill special effects and scene special effects, etc., which are not limited here. The central processing unit packs the rendering parameters to obtain a rendering parameter data packet, and transmits the rendering parameter data packet to the second display adapter through the PCIe bus. After receiving the rendering parameter data packet, the second display adapter unpacks the rendering parameter data packet, performs corresponding rendering operations based on the rendering parameters, and generates the current first screen frame of the game. For example, the rendering operation can be rendering the character model, clothing, skin texture, etc. of the game character, rendering the game environment elements such as mountains, forests, lakes, rendering animations, etc., which are not limited here.

[0044] Among them, the second display adapter is connected to the first display. Compared with the first display being connected to the microcomputer host, the second first display adapter needs to return the first picture frame to the microcomputer host, and the microcomputer host transmits the first picture frame to the first display, which is beneficial to reducing data transmission time.

[0045] Specifically, the second picture frame is the previous frame of the first picture frame, and determining the first picture update data includes the following steps: determining, based on the first picture frame and the second picture frame, third picture update data that is updated for the first picture frame compared to the second picture frame; removing picture data in the target image area from the third picture update data to obtain the first picture update data.

[0046] See also Figure 3 , Figure 3 This is a schematic diagram of a microcomputer host and a graphics card expansion dock provided in an embodiment of the present application. The microcomputer host is connected to a camera, a graphics card expansion dock and a second display respectively. The graphics card expansion dock is connected to the first display. The first display displays the game screen, i.e., the first screen frame. The second display displays the live broadcast screen, which includes the game screen and the anchor's portrait.

[0047] For example, see Figure 4-Figure 5 , Figure 4 is a schematic diagram of a live broadcast screen provided in an embodiment of the present application. Figure 5 is a schematic diagram of another live broadcast screen provided in an embodiment of the present application. Figure 4 The live broadcast picture shown is the second picture frame, and the second picture frame includes the first character and the environment scene. Figure 5 The live screen shown is the first screen frame, which includes the first character, the second character and the environmental scene. The first screen frame updates the second character compared to the second screen frame, while the environmental scene does not change. Then the screen data corresponding to the first area where the second character is located in the first screen frame is the third screen update data, and part of the body of the second character is in the target placeholder image area, and the part of the body in the target placeholder image area cannot be seen by the user. Therefore, the first area can be divided into the second area and the third area. The second area is a partial area in the target placeholder image area. The screen data in the second area in the third screen update data can be removed to obtain the first screen update data.

[0048] Step S204: receiving the first image update data from the second display adapter.

[0049] The second display adapter can transmit the first picture update data to the central processing unit via the PCIe bus.

[0050] Step S205, executing the first data processing task according to the first picture update data and the second picture frame to obtain a third picture frame, wherein the second picture frame is a frame previous to the first picture frame cached by the central processing unit.

[0051] Among them, the second screen frame can be updated based on the first screen update data to obtain the current fourth screen frame of the game. The fourth screen frame does not include part of the game screen in the target placeholder image area, and the third screen frame also does not include part of the game screen in the target placeholder image area.

[0052] The third picture frame may be a live picture frame.

[0053] Step S206: transmitting the third picture frame to the first display adapter, wherein the first display adapter is used to encode and encapsulate the third picture frame to obtain a data packet.

[0054] Among them, if the first display adapter of the microcomputer host is used to perform the game rendering task and encode and package the live screen frames at the same time, the encoding and packaging of the live screen frames may occupy too many graphics card resources, causing the game to appear stuck, frame drops, etc., affecting the game experience and the live broadcast experience; and when the second display adapter is used to perform the game rendering task and encode and package the live screen frames, the amount of data that needs to be sent back to the central processing unit increases, and the delay has a greater impact. Therefore, the second display adapter is selected to perform the game rendering task, and the live screen frames are encoded and packaged by the first display adapter. The first display adapter and the second display adapter divide the work of performing live broadcast related tasks and game related tasks, which can improve the stability of the system in running games and live broadcasts.

[0055] Step S207, receiving the data packet from the first display adapter, and streaming the data packet.

[0056] It can be seen that in the embodiment of the present application, the central processing unit first obtains multiple data processing tasks, then determines the target placeholder image area according to the screen layout information, and then executes the second data processing task to obtain the first rendering parameter, and transmits the first rendering parameter and the target placeholder image area to the second display adapter, the second display adapter is used to perform the rendering operation according to the rendering parameter to obtain the first picture frame, determine the first picture update data of the first picture frame according to the first picture frame and the target placeholder image area, transmit the first picture frame to the first display, the first display is used to display the first picture frame, further, receive the first picture update data from the second display adapter, and further, execute the first data processing task according to the first picture update data and the second picture frame to obtain the third picture frame, the second picture frame is the previous frame of the first picture frame, and then transmit the third picture frame to the first display adapter, the first display adapter is used to encode and encapsulate the third picture frame to obtain a data packet, and finally, receive the data packet from the first display adapter and push the data packet. By determining a placeholder image area, and determining the screen update data to be transmitted based on the placeholder image area, the first picture frame, and the second picture frame, compared to the second display adapter transmitting the entire first picture frame, the image data to be transmitted between the second display adapter and the central processing unit is reduced, and the delay effect caused by the transmission protocol and bandwidth limitations is reduced, which is beneficial to improving the system's task work efficiency and the intelligence of resource allocation.

[0057] In a possible example, in terms of determining the target placeholder image area according to the screen layout information, the above method may further include the following steps: determining at least one layout element according to the screen layout information; filtering out a target element from the at least one layout element according to a preset rule; determining a target layout parameter of the target element; and determining a target placeholder image area of ​​the target element according to the target layout parameter.

[0058] Among them, the target element refers to a layout element that can completely cover the game screen without revealing any game elements and can form a certain placeholder area. The target elements include at least one of the anchor's portrait, advertisement, and anchor's virtual image. Text is difficult to form a certain placeholder area and is not a target element.

[0059] Among them, the occupied area of ​​the entire target element on the live broadcast screen can be determined according to the layout parameters, and then the target placeholder image area is determined according to the occupied area, and the target placeholder image area is smaller than the occupied area.

[0060] The shape of the target placeholder image area is not limited, and may be a rectangle, a circle, or an irregular shape. For example, the area where the anchor portrait is located is often a rectangular area.

[0061] For example, see Figure 3 , the live broadcast screen displayed on the second display in the figure includes the game screen and the anchor portrait. The anchor portrait is located in the lower right corner of the live broadcast screen and is in the occupied area. The target placeholder image area is smaller than the occupied area and is in the occupied area.

[0062] It can be seen that in this example, by screening out the target element from at least one layout element, and then determining the occupied area of ​​the target element according to the layout parameters of the target element, and then further determining the target placeholder image area, and making the target placeholder image area smaller than the occupied area of ​​the target element, it is beneficial to reduce the risk of abnormal live streaming and to improve the task work efficiency of the system.

[0063] In one possible example, after transmitting the rendering parameters and the target placeholder image area to the second display adapter, the method may include the following steps: obtaining the user's peripheral operation information; determining whether the peripheral operation information indicates adjusting the layout of the target element; if it is determined that the peripheral operation information indicates adjusting the layout of the target element, generating a screen synchronization instruction; transmitting the screen synchronization instruction to the second display adapter, wherein the screen synchronization instruction is used to instruct the second display adapter to transmit the first screen frame to the central processing unit.

[0064] The peripheral operation information may include the user's current operation on the mouse and keyboard, the mouse position information, and other peripheral operations.

[0065] Optionally, determining whether the external device operation information indicates adjusting the layout of the target element may include the following steps: if it is analyzed based on the external device operation information that there is a trend of the mouse pointer approaching the target placeholder image area and the position of the mouse pointer is within a preset distance range near the target placeholder image area, then determining that the external device operation information indicates adjusting the layout of the target element.

[0066] Specifically, the movement path of the mouse pointer within a preset time period can be determined based on the peripheral operation information, and the movement path and the position of the target placeholder image area can be analyzed to determine whether the mouse pointer has a trend of approaching the target placeholder image area. If it is analyzed that the mouse pointer has a trend of approaching the target placeholder image area and the position of the mouse pointer is always within a preset distance range near the target placeholder image area within the preset time period, it is determined that the peripheral operation information indicates to adjust the layout of the target element.

[0067] Optionally, the target distance between the mouse pointer and the target placeholder image area within a preset time period can be determined in real time. If multiple target distances are determined within the preset time period and it is determined that any target distance is less than or equal to the preset distance, it is determined that the position of the mouse pointer within the preset time period is always within a preset distance range near the target placeholder image area.

[0068] Among them, the preset time period can be set manually or by system default, and is not limited here; the preset distance range can be set manually or by system default, and is not limited here.

[0069] Optionally, determining whether the peripheral operation information indicates adjusting the layout of the target element may include the following steps: if it is analyzed based on the peripheral operation information that the user opens the layout setting page of the target element, determining that the peripheral operation information indicates adjusting the layout of the target element.

[0070] Among them, when it is determined that the peripheral operation information indicates to adjust the layout of the target element, it means that the position of the target placeholder image area needs to be changed. At this time, the game screen under the target placeholder image area needs to be displayed. At this time, the central processing unit can transmit a screen synchronization instruction to the second display adapter, instructing the second display adapter to transmit the complete first screen frame to prevent abnormal live broadcast screen streaming.

[0071] It can be seen that in this example, when the central processing unit determines that the peripheral operation information indicates to adjust the layout of the target element, it can promptly instruct the second display adapter to resume transmitting the complete first picture frame, which is beneficial to reducing the risks of live picture synthesis abnormalities and streaming abnormalities, and is beneficial to improving the stability of the central processing unit's synthesis of live pictures.

[0072] In one possible example, the first task information includes device information. In terms of executing the first data processing task according to the first picture update data and the second picture frame to obtain the third picture frame, the method may include the following steps: updating the second picture frame according to the first picture update data to obtain a fourth picture frame; determining a target audio acquisition device and a target video acquisition device according to the device information; acquiring audio data from the target audio acquisition device, and acquiring video data from the target video acquisition device; determining a fifth picture frame according to the audio data, the video data and the picture layout parameters in the picture layout information; and determining the third picture frame according to the fourth picture frame and the fifth picture frame.

[0073] Among them, the fourth screen frame is obtained by the central processing unit using the first screen update data to update the second screen frame. The fourth screen frame is a game screen frame. The fourth screen frame is different from the first screen frame. The fourth screen frame does not include part of the game screen in the target placeholder image area.

[0074] The target audio acquisition device may be a sound card, and the target video acquisition device may be a camera.

[0075] Among them, audio data includes the host's voice, environmental sound and timestamp, and video data includes timestamp and host's portrait.

[0076] Among them, the fifth picture frame is a live picture frame. The central processing unit synthesizes the live picture frame according to the timestamp, picture layout parameters, audio data and video data collected by the sound card to obtain the fifth picture frame, and superimposes the fifth picture frame on the fourth picture frame to obtain the third picture frame.

[0077] It can be seen that in this example, the central processing unit can update the second picture frame according to the first picture update data to obtain the fourth picture frame, and synthesize the fifth picture frame according to the audio data and the video data, and superimpose the fifth picture frame on the fourth picture frame to obtain the third picture frame, which is conducive to improving the task work efficiency of the system.

[0078] In one possible example, after executing the first data processing task according to the first screen update data and the second screen frame to obtain the third screen frame, the method may include the following steps: acquiring the user's current operation information and historical operation information; predicting the target operation to be performed by the user according to the current operation information, the historical operation information and a pre-trained operation prediction model; determining second rendering parameters according to the target operation; transmitting the second rendering parameters to the second display adapter, the second display adapter being used to determine the second screen update data according to the second rendering parameters; receiving the second screen update data from the second display adapter; and determining a sixth screen frame according to the second screen update data and the fourth screen frame.

[0079] Among them, the user's game operations are often multiple and continuous, so when predicting the user's next operation, the user's historical operations also need to be considered.

[0080] Among them, current operation information may include the user's current game operation, historical operation information may include the user's game operation history within a certain time window, and game operation records may include the mouse movement trajectory, click time, click position, keyboard button pressing and releasing, operations of other game peripherals, etc.

[0081] Among them, a training set can be constructed based on historical operation information, and the neural network model can be trained using the training set to obtain a trained operation prediction model.

[0082] Among them, the game operation that the user will perform, that is, the target operation, is predicted through the user's current operation information, historical operation information and operation prediction model, so that the second display adapter can complete the rendering operation corresponding to the target operation earlier based on the second rendering parameters, and obtain the seventh screen frame. The seventh screen frame is the next frame of the predicted first screen frame, and the second screen update data is determined according to the seventh screen frame, the first screen frame and the target placeholder image area, and the central processing unit updates the fourth screen frame with the second screen update data to obtain the sixth screen frame.

[0083] The second picture update data is picture data of the seventh picture frame updated compared with the first picture frame, and the second picture update data does not include picture data of the target placeholder image area.

[0084] For example, the current game is a shooting game, and the user's current operation information is that the user slid the mouse to the left and clicked the right button of the mouse. The user's historical operation information shows that before the user slid the mouse to the left and clicked the right button of the mouse, the user simultaneously pressed and held the w key and the shift key on the keyboard and clicked the space bar. Then, based on the current operation information and the historical operation information, the operation prediction model can predict that the user wants to complete a continuous shooting operation of jumping forward, rotating the perspective, shooting and aiming, and the shooting operation is to click the left button of the mouse. Then, it is finally predicted that the user's next operation, that is, the target operation, is to click the left button of the mouse.

[0085] It can be seen that in this example, the target operation that the user will perform can be predicted based on the user's current operation information and historical operation information, and then the second display adapter can execute the rendering operation corresponding to the target operation, and determine the second screen update data, and send back the second screen update data in advance, which is conducive to improving the task execution efficiency of the system.

[0086] In one possible example, in terms of predicting the target operation to be performed by the user based on the current operation information, the historical operation information and a pre-trained operation prediction model, the above method may include the following steps: determining a target time window; extracting first feature information of the current operation information; extracting second feature information of the operation data of the historical operation information within the target time window; concatenating the first feature information and the second feature information to obtain third feature information; determining the operation label of the user; inputting the third feature information and the operation label into the operation prediction model to obtain multiple probability values ​​for multiple operations; and taking the operation with the largest probability value as the target operation to be performed by the user.

[0087] Among them, the user's game operations are often multiple and continuous, and multiple game operations are often completed within a certain time window. Therefore, historical operations and current game operations within a certain time window can be selected to predict the game operations that the user will perform.

[0088] Among them, the characteristic information includes but is not limited to the mean and variance of the operation interval time, the frequency of occurrence of a specific operation within a certain period of time, the two-dimensional distribution of the mouse click position on the screen, the number of mouse clicks, the duration of the clicks, the order of multiple mouse operations and / or multiple keyboard keys being pressed, etc., which are not limited here.

[0089] Among them, each operation corresponds to a probability value. For example, multiple operations are predicted to be clicking the right mouse button, clicking the left mouse button, and sliding the mouse to the right. Among them, the probability value of clicking the right mouse button is 10%, the probability value of clicking the left mouse button is 70%, and the probability value of sliding the mouse to the right is 20%. Then the probability value of clicking the left mouse button is the largest, and clicking the left mouse button is the target operation.

[0090] Optionally, the game time, game achievements and game operation evaluation information of the user playing the current game can be obtained, and the user's operation label can be determined based on the game time, game achievements and game operation evaluation information.

[0091] Among them, when predicting the user's target operation, the operation label should be considered. Users with good game operation skills can often perform a series of operations that are coherent, complete, and difficult, while users with poor game operation skills can often only perform simpler operations.

[0092] Among them, game achievements can be achievements associated with game operations. The more game achievements, the better the user's game operations. The game operation evaluation information reflects the quality of the user's game operations. The operation label can include game period sub-labels and operation level sub-labels. For example: the game period sub-labels include novice period, familiarization period and proficient period. The operation level sub-labels include novice level, intermediate level, advanced level and professional level. The operation level increases from left to right. For users in the novice period, they may not even be used to the game buttons and the regularity of operations is poor. For users in the proficient period, they can often perform multiple operations unique to the current game.

[0093] The first characteristic information and the second characteristic information may be spliced ​​directly in chronological order.

[0094] It can be seen that in this example, when predicting the operation that the user will perform, considering the time window and the operation label is conducive to improving the accuracy of the operation prediction.

[0095] In one possible example, in terms of determining the target time window, the above method may include the following steps: determining the target game type corresponding to the second data processing task; determining the target game scene in which the game character is currently located based on the second screen frame; and determining the target time window based on the target game type and the target game scene.

[0096] Among them, the time window of multiple consecutive operations of the user is often related to the game type and game scene. For example, for strategy games, users often think while operating, and the time window of multiple operations is longer, while for music games, the user's operation rhythm is faster, and the time window of multiple operations is shorter. For game scenes, for example, in the game boss strategy scene, users often need to frequently click mouse buttons and / or keyboard buttons to release game skills, and the time window of multiple operations is shorter. In the tracking game scene, users often click mouse buttons and / or keyboard buttons at a longer interval, and the time window of multiple operations is longer.

[0097] For example, for music-type games and game scenes that are level challenge scenes, the set time window is shorter, at 0.1 seconds to 0.3 seconds; for strategy-type games and game scenes that are strategy battle scenes, the set time window is longer, at 1 second to 2 seconds.

[0098] Optionally, preset rules may be stored in advance, the preset rules including the correspondence between game types and game scenes and time windows, and the corresponding target time window in the preset rules may be queried based on the target game type and target game scene.

[0099] It can be seen that in this example, the target time window can be determined based on the game type and game scenario, which is beneficial to improving the accuracy of time window determination and the accuracy of operation prediction.

[0100] See also Figure 6 , Figure 6 1 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application, which is applied to a central processing unit in a microcomputer host, wherein the microcomputer host includes the central processing unit and a first display adapter, wherein the central processing unit is respectively connected to the first display adapter and a second display adapter in a graphics card expansion dock, and the second display adapter is connected to a first display; Figure 6 As shown, the electronic device includes a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory, and the one or more programs are configured to execute the following steps by the processor: Acquire multiple data processing tasks, the multiple data processing tasks include a first data processing task and a second data processing task, the first data processing task includes first task information, and the first task information includes screen layout information; Determining a target placeholder image area according to the screen layout information; executing the second data processing task to obtain a first rendering parameter, and transmitting the first rendering parameter and the target placeholder image area to the second display adapter, the second display adapter being used to perform a rendering operation according to the first rendering parameter to obtain a first picture frame, determining first picture update data of the first picture frame according to the first picture frame and the target placeholder image area, transmitting the first picture frame to the first display, and the first display being used to display the first picture frame; receiving the first picture update data from the second display adapter; Execute the first data processing task according to the first picture update data and the second picture frame to obtain a third picture frame, wherein the second picture frame is a frame of the previous picture of the first picture frame cached by the central processing unit; transmitting the third picture frame to the first display adapter, wherein the first display adapter is used for encoding and encapsulating the third picture frame to obtain a data packet; Receive the data packet from the first display adapter, and stream the data packet.

[0101] It can be seen that in the embodiment of the present application, the central processing unit first obtains multiple data processing tasks, then determines the target placeholder image area according to the screen layout information, and then executes the second data processing task to obtain the first rendering parameter, and transmits the first rendering parameter and the target placeholder image area to the second display adapter, the second display adapter is used to perform the rendering operation according to the rendering parameter to obtain the first picture frame, determine the first picture update data of the first picture frame according to the first picture frame and the target placeholder image area, transmit the first picture frame to the first display, the first display is used to display the first picture frame, further, receive the first picture update data from the second display adapter, and further, execute the first data processing task according to the first picture update data and the second picture frame to obtain the third picture frame, the second picture frame is the previous frame of the first picture frame, and then transmit the third picture frame to the first display adapter, the first display adapter is used to encode and encapsulate the third picture frame to obtain a data packet, and finally, receive the data packet from the first display adapter and push the data packet. By determining a placeholder image area, and determining the screen update data to be transmitted based on the placeholder image area, the first picture frame, and the second picture frame, compared to the second display adapter transmitting the entire first picture frame, the image data to be transmitted between the second display adapter and the central processing unit is reduced, and the delay effect caused by the transmission protocol and bandwidth limitations is reduced, which is beneficial to improving the system's task work efficiency and the intelligence of resource allocation.

[0102] The above mainly introduces the scheme of the embodiment of the present application from the perspective of the execution process on the method side. It is understandable that, in order to realize the above functions, the electronic device includes a hardware structure and / or software module corresponding to the execution of each function. It should be easily appreciated by those skilled in the art that, in combination with the units and algorithm steps of each example described in the embodiments provided herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present application.

[0103] The embodiment of the present application can divide the electronic device into functional units according to the above method example. For example, each functional unit can be divided according to each function, or two or more functions can be integrated into one processing unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional units. It should be noted that the division of units in the embodiment of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0104] In the case of dividing each functional module into corresponding functional modules, Figure 7 A functional unit block diagram of a resource allocation device based on a microcomputer host is given, such as Figure 7 As shown, a central processing unit is applied to a microcomputer host, the microcomputer host includes the central processing unit and a first display adapter, the central processing unit is respectively connected to the first display adapter and the second display adapter in the graphics card expansion dock, and the second display adapter is connected to the first display; the device includes an acquisition unit 701, a determination unit 702, a task execution unit 703 and a transmission unit 704; wherein, The acquisition unit 701 is used to acquire multiple data processing tasks, where the multiple data processing tasks include a first data processing task and a second data processing task, where the first data processing task includes first task information, and the first task information includes screen layout information; The determining unit 702 is used to determine a target placeholder image area according to the screen layout information; The task execution unit 703 is used to execute the second data processing task, obtain a first rendering parameter, and transmit the first rendering parameter and the target placeholder image area to the second display adapter, the second display adapter is used to perform a rendering operation according to the first rendering parameter to obtain a first picture frame, determine first picture update data of the first picture frame according to the first picture frame and the target placeholder image area, and transmit the first picture frame to the first display, and the first display is used to display the first picture frame; The acquisition unit 701 is further configured to receive the first screen update data from the second display adapter; The task execution unit 703 is further used to execute the first data processing task according to the first picture update data and the second picture frame to obtain a third picture frame, wherein the second picture frame is a frame previous to the first picture frame cached by the central processing unit; The transmission unit 704 is used to transmit the third picture frame to the first display adapter, and the first display adapter is used to encode and encapsulate the third picture frame to obtain a data packet; The acquisition unit 701 is further configured to receive the data packet from the first display adapter and stream the data packet.

[0105] It can be seen that the resource configuration device based on the microcomputer host described in the embodiment of the present application first obtains multiple data processing tasks, then determines the target placeholder image area according to the screen layout information, and then executes the second data processing task to obtain the first rendering parameter, and transmits the first rendering parameter and the target placeholder image area to the second display adapter. The second display adapter is used to perform a rendering operation according to the rendering parameter to obtain a first picture frame, determine the first picture update data of the first picture frame according to the first picture frame and the target placeholder image area, and transmit the first picture frame to the first display. The first display is used to display the first picture frame, further, receive the first picture update data from the second display adapter, and further, execute the first data processing task according to the first picture update data and the second picture frame to obtain a third picture frame, the second picture frame is the previous frame of the first picture frame, and then transmit the third picture frame to the first display adapter. The first display adapter is used to encode and encapsulate the third picture frame to obtain a data packet. Finally, receive the data packet from the first display adapter and push the data packet. By determining a placeholder image area, and determining the screen update data to be transmitted based on the placeholder image area, the first picture frame, and the second picture frame, compared to the second display adapter transmitting the entire first picture frame, the image data to be transmitted between the second display adapter and the central processing unit is reduced, and the delay effect caused by the transmission protocol and bandwidth limitations is reduced, which is beneficial to improving the system's task work efficiency and the intelligence of resource allocation.

[0106] It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0107] The electronic device provided in this embodiment is used to execute the above-mentioned resource configuration method based on the microcomputer host, and thus can achieve the same effect as the above-mentioned implementation method.

[0108] In the case of an integrated unit, the electronic device may include a processing module, a storage module and a communication module. The processing module may be used to control and manage the actions of the electronic device, for example, it may be used to support the electronic device to execute the steps performed by the above-mentioned functional unit. The storage module may be used to support the electronic device to execute stored program codes and data, etc. The communication module may be used to support the communication between the electronic device and other devices.

[0109] Among them, the processing module can be a processor or a controller. It can implement or execute various exemplary logic boxes, modules and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, etc. The storage module can be a memory. The communication module can specifically be a device that interacts with other electronic devices, such as a radio frequency circuit, a Bluetooth chip, a Wi-Fi chip, etc.

[0110] An embodiment of the present application also provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, wherein the computer program enables a computer to execute part or all of the steps of any method described in the above method embodiments, and the above computer includes an electronic device.

[0111] The present application also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute some or all of the steps of any method described in the method embodiment. The computer program product may be a software installation package, and the computer includes a control platform.

[0112] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0113] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0114] In the several embodiments provided in the present application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only schematic, such as the division of the above-mentioned units, which is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical or other forms.

[0115] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0116] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0117] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a memory, including a number of instructions to enable a computer device (which can be a personal computer, server or network device, etc.) to execute all or part of the steps of the above-mentioned methods in each embodiment of the present application. The aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or optical disk and other media that can store program codes.

[0118] A person of ordinary skill in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable memory, which can include: a flash drive, a read-only memory, a random access memory, a magnetic disk or an optical disk, etc.

[0119] The embodiments of the present application are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and core idea of ​​the present application. At the same time, for general technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A resource configuration method based on a microcomputer host, characterized in that: A central processing unit applied to a microcomputer host, the microcomputer host comprising the central processing unit and a first display adapter, the central processing unit being respectively connected to the first display adapter and a second display adapter in a graphics card expansion dock, the second display adapter being connected to a first display; the method comprising: Acquire multiple data processing tasks, the multiple data processing tasks include a first data processing task and a second data processing task, the first data processing task includes first task information, and the first task information includes screen layout information; Determining a target placeholder image area according to the screen layout information; executing the second data processing task to obtain a first rendering parameter, and transmitting the first rendering parameter and the target placeholder image area to the second display adapter, the second display adapter being used to perform a rendering operation according to the first rendering parameter to obtain a first picture frame, determining first picture update data of the first picture frame according to the first picture frame and the target placeholder image area, transmitting the first picture frame to the first display, and the first display being used to display the first picture frame; receiving the first picture update data from the second display adapter; Execute the first data processing task according to the first picture update data and the second picture frame to obtain a third picture frame, wherein the second picture frame is a frame of the previous picture of the first picture frame cached by the central processing unit; transmitting the third picture frame to the first display adapter, wherein the first display adapter is used for encoding and encapsulating the third picture frame to obtain a data packet; Receive the data packet from the first display adapter, and stream the data packet.

2. The method according to claim 1, characterized in that The step of determining a target placeholder image area according to the screen layout information includes: Determining at least one layout element according to the screen layout information; Filtering a target element from the at least one layout element according to a preset rule; Determining target layout parameters of the target element; A target placeholder image area of ​​the target element is determined according to the target layout parameters.

3. The method according to claim 2, characterized in that After transmitting the rendering parameters and the target placeholder image area to the second display adapter, the method further includes: Get the user's peripheral operation information; Determining whether the peripheral operation information indicates adjusting the layout of the target element; If it is determined that the peripheral operation information indicates adjusting the layout of the target element, a screen synchronization instruction is generated; The screen synchronization instruction is transmitted to the second display adapter, where the screen synchronization instruction is used to instruct the second display adapter to transmit the first screen frame to the central processing unit.

4. The method according to claim 1, characterized in that: The first task information includes device information, and the first data processing task is performed according to the first screen update data and the second screen frame to obtain a third screen frame, including: updating the second picture frame according to the first picture update data to obtain a fourth picture frame; Determine a target audio acquisition device and a target video acquisition device according to the device information; Acquire audio data from the target audio acquisition device, and acquire video data from the target video acquisition device; Determine a fifth picture frame according to the audio data, the video data and the picture layout parameters in the picture layout information; The third picture frame is determined according to the fourth picture frame and the fifth picture frame.

5. The method according to claim 4, characterized in that After performing the first data processing task according to the first picture update data and the second picture frame to obtain a third picture frame, the method further includes: Get the user's current operation information and historical operation information; Predicting a target operation to be performed by a user based on the current operation information, the historical operation information, and a pre-trained operation prediction model; Determining a second rendering parameter according to the target operation; transmitting the second rendering parameter to the second display adapter, where the second display adapter is used to determine second picture update data according to the second rendering parameter; receiving the second picture update data from the second display adapter; A sixth picture frame is determined according to the second picture update data and the fourth picture frame.

6. The method according to claim 5, characterized in that The predicting the target operation to be performed by the user according to the current operation information, the historical operation information and the pre-trained operation prediction model includes: Determine the target time window; Extracting first characteristic information of the current operation information; Extracting second feature information of operation data of the historical operation information within the target time window; Concatenate the first feature information and the second feature information to obtain third feature information; Determining an operation tag of the user; Inputting the third feature information and the operation label into the operation prediction model to obtain multiple probability values ​​of multiple operations; The operation with the largest probability value is taken as the target operation to be performed by the user.

7. The method according to claim 6, characterized in that Determining the target time window includes: Determining a target game type corresponding to the second data processing task; Determining the target game scene where the game character is currently located according to the second picture frame; The target time window is determined according to the target game type and the target game scene.

8. A resource configuration device based on a microcomputer host, characterized in that: A central processing unit applied to a microcomputer host, the microcomputer host comprising the central processing unit and a first display adapter, the central processing unit being respectively connected to the first display adapter and a second display adapter in a graphics card expansion dock, the second display adapter being connected to a first display, the resource configuration device based on the microcomputer host comprising: an acquisition unit, a determination unit, a task execution unit and a transmission unit, wherein: The acquisition unit is used to acquire a plurality of data processing tasks, wherein the plurality of data processing tasks include a first data processing task and a second data processing task, wherein the first data processing task includes first task information, and the first task information includes screen layout information; The determining unit is used to determine a target placeholder image area according to the screen layout information; The task execution unit is used to execute the second data processing task, obtain a first rendering parameter, and transmit the first rendering parameter and the target placeholder image area to the second display adapter, the second display adapter is used to perform a rendering operation according to the first rendering parameter to obtain a first picture frame, determine first picture update data of the first picture frame according to the first picture frame and the target placeholder image area, and transmit the first picture frame to the first display, and the first display is used to display the first picture frame; The acquisition unit is further configured to receive the first screen update data from the second display adapter; The task execution unit is further used to execute the first data processing task according to the first picture update data and the second picture frame to obtain a third picture frame, wherein the second picture frame is a frame previous to the first picture frame cached by the central processing unit; The transmission unit is used to transmit the third picture frame to the first display adapter, and the first display adapter is used to encode and encapsulate the third picture frame to obtain a data packet; The acquisition unit is further used to receive the data packet from the first display adapter and stream the data packet.

9. An electronic device, characterized in that: The method comprises a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for executing the steps in the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: A computer program for electronic data exchange is stored, wherein the computer program enables a computer to execute the method according to any one of claims 1 to 7.

Images