Information display method and device, electronic equipment and storage medium
By separating game screen information into a main screen and an auxiliary screen and displaying them separately in the parallel layer display mode, the problem of operation interruption and obstruction caused by manually viewing economic system information in the game is solved, thus improving the user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- VIVO MOBILE COMM CO LTD
- Filing Date
- 2026-02-27
- Publication Date
- 2026-05-29
Smart Images
Figure CN122097952A_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the field of electronic equipment technology, and specifically relates to an information display method, device, electronic equipment and storage medium. Background Technology
[0002] When people play games on electronic devices, especially multiplayer online tactical competitive games, they need to keep track of key economic system information such as the economic value of both sides, equipment types, skills, and skill cooldown times in order to formulate tactical strategies.
[0003] Currently, players typically access in-game economic information by manually clicking or swiping a shortcut control to bring up a floating panel. This requires players to manually access the floating panel every time, interrupting their current actions and disrupting their gameplay rhythm. Furthermore, the floating panel obscures the current game screen, affecting the player's view and potentially leading to operational errors. Summary of the Invention
[0004] The purpose of this application is to provide an information display method, device, electronic device, and storage medium that can solve the problems in the prior art where economic system information affects user operations, leading to user misoperation, and interrupting user operations every time economic system information needs to be viewed.
[0005] In a first aspect, embodiments of this application provide an information display method, the method comprising: When the layer display mode is in the layer parallel display mode, the game screen information is drawn. The game screen information includes the main game screen information and the auxiliary game screen information. The auxiliary game screen information includes the game economic system information. The main game screen information is the other screen information in the game screen information excluding the auxiliary game screen information. The game screen information is separated to obtain a first layer containing the main game screen information and a second layer containing the auxiliary game screen information; The first layer is sent to a first display screen for display, and the second layer is sent to a second display screen for display. The first display screen and the second display screen are different display screens of the same electronic device, or the first display screen and the second display screen are display screens of different electronic devices.
[0006] Secondly, embodiments of this application provide an information display device, the device comprising: The drawing module is used to draw game screen information when the layer display mode is in the layer parallel display mode. The game screen information includes game main screen information and game auxiliary screen information. The game auxiliary screen information includes game economic system information. The game main screen information is other screen information in the game screen information except for the game auxiliary screen information. The information separation module is used to separate the game screen information to obtain a first layer containing the game main screen information and a second layer containing the game auxiliary screen information; The sending module is used to send the first layer to a first display screen for display and to send the second layer to a second display screen for display. The first display screen and the second display screen are different display screens of the same electronic device, or the first display screen and the second display screen are display screens of different electronic devices.
[0007] Thirdly, embodiments of this application provide an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can run on the processor, and the programs or instructions, when executed by the processor, implement the method as described in the first aspect.
[0008] Fourthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the method described in the first aspect.
[0009] Fifthly, embodiments of this application provide a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to run programs or instructions to implement the method as described in the first aspect.
[0010] In a sixth aspect, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the method described in the first aspect.
[0011] In this embodiment, when the layer display mode is in parallel layer display mode, the game auxiliary screen information containing game economic system information and the main game screen information other than the game auxiliary screen information are separated to obtain a first layer containing the main game screen information and a second layer containing the game auxiliary screen information. The first layer containing the main game screen information is then sent to the first display screen for display, and the second layer containing the game auxiliary screen information is sent to the second display screen for display. This way, the main game screen information and the game auxiliary screen information are displayed on different screens, preventing the game auxiliary screen information from obscuring the main game screen information and thus not affecting user operation, avoiding accidental user actions. Furthermore, when the electronic device's layer display mode is in parallel layer display mode, the game auxiliary screen information can be directly displayed on the second display screen when it exists, without requiring manual triggering by the user. This does not interrupt the user's operation of the main game screen information, improving the user experience. Attached Figure Description
[0012] Figure 1 This is a flowchart illustrating an information display method provided in some embodiments of this application; Figure 2 This is a schematic diagram of the display of the main information screen and the auxiliary information screen in the existing technology; Figure 3 These are schematic diagrams of the settings interface provided in some embodiments of this application; Figure 4 This is a schematic diagram showing the first and second display devices in an unfolded state according to some embodiments of this application; Figure 5 This is a schematic diagram of a first display device and a second display device in a folded state according to some embodiments of this application; Figure 6 This is a flowchart illustrating an information display method provided in some embodiments of this application; Figure 7 This is a schematic diagram of the structural framework of an electronic device provided in some embodiments of this application; Figure 8 These are schematic diagrams illustrating the structure of an information display device according to some embodiments of this application; Figure 9 These are schematic diagrams illustrating the structure of an electronic device according to some embodiments of this application; Figure 10 These are schematic diagrams illustrating the hardware structure of an electronic device according to some embodiments of this application. Detailed Implementation
[0013] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.
[0014] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and are not limited in number; for example, a first object can be one or N objects. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.
[0015] The terminology used in the embodiments of this invention will be explained below.
[0016] The identifiers in this application are text, symbols, images, etc. used to indicate information, and can be displayed in the form of controls or other containers, including but not limited to text identifiers, symbol identifiers, and image identifiers.
[0017] Controls are graphical elements that users can directly manipulate or perceive during interaction. They are used to receive user input, trigger functions, or display real-time information. They serve as an interaction bridge between users and device or application functions, enabling command transmission and status feedback through a visual format.
[0018] Interface: Refers to the graphical interactive layer seen by users through the screen of an electronic device. Also known as the "user interface (UI)," it is the medium through which applications or operating systems interact and exchange information with users, converting the internal form of information into a form acceptable to the user. The user interface is source code written in specific computer languages such as Java and XML. This source code is parsed and rendered on the electronic device, ultimately presenting content that the user can recognize. The most common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be visible interface elements displayed on the screen of an electronic device, such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and web widgets.
[0019] Application: A computer program developed to perform one or more specific tasks and running on an operating system. Applications run in user mode, can interact with the user, and have a visual user interface.
[0020] Central Processing Unit (CPU): In the field of image processing, it is the control unit in the image processing process. It is mainly responsible for decoding instructions and issuing control signals for the various operations to be performed to complete each instruction.
[0021] Graphics Processing Unit (GPU): A microprocessor specifically designed to perform graphics calculations on personal computers, workstations, game consoles, and mobile devices such as tablets and smartphones.
[0022] Distributed Processing Unit (DPU): It is a station on the WDPF high-speed data highway. Sometimes, the DPU is also called a Multi-Application Controller (MAC). It can execute control strategies configured by engineers, and can implement both discrete ladder logic control and continuous regulation control.
[0023] Dynamic Random Access Memory (DRAM): The most common type of system memory. DRAM can only retain data for a very short time. To retain data, DRAM uses capacitors for storage, so it must be refreshed periodically. If the memory cell is not refreshed, the stored information will be lost.
[0024] Display Serial Interface (DSI) is a high-speed serial interface standard developed by the Mobile Industry Processor Interface (MIPI) Alliance. It is designed to connect processors and display modules and features high bandwidth, low power consumption, and flexible architecture.
[0025] Direct Rendering Manager (DRM): In the Linux graphics stack, DRM is the GPU management framework in the kernel. It is responsible for GPU command scheduling, memory and buffer management, and interrupts, and provides capabilities to user space through a unified interface.
[0026] DisplayPort (DP): DisplayPort is also a high-definition digital display interface standard. This interface can provide a variety of different connection solutions for personal computers, monitors, display panels, projectors, and high-resolution content applications.
[0027] The technical solution of this application embodiment can be applied to scenarios where it is necessary to display game auxiliary screen information without affecting the main game screen information. For example, a user is playing an online tactical competitive game and needs to frequently check the game's economic system information such as the economic value, equipment type, skills, and skill cooldown time of both sides. This requires the user to frequently click on shortcut controls in the game interface to bring up a floating panel displaying the game's economic system information. This information can obscure the surrounding environment of the user's character. In this situation, the user does not want the frequent access to the game's economic system information to disrupt their operation, nor does the information obscure the surrounding environment of their character, thus affecting the user's gaming experience.
[0028] The information display method provided in this application will be described in detail below with reference to the accompanying drawings, through specific embodiments and application scenarios.
[0029] Figure 1 This is a flowchart illustrating an information display method provided in an embodiment of this application. The subject executing this information display method can be an electronic device, which may be, but is not limited to, a personal computer (PC), a smartphone, a tablet computer, or a personal digital assistant (PDA).
[0030] like Figure 1 As shown, the information display method provided in this application embodiment may include steps 110-130.
[0031] Step 110: With the layer display mode in parallel layer display mode, draw the game screen information. The game screen information includes the main game screen information and the auxiliary game screen information. The auxiliary game screen information includes the game economic system information, and the main game screen information is all other screen information in the game screen information except for the auxiliary game screen information.
[0032] The layer display mode refers to the display mode of layers in an electronic device. This layer display mode can include serial display mode and parallel display mode. In serial display mode, when one layer is displayed and another is displayed, the newly displayed layer completely obscures the previously displayed layer. In parallel display mode, when one layer is displayed and another is displayed, the newly displayed layer does not obscure the previously displayed layer; instead, it is displayed alongside the previously displayed layer on the screen.
[0033] Game screen information can be game-related visual information, such as game-related image data. This information can include main screen information and auxiliary screen information. The main screen information can be image data of the main game screen, and the auxiliary screen information can be image data of the auxiliary game screen. The auxiliary screen information can include game economic system information such as the economic values of both sides, equipment types, skills, and skill cooldown times. The main screen information can be other screen information besides the auxiliary screen information. The main screen information is the core visual and dynamic content that the user directly sees, operates, and interacts with. It mainly includes: battlefield environment information, real-time operation and combat feedback information, and environmental interaction signal information. The battlefield environment information can include the game map, terrain, defensive towers, camps, resource points, etc. The operational and combat feedback information in the above embodiments may include the real-time location of friendly heroes, enemy heroes, minions, jungle monsters, summoned creatures, their models, orientations, and hero status, such as walking, attacking, casting, or dead status; as well as direct visual feedback on the user's hero's movement, basic attacks, skill aiming, and release. The environmental interaction signals mentioned above may include the specific location and icon on the map of quick signals such as "Attack" and "Retreat" sent by teammates.
[0034] refer to Figure 2 , Figure 2 This is a schematic diagram illustrating the display of game main screen information and game auxiliary screen information in existing technology. Figure 2 In the middle, the information in interface 21 is the main game screen information, and the information in interface 22 is the auxiliary game screen information.
[0035] It should be noted that the layer parallel display mode can be supported by component services provided by the operating system, allowing the parallel display mode to run within the operating system. Specifically, the operating system here can be a Linux system. The component services can be, but are not limited to, built using the Spring framework, Spring Boot framework, or ToySpring framework.
[0036] In some embodiments of this application, if an electronic device is to be in the layer parallel display mode, it is necessary to first respond to the user's operation of the layer parallel display mode control in the settings interface of the electronic device, that is, the layer parallel display mode switch needs to be turned on in advance in the electronic device.
[0037] refer to Figure 3 After the user clicks the "Settings" app icon, the following will be displayed: Figure 3 The settings interface 31 shown includes a "Layer Parallel Display Mode" control 32. Users can click the "Layer Parallel Display Mode" control 32 to enable the layer parallel display mode.
[0038] Step 120: Separate the game screen information to obtain a first layer containing the main game screen information and a second layer containing the auxiliary game screen information.
[0039] In some embodiments of this application, the game screen information can be separated, thus obtaining a first layer containing the main game screen information and a second layer containing the auxiliary game screen information.
[0040] In some embodiments of this application, in order to improve the efficiency of separating game screen information, after step 110, the method described above may further include: Add a first identifier to the game's auxiliary screen information; Step 120 may specifically include: Based on the first identifier, the game screen information is separated to obtain a first layer containing the main game screen information and a second layer containing the auxiliary game screen information.
[0041] The first identifier can be an identifier used to distinguish between game auxiliary screen information and game main screen information. Specifically, the first identifier can be added to the game auxiliary screen information. For example, a start identifier can be added before drawing the game auxiliary screen information, and an end identifier can be added at the end of the game auxiliary screen information after the game auxiliary screen information is drawn. The aforementioned start identifier and end identifier are the first identifier.
[0042] In some embodiments of this application, a first identifier can be added to the game auxiliary screen information, and then the game auxiliary screen information can be identified according to the first identifier, thereby separating the game main screen information and the game auxiliary screen information to obtain a first layer containing the game main screen information and a second layer containing the game auxiliary screen information.
[0043] In the embodiments of this application, by adding a first identifier to the game auxiliary screen information, the game auxiliary screen information can be quickly identified based on the first identifier, thereby separating the game main screen information and the game auxiliary screen information, and improving the separation efficiency of the game main screen information and the game auxiliary screen information.
[0044] Step 130: Send the first layer to the first display screen for display, and send the second layer to the second display screen for display.
[0045] The first display screen and the second display screen can be different display screens of the same electronic device, or the first display screen and the second display screen can be display screens of different electronic devices.
[0046] In some embodiments of this application, the first display screen and the second display screen may be integrated into the same electronic device, that is, the first display screen and the second display screen may be two split screens of the electronic device, such as... Figure 4 As shown, the first display screen 41 and the second display screen 42 are integrated into the electronic device, that is, the first display screen 41 and the second display screen 42 are two split screens of the electronic device.
[0047] The first and second display screens mentioned above can also be display screens of different electronic devices. That is, one of the display screens can be the display screen of a certain electronic device, and the other display screen can be an external screen of that electronic device. For example, the first display screen is the display screen of an electronic device, and the second display screen is an external screen of the electronic device.
[0048] When the first and second display screens are different display screens of the same electronic device, both the first and second display screens can be connected to the electronic device using a MIPI interface. When the first and second display screens are display screens of different electronic devices—that is, the first display screen is the display screen of the electronic device, and the second display screen is an external screen of the electronic device—the first display screen can be connected to the electronic device using a MIPI interface, and the second display screen can be connected to the electronic device via a charging port, such as a USB interface. The electronic device transmits game auxiliary screen information to the second display screen via the DP protocol.
[0049] In some embodiments of this application, the connection methods of the first display screen and the second display screen are different, and the ways in which they trigger the electronic device to enter the layer parallel display mode are also different. Specifically, the layer display mode may be in the layer parallel display mode, which may include: If the first display screen and the second display screen are different display screens of the same electronic device, and if it is detected that the second display screen is flipped from the back of the electronic device to an unfolded state, it is determined that the layer display mode is in the layer parallel display mode. When the first display screen and the second display screen are display screens of different electronic devices, and the second display screen is connected to the electronic device corresponding to the first display screen, it is determined that the layer display mode is in the layer parallel display mode.
[0050] In some embodiments of this application, when the first display screen and the second display screen are different display screens of the same electronic device, it can be determined that the layer display mode is in the layer parallel display mode when it is detected that the second display screen is flipped from the back of the electronic device to the unfolded state.
[0051] refer to Figure 5 The first display screen 51 and the second display screen 52 are in a folded state. The second display screen 52 is located on the back of the electronic device, that is, the second display screen 52 and the first display screen 51 are facing away from each other. Then the user flips the second display screen 52 from the back of the electronic device until it is... Figure 4 The expanded state shown indicates that the electronic device is currently in a layer parallel display mode.
[0052] In some embodiments of this application, when the first display screen and the second display screen are display screens of different electronic devices, such as when the second display screen is an external screen of the first display screen in an electronic device, the layer display mode of the electronic device is determined to be in a layer parallel display mode when the connection between the second display screen and the electronic device corresponding to the first display screen is detected. For example, the layer display mode of the electronic device can be determined to be in a layer parallel display mode when the connection between the second display screen and the electronic device corresponding to the first display screen is detected through a charging port.
[0053] In the embodiments of this application, depending on the different relationships between the second display screen and the first display screen, the layer display mode of the electronic device can be set to the layer parallel display mode in different ways, thereby improving the flexibility of determining whether the layer display mode of the electronic device is in the layer parallel display mode.
[0054] In some embodiments of this application, the above-described information display method is implemented at the software level of the electronic device as follows: The information for drawing the game screen may specifically include: The game screen information is drawn through the application layer and then sent to the display compositing layer. Step 120 may specifically include: The game screen information is separated by displaying the composite layer to obtain a first layer containing the main game screen information and a second layer containing the auxiliary game screen information, and the first and second layers are sent to the driver layer. Step 130 may specifically include: The first layer is sent to the first display screen for display via the driver layer, and the second layer is sent to the second display screen for display.
[0055] In some embodiments of this application, it may be as follows Figure 6 As shown, the game screen information is drawn through the application layer of the electronic device, and a first mark is added to the game auxiliary screen information in the game screen information. Then, the game main screen information and the game auxiliary screen information are sent to the display composition layer.
[0056] The display compositing layer can iterate through all game screen information sent by the application layer, then identify a first marker. Game screen information with the first marker is grouped into one layer, while game screen information without the first marker is grouped into another layer, thus separating the main game screen information from the auxiliary game screen information. This results in a first layer containing the main game screen information and a second layer containing the auxiliary game screen information. The first and second layers are then sent to the driver layer. The driver layer can then send the first layer to the first display screen for display and the second layer to the second display screen for display.
[0057] It should be noted that, as Figure 6 As shown, before the driver layer sends the first layer to the first display screen for display and the second layer to the second display screen for display, the driver layer first stores both the first layer and the second layer in DRAM, and then retrieves the first layer and the second layer from DRAM and sends them to different display devices through different display paths.
[0058] It should be noted that there can be multiple first layers, all of which are related to the main game screen information. Similarly, there can also be multiple second layers, all of which are related to the auxiliary game screen information.
[0059] exist Figure 6In this process, the display compositing layer can be completed using a display engine and a hardware compositor. The display engine could be SurfaceFlinger, and the hardware compositor could be HWComposer. Specifically, after SurfaceFlinger receives the first layer containing the game's main visual information and the second layer containing the game's auxiliary visual information, it sorts them according to Z-order to determine which layer is on top and which is on the bottom. SurfaceFlinger then passes the layer information to HWComposer, which evaluates whether these layers are directly composited by the DPU or by the GPU. This yields complete image data for both the game's auxiliary and main visual information. Finally, the game's auxiliary visual information from the second layer and the game's main visual information from the first layer are sent to the driver layer.
[0060] In the embodiments of this application, by executing the information display method provided in the embodiments of this application through different structural layers of the electronic device, the first layer and the second layer can be displayed on different display screens respectively. In this way, the second layer will not obscure the first layer, thereby not affecting user operation and avoiding user misoperation. In addition, when the second layer exists, the second layer is directly displayed on the second display screen without the need for manual triggering by the user. This does not interrupt the user's operation on the first layer and improves the user experience.
[0061] In some embodiments of this application, in order to improve the transmission efficiency of the first layer and the second layer, sending the first layer and the second layer to the driver layer may specifically include: The first layer is routed to the first display path corresponding to the first display screen, and the first layer is sent to the driver layer based on the first display path; The second layer is routed to the second display path corresponding to the second display screen, and the second layer is sent to the driver layer based on the second display path.
[0062] The first display path and the second display path can be two different display paths, and the first display path and the second display path can be used to transmit the first layer and the second layer, respectively.
[0063] In some embodiments of this application, the first layer can be routed to a first display path corresponding to the first display screen, and the first layer can be sent to the driver layer based on the first display path, so that the first layer can be sent to the first display screen for display through the driver layer.
[0064] Furthermore, the second layer is routed to the second display path corresponding to the second display screen, and the first layer is sent to the driver layer based on the second display path, so that the first layer can be sent to the second display screen for display through the driver layer.
[0065] It should be noted that when the first display screen and the second display screen are different display screens of the same electronic device, Figure 6 The first display path and the second display path can both be paths composed of interface standards defined by MIPI. For example, the first display path and the second display path can both be DSI interfaces, such as the first display path being a DSI0 interface and the second display path being a DSI1 interface.
[0066] When the first display screen and the second display screen are the display screens of different electronic devices, for example, the first display screen is the display screen of an electronic device, and the second display screen is an external screen of the electronic device. Figure 6 The first display path can be a path formed by the interface standard defined by MIPI, and the second display path can be a DP protocol interface. For example, the first display path is a DSI0 interface and the second display path is a USB interface.
[0067] In the embodiments of this application, the first layer is transmitted to the driving layer through the first display path corresponding to the first display screen, and the second layer is transmitted to the driving layer through the second display path corresponding to the second display screen. In this way, different image layers are transmitted in parallel through different display paths, instead of transmitting the first layer and the second layer sequentially through only one display path. The solution of the embodiments of this application improves the transmission efficiency of the first layer and the second layer.
[0068] In some embodiments of this application, in order to better illustrate the process of the electronic device implementing the information display method in the embodiments of this application, the process of the electronic device implementing the information display method at the hardware level is described in detail below through specific scenarios.
[0069] refer to Figure 7 , Figure 7 A structural framework diagram of an electronic device, such as Figure 7 As shown, the electronic device may include: a central processing unit 710, a graphics processor 720, a dynamic random access memory 730, a distributed processing unit 740, a first display path interface 750, and a second display path interface 760.
[0070] The central processing unit 710 is used to execute the logic code of the above information display method. It decides what content to display, such as calculating the position of a hero character in the game, and calling the graphics application programming interface (API) to send rendering instructions to the GPU.
[0071] After receiving rendering instructions from the CPU, the graphics processor 720 performs rasterization and other operations through extensive parallel computing to generate the final display image data and caches the image data in DRAM.
[0072] The DPU obtains the synthesized image data from the DRAM, performs timing control, color management, resolution conversion and other operations, and sends the data stream to the physical screens such as the first display screen and the second display screen through the first display path interface and the second display path interface to drive the screen to emit light and display.
[0073] When the DPU retrieves the synthesized image data from the DRAM, the DPU corresponding to the first display screen may retrieve the synthesized main game screen information from the DRAM and send it to the first display screen through the first display path interface. Similarly, the DPU corresponding to the second display screen may retrieve the synthesized auxiliary game screen information from the DRAM and send it to the second display screen through the second display path interface.
[0074] It should be noted that when the first display screen and the second display screen are different display screens of the same electronic device, both the first display path interface and the second display path interface can be interfaces specified by MIPI. For example, the first display path interface can be a DSI0 interface, and the second display path interface can be a DSI1 interface. When the first display screen and the second display screen are displays of different electronic devices, the first display path interface can be a MIPI-specified interface, such as a DSI0 interface, and the second display path interface can be a DP protocol interface, or a USB interface.
[0075] It should be noted that the aforementioned central processing unit 710, graphics processor 720, dynamic random access memory 730, and distributed processing unit 740 are the main control terminals of the electronic device. In the main control terminals of the electronic device, the first display path interface 750 and the second display path interface 760 have interface transmitters, and the first display screen and the second display screen side have interface receivers. The interface type of the interface receiver is the same as the interface type of the transmitter. That is, when the second display path interface is a DSI interface, the interface receiver is also a DSI interface. When the second display path interface is a DP protocol interface, the interface receiver is also a DP protocol interface.
[0076] The following details how to use [method / mechanism] in the game's display scene. Figure 6 Software level and Figure 7 The process of implementing the information display method provided in the embodiments of this application through hardware-level cooperation.
[0077] Step 1: Application rendering, which requires the CPU and GPU to work together.
[0078] When the game is running, the CPU calculates all the visual elements in a single frame, such as hero positions, skill effects, and the economy panel.
[0079] The game application generates and renders game screen information, such as the game main screen information and game auxiliary screen information in the embodiments of this application. The game main screen information describes a 3D battle scene, and the game auxiliary screen information is used to describe economic system information. The game auxiliary screen information has a first marker.
[0080] GPU rendering: Game applications submit drawing commands for each layer to the GPU via the graphics API. In other words, the game application submits the instructions for drawing game screen information to the GPU.
[0081] The GPU performs calculations such as vertex shading, rasterization, and texture mapping in parallel, rendering game screen information into independent image data containing pixel data.
[0082] Step 2: Layer submission and compositing. This step requires collaboration between the display engine and the hardware compositor. The display engine can be SurfaceFlinger, and the hardware compositor can be HWComposer.
[0083] The game application submits the rendered game screen image data to the system service SurfaceFlinger. SurfaceFlinger collects all game screen information from the game application, identifies the first marker in the game auxiliary screen information, separates the game auxiliary screen information from the main game screen information, obtains a first layer containing the main game screen information and a second layer containing the game auxiliary screen information, and sorts them according to Z-order to determine which layer is on top and which layer is on the bottom.
[0084] SurfaceFlinger passes layer information to HWComposer, which then evaluates these layers. Case A (Hardware Composition): If the layer overlay method is simple, such as the second layer in the embodiment of this application which needs to be fully displayed on the second display screen, HWComposer will instruct the DPU to directly process the composition of these layers.
[0085] Case B (GPU Compositing): If the compositing operation is very complex, such as the first layer in the embodiments of this application, and the images displayed in these layers have very complex special effects, such as semi-transparency and motion blur effects, HWComposer will decide to use the GPU to complete the compositing.
[0086] Step 3: Final display, this step is performed by the DPU.
[0087] After completing the execution of scenarios A and B, the final image data is synthesized and cached in DRAM.
[0088] Then, the DPU corresponding to each display device retrieves the corresponding image data from the DRAM. This DPU is responsible for converting the digital image signal into a timing signal that the screen can recognize, and sending it to the corresponding display screen through the display path interface corresponding to each display screen. The display screen lights up the pixels according to the received signal, and the user sees a complete frame of the game screen.
[0089] The information display method provided in this application can be executed by an information display device. This application uses an information display device executing the information display method as an example to illustrate the information display device provided in this application.
[0090] Figure 8 This is a schematic diagram illustrating the structure of an information display device according to an exemplary embodiment. For example... Figure 8 As shown, the information processing device 800 may include: The drawing module 810 is used to draw game screen information when the layer display mode is in the layer parallel display mode. The game screen information includes game main screen information and game auxiliary screen information. The game auxiliary screen information includes game economic system information. The game main screen information is other screen information in the game screen information except for the game auxiliary screen information. The information separation module 820 is used to separate the game screen information to obtain a first layer containing the game main screen information and a second layer containing the game auxiliary screen information; The sending module 830 is used to send the first layer to a first display screen for display and to send the second layer to a second display screen for display. The first display screen and the second display screen are different display screens of the same electronic device, or the first display screen and the second display screen are display screens of different electronic devices.
[0091] In the embodiments of this application, when the layer display mode is in the layer parallel display mode, the game auxiliary screen information containing game economic system information and the main game screen information other than the game auxiliary screen information are separated to obtain a first layer containing the main game screen information and a second layer containing the game auxiliary screen information. Then, the first layer containing the main game screen information is sent to the first display screen for display, and the second layer containing the game auxiliary screen information is sent to the second display screen for display. In this way, the main game screen information and the game auxiliary screen information are displayed on different display screens, so the game auxiliary screen information will not obscure the main game screen information, thus not affecting user operation and avoiding user misoperation. Furthermore, when the electronic device's layer display mode is in the layer parallel display mode, when game auxiliary screen information exists, it can be directly displayed on the second display screen without manual triggering by the user. This does not interrupt the user's operation of the main game screen information and improves the user experience.
[0092] In some embodiments of this application, the apparatus described above may further include: An addition module is used to add a first identifier to the game auxiliary screen information after the game screen information is drawn. The first identifier is used to distinguish the game auxiliary screen information from the game main screen information. The separation module is specifically used for: Based on the first identifier, the game screen information is separated to obtain a first layer containing the main game screen information and a second layer containing the auxiliary game screen information.
[0093] In some embodiments of this application, the drawing module is specifically used for: The game screen information is drawn through the application layer and then sent to the display compositing layer. The separation module is specifically used for: The game screen information is separated by the display compositing layer to obtain a first layer containing the main game screen information and a second layer containing the auxiliary game screen information, and the first layer and the second layer are sent to the driver layer; The sending module is specifically used for: The first layer is sent to the first display screen for display via the driver layer, and the second layer is sent to the second display screen for display.
[0094] In some embodiments of this application, the separation module is specifically used for: The first layer is routed to the first display path corresponding to the first display screen, and the first layer is sent to the driver layer based on the first display path; The second layer is routed to the second display path corresponding to the second display screen, and the second layer is sent to the driver layer based on the second display path.
[0095] In some embodiments of this application, the apparatus described above may further include: The determining module is configured to determine that the layer display mode is in a layer parallel display mode when the first display screen and the second display screen are different display screens of the same electronic device and when the second display screen is detected to be flipped from the back of the electronic device to an unfolded state; and to determine that the layer display mode is in a layer parallel display mode when the first display screen and the second display screen are display screens of different electronic devices and the second display screen is connected to the electronic device corresponding to the first display screen.
[0096] The information display device in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the device.
[0097] The information display device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit the specific operating system used.
[0098] The information display device provided in this application embodiment can achieve... Figure 1 The various processes implemented in the method implementation examples will not be described again here to avoid repetition.
[0099] Optionally, such as Figure 9 As shown, this application embodiment also provides an electronic device 900, including a processor 901 and a memory 902. The memory 902 stores a program or instructions that can run on the processor 901. When the program or instructions are executed by the processor 901, they implement the various steps of the above-described information display method embodiment and can achieve the same technical effect. To avoid repetition, they will not be described again here.
[0100] It should be noted that the electronic devices in the embodiments of this application include the mobile electronic devices and non-mobile electronic devices described above.
[0101] Figure 10 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of this application.
[0102] The electronic device 1000 includes, but is not limited to, components such as: radio frequency unit 1001, network module 1002, audio output unit 1003, input unit 1004, sensor 1005, display unit 1006, user input unit 1007, interface unit 1008, memory 1009, and processor 1010.
[0103] Those skilled in the art will understand that the electronic device 1000 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 1010 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 10 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.
[0104] The processor 1010 is configured to draw game screen information when the layer display mode is in the layer parallel display mode. The game screen information includes game main screen information and game auxiliary screen information. The game auxiliary screen information includes game economic system information. The game main screen information is other screen information in the game screen information excluding the game auxiliary screen information. The processor separates the game screen information to obtain a first layer containing the game main screen information and a second layer containing the game auxiliary screen information. The processor sends the first layer to a first display screen for display and sends the second layer to a second display screen for display. The first display screen and the second display screen are different display screens of the same electronic device, or the first display screen and the second display screen are display screens of different electronic devices.
[0105] Thus, when the layer display mode is in parallel layer display mode, the game auxiliary screen information containing game economic system information and the main game screen information (excluding the auxiliary screen information) are separated into a first layer containing the main game screen information and a second layer containing the auxiliary screen information. The first layer containing the main game screen information is then sent to the first display screen, and the second layer containing the auxiliary screen information is sent to the second display screen. This separates the main game screen information and the auxiliary screen information on different screens, preventing the auxiliary screen information from obscuring the main game screen information and thus avoiding user operation and accidental operation. Furthermore, when the electronic device's layer display mode is in parallel layer display mode, the auxiliary screen information can be directly displayed on the second display screen without manual triggering by the user, thus not interrupting the user's operation of the main game screen information and improving the user experience.
[0106] Optionally, the processor 1010 is further configured to add a first identifier to the game auxiliary screen information, the first identifier being used to distinguish the game auxiliary screen information from the game main screen information; and to separate the game screen information according to the first identifier to obtain a first layer containing the game main screen information and a second layer containing the game auxiliary screen information.
[0107] Optionally, the processor 1010 is further configured to draw game screen information through the application layer and send the game screen information to the display compositing layer; separate the game screen information through the display compositing layer to obtain a first layer containing the game main screen information and a second layer containing the game auxiliary screen information, and send the first layer and the second layer to the driver layer; send the first layer to the first display screen for display through the driver layer, and send the second layer to the second display screen for display.
[0108] Optionally, the processor 1010 is further configured to route the first layer to a first display path corresponding to the first display screen, and send the first layer to the driver layer based on the first display path; route the second layer to a second display path corresponding to the second display screen, and send the second layer to the driver layer based on the second display path.
[0109] Optionally, the processor 1010 is further configured to determine that the layer display mode is in a layer parallel display mode when the first display screen and the second display screen are different display screens of the same electronic device and when it is detected that the second display screen is flipped from the back of the electronic device to an unfolded state; and to determine that the layer display mode is in a layer parallel display mode when the first display screen and the second display screen are display screens of different electronic devices and the second display screen is connected to the electronic device corresponding to the first display screen.
[0110] It should be understood that, in this embodiment, the input unit 1004 may include a graphics processing unit (GPU) 10041 and a microphone 10042. The GPU 10041 processes image data of still images or videos obtained by an image capture device (such as a color camera) in video capture mode or image capture mode. The display unit 1006 may include a display panel 10061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 1007 includes at least one of a touch panel 10071 and other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, and joysticks, which will not be described in detail here.
[0111] The memory 1009 can be used to store software programs and various data. The memory 1009 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 1009 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 1009 in this embodiment includes, but is not limited to, these and any other suitable types of memory.
[0112] The processor 1010 may include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into the processor 1010.
[0113] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described information display method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.
[0114] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.
[0115] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described information display method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.
[0116] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.
[0117] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the information display method embodiments described above, and can achieve the same technical effect. To avoid repetition, it will not be described again here.
[0118] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
[0119] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.
[0120] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.
Claims
1. An information display method, characterized in that, The method includes: When the layer display mode is in the layer parallel display mode, the game screen information is drawn. The game screen information includes the main game screen information and the auxiliary game screen information. The auxiliary game screen information includes the game economic system information. The main game screen information is the other screen information in the game screen information excluding the auxiliary game screen information. The game screen information is separated to obtain a first layer containing the main game screen information and a second layer containing the auxiliary game screen information; The first layer is sent to a first display screen for display, and the second layer is sent to a second display screen for display. The first display screen and the second display screen are different display screens of the same electronic device, or the first display screen and the second display screen are display screens of different electronic devices.
2. The method according to claim 1, characterized in that, When drawing the game screen information, the method further includes: A first identifier is added to the game auxiliary screen information, and the first identifier is used to distinguish the game auxiliary screen information from the game main screen information; The step of separating the game screen information to obtain a first layer containing the main game screen information and a second layer containing the auxiliary game screen information includes: Based on the first identifier, the game screen information is separated to obtain a first layer containing the main game screen information and a second layer containing the auxiliary game screen information.
3. The method according to claim 1, characterized in that, The information for drawing the game screen includes: The game screen information is drawn through the application layer and then sent to the display compositing layer. The step of separating the game screen information to obtain a first layer containing the main game screen information and a second layer containing the auxiliary game screen information includes: The game screen information is separated by the display compositing layer to obtain a first layer containing the main game screen information and a second layer containing the auxiliary game screen information, and the first layer and the second layer are sent to the driver layer; The step of sending the first layer to the first display screen for display and sending the second layer to the second display screen for display includes: The first layer is sent to the first display screen for display via the driver layer, and the second layer is sent to the second display screen for display.
4. The method according to claim 3, characterized in that, Sending the first layer and the second layer to the driver layer includes: The first layer is routed to the first display path corresponding to the first display screen, and the first layer is sent to the driver layer based on the first display path; The second layer is routed to the second display path corresponding to the second display screen, and the second layer is sent to the driver layer based on the second display path.
5. The method according to claim 1, characterized in that, The method further includes: When the first display screen and the second display screen are different display screens of the same electronic device, and when it is detected that the second display screen is flipped from the back of the electronic device to an unfolded state, it is determined that the layer display mode is in the layer parallel display mode; When the first display screen and the second display screen are display screens of different electronic devices, and the second display screen is connected to the electronic device corresponding to the first display screen, it is determined that the layer display mode is in the layer parallel display mode.
6. An information display device, characterized in that, The device includes: The drawing module is used to draw game screen information when the layer display mode is in the layer parallel display mode. The game screen information includes game main screen information and game auxiliary screen information. The game auxiliary screen information includes game economic system information. The game main screen information is other screen information in the game screen information except for the game auxiliary screen information. The information separation module is used to separate the game screen information to obtain a first layer containing the game main screen information and a second layer containing the game auxiliary screen information; The sending module is used to send the first layer to a first display screen for display and to send the second layer to a second display screen for display. The first display screen and the second display screen are different display screens of the same electronic device, or the first display screen and the second display screen are display screens of different electronic devices.
7. The apparatus according to claim 6, characterized in that, The device further includes: An addition module is used to add a first identifier to the game auxiliary screen information after the game screen information is drawn. The first identifier is used to distinguish the game auxiliary screen information from the game main screen information. The separation module is specifically used for: Based on the first identifier, the game screen information is separated to obtain a first layer containing the main game screen information and a second layer containing the auxiliary game screen information.
8. The apparatus according to claim 6, characterized in that, The drawing module is specifically used for: The game screen information is drawn through the application layer and then sent to the display compositing layer. The separation module is specifically used for: The game screen information is separated by the display compositing layer to obtain a first layer containing the main game screen information and a second layer containing the auxiliary game screen information, and the first layer and the second layer are sent to the driver layer; The sending module is specifically used for: The first layer is sent to the first display screen for display via the driver layer, and the second layer is sent to the second display screen for display.
9. The apparatus according to claim 8, characterized in that, The separation module is specifically used for: The first layer is routed to the first display path corresponding to the first display screen, and the first layer is sent to the driver layer based on the first display path; The second layer is routed to the second display path corresponding to the second display screen, and the second layer is sent to the driver layer based on the second display path.
10. The apparatus according to claim 6, characterized in that, The device further includes: The determining module is configured to determine that the layer display mode is in a layer parallel display mode when the first display screen and the second display screen are different display screens of the same electronic device and when the second display screen is detected to be flipped from the back of the electronic device to an unfolded state; and to determine that the layer display mode is in a layer parallel display mode when the first display screen and the second display screen are display screens of different electronic devices and the second display screen is connected to the electronic device corresponding to the first display screen.
11. An electronic device, characterized in that, It includes a processor and a memory, the memory storing a program or instructions that can run on the processor, the program or instructions being executed by the processor to implement the steps of the information display method as described in any one of claims 1-5.
12. A readable storage medium, characterized in that, The readable storage medium stores a program or instructions that, when executed by a processor, implement the steps of the information display method as described in any one of claims 1-5.