A method, system, and storage medium for displaying virtual scenes
By processing complex computational tasks on the server side and utilizing supplementary presentation data and frame synchronization information, the problem of computing power limitations in virtual display systems is solved, achieving efficient virtual scene presentation and an immersive user experience.
Patent Information
- Application Number
- CN202311108836.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-08-30
- Publication Date
- 2026-11-17
- Estimated Expiration
- 2043-08-30
AI Technical Summary
Existing virtual display systems are limited by device computing power, which affects the realism of the virtual environment and the user's immersion in the presentation of virtual scenes.
Complex computational tasks are processed on the server side, and the client only needs to receive and display the results transmitted by the server. The client also presents the rendering target in the second display area by receiving auxiliary presentation data and frame synchronization information. By utilizing the server's powerful computing and rendering capabilities, the synchronization and seamless connection between the main screen and the rendering target can be achieved.
It improves the overall operating efficiency and resource utilization of the system, provides a more realistic visual experience, enhances the user's immersion and realism, and ensures the continuity and smoothness of the visual effects.
Smart Images

Figure CN117156193B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of virtual display, and more particularly to a method, system, and storage medium for displaying virtual scenes. Background Technology
[0002] A Virtual Reality System (VRS) combines hardware devices, software applications, and interactive technologies to simulate a real-world or fictional environment, aiming to create a computer-generated virtual environment in which users can have an immersive interactive experience.
[0003] With the continuous development of virtual display technology, virtual display head-mounted display devices have been widely used. Virtual display head-mounted display devices, also known as VR devices, VR headsets, or VR glasses, use VR devices to close off the user's vision from the outside world, guiding the user to feel as if they are in a virtual environment, and can provide the user with a three-dimensional and realistic visual effect.
[0004] However, although current virtual display systems can provide users with relatively realistic virtual scenes, some limitations still exist. Specifically, due to limitations in device computing power, the presentation of virtual scenes may affect the realism of the virtual environment and reduce the user's immersion. Summary of the Invention
[0005] To enhance the realism of virtual environments, this application provides a method, system, and storage medium for displaying virtual scenes.
[0006] Firstly, this application provides a method for displaying a virtual scene, which adopts the following technical solution: A method for displaying a virtual scene, used on a client, the client having a preset first display area and a second display area, the method comprising: The system continuously receives the main screen from the server according to a preset frame order and displays the main screen in the first display area. The main screen is used to present a three-dimensional scene. Receive the auxiliary presentation data pushed by the server and perform corresponding rendering actions based on the auxiliary presentation data to obtain the rendering target associated with the main screen; The rendering target is rendered in the second display area according to the frame synchronization information indicated by the auxiliary rendering data.
[0007] By adopting the above technical solution, the server's powerful computing and rendering capabilities allow complex computational tasks to be processed on the server side. For the main screen, the client only needs to receive and display the results transmitted by the server. This fully utilizes server resources, improving the overall system efficiency and resource utilization. Furthermore, this setup allows the main screen to display virtual scenes with higher precision and detail, providing a more realistic visual experience. Moreover, by receiving the main screen from the server, the client can also display high-quality virtual scenes with relatively low computing power, presenting users with high-quality 3D scenes.
[0008] By receiving auxiliary rendering data and frame synchronization information pushed by the server, the client can present the rendering target associated with the main screen in the second display area according to the preset frame order. This ensures the synchronized presentation of the main screen and the rendering target, resulting in a coherent and smooth visual effect, enhancing the user's immersion and the realism of the virtual reality experience.
[0009] For example, the auxiliary rendering data is special effects data, and receiving the auxiliary rendering data pushed by the server and performing corresponding rendering actions based on the auxiliary rendering data to obtain a rendering target associated with the main screen includes: Before the predetermined motion effect target is displayed on the main screen, the special effect data pushed by the server is received; The rendering action is performed based on the special effects data to obtain the rendering target corresponding to the motion special effects target.
[0010] By adopting the above technical solution, the client only needs to render the rendering target corresponding to the motion effect target of the main screen and present the rendering target in the second display area. Compared with the client independently generating and rendering all the effects, this solution reduces the client's computing burden, enabling the client to process and display effects more efficiently. It also reduces the computing power requirements of the client device. Furthermore, presenting the rendering target corresponding to the motion effect target of the main screen in the second display area can further enhance the user's immersion and the realism of the virtual reality experience.
[0011] For example, receiving the special effects data pushed by the server before the predetermined motion effect target is displayed on the main screen includes: Before the predetermined motion effect target is displayed on the main screen, the system receives instruction information pushed by the server to mark the motion effect target in the 3D scene. Subsequently, special effects materials associated with the motion effects target are received and pushed by the server.
[0012] The special effects materials include explosion effects materials, light and shadow effects materials, and particle effects materials.
[0013] By adopting the above technical solution, the client can accurately mark moving special effects targets in a 3D scene based on the instructions received from the server. This precise control ensures the accuracy of the position and movement path of the special effects, thereby improving the realism and immersion of the scene. By receiving and rendering various special effects materials (such as explosions, lighting, particles, etc.) from the server, the visual effects of the virtual scene are enriched, enhancing its realism and attractiveness, improving the user's immersion, and allowing the user to be more engaged and enjoy the world of virtual reality.
[0014] For example, presenting the rendering target in the second display area according to the frame synchronization information indicated by the auxiliary rendering data includes: When the motion effect target is displayed on the main screen, a synchronization strategy is determined based on the frame synchronization information; According to the sequential display method, motion method, and disappearance method defined by the synchronization strategy, the rendering target is presented in the second display area so that the presentation of the motion effect target in the first display area and the presentation of the rendering target in the second display area are seamlessly connected.
[0015] By adopting the above technical solutions, seamless integration eliminates visual discontinuities and inconsistencies, allowing users to enjoy a smooth and continuous visual experience when viewing virtual scenes, enhancing immersion and realism. Furthermore, through the setting of synchronization strategies, the sequential display, movement, and disappearance of special effects can be precisely controlled. This allows for accurate presentation and dynamic display of special effects based on design requirements and scene specifications, enabling users to better perceive the movement, changes, and interactions of the special effects targets, thus improving the quality and visual appeal of the visual effects.
[0016] For example, the frame synchronization information includes a transition time point, which indicates the time when the motion effect target reaches the boundary of the first display area according to its motion trajectory. Presenting the rendered target in the second display area according to the transition display method, motion method, and disappearance method defined by the synchronization strategy, so that the presentation of the motion effect target in the first display area and the presentation of the rendered target in the second display area are seamlessly connected, includes transition display in the following manner: Starting from the connection point, gradually reduce the transparency of the motion effect target within the first display area; Starting from the point of transition, the portion of the motion effect target that disappeared in the first display area is gradually displayed in the second display area to present the rendered target in the second display area.
[0017] By adopting the above technical solution, the transparency of the moving special effects target is gradually reduced in the first display area, while the transparency of the rendered target is gradually increased in the second display area. This natural "fade-in" effect conforms to human visual habits, achieves a smooth transition of the special effects target, and makes users feel more natural and comfortable when watching virtual scenes.
[0018] For example, the frame synchronization information includes the connection position, connection path, and connection motion speed. Presenting the rendered target in the second display area according to the sequential display method, motion method, and disappearance method defined by the synchronization strategy, so that the presentation of the motion effect target in the first display area and the presentation of the rendered target in the second display area are seamlessly connected, includes moving and disappearing in the following manner: Once the rendering target is fully rendered in the second display area, the rendering target moves along the connection path within the second display area from the connection position at the connection speed. Once the rendering target moves to a preset position, the transparency of the rendering target within the second display area is gradually reduced until the rendering target disappears.
[0019] By employing the aforementioned technical solution, the movement and disappearance of the rendered target achieves a seamless presentation within the second display area, enhancing the user's viewing experience and making the transition between the special effects target in the first display area and the rendered target in the second display area smoother and more natural. Simultaneously, according to a preset synchronization strategy, the movement and disappearance of the special effects target and the rendered target are coordinated in time, improving the overall visual effect and viewing experience.
[0020] For example, the first display area is a planar display area, the second display area is a three-dimensional surround area, and the first display area is surrounded by the second display area.
[0021] By adopting the above technical solution, the first display area is set as a planar display area, providing users with a reference plane to perceive depth and spatial sense within the virtual scene. The second display area, acting as a stereoscopic surround area, offers a more immersive and three-dimensional experience, allowing users to feel the scene's three-dimensionality and realism. By extending the scene around the user and presenting effects and elements in three-dimensional space, the scene's realism and interactivity are increased. Users can experience visual stimuli from different directions, enhancing the immersiveness of the virtual reality experience.
[0022] The first display area is surrounded by the second display area, making the transition and connection between the two areas more natural and coherent. Users can view 3D scenes in the flat display area, and the special effects of the 3D scene can penetrate into the stereoscopic surround area, making the entire virtual reality experience have a seamless transition and connection effect, enhancing the overall sense of unity.
[0023] For example, the main screen is a rendered screen.
[0024] By adopting the above technical solution, the rendered main screen can be optimized on the server side according to the characteristics and performance of the client to adapt to the requirements of different client devices. This allows more devices with different specifications and performance to display high-quality images, expanding the range of choices for users.
[0025] Secondly, this application provides a method for displaying a virtual scene, which adopts the following technical solution: A method for displaying a virtual scene, used on a server, the method comprising: The system continuously sends the main screen to the client according to a preset frame order to trigger the client to display the main screen in a preset first display area. The main screen is used to present a three-dimensional scene. The client is sent supplementary rendering data to trigger the client to perform corresponding rendering actions based on the supplementary rendering data in order to obtain a rendering target associated with the main screen.
[0026] By adopting the above technical solution, since the server typically has more powerful computing and graphics processing capabilities than the client, it can generate high-quality main screens. Therefore, sending the main screen from the server to the client ensures high-quality output, presenting users with more realistic and smooth 3D scenes. Furthermore, the client only needs to perform simple decoding and display operations on the main screen, without undertaking complex calculations, thus saving client resources and energy.
[0027] For example, sending auxiliary rendering data to the client to trigger the client to perform a corresponding rendering action based on the auxiliary rendering data to obtain a rendering target associated with the main screen includes: Before the predetermined motion effect target is displayed on the main screen, effect data is sent to the client to trigger the client to perform a rendering action based on the effect data to obtain a rendering target corresponding to the motion effect target.
[0028] By adopting the above technical solutions, special effects are an important element in virtual scenes, enhancing dynamics and visual appeal. Sending supplementary rendering data, especially special effects data, to the client ensures that the client can associate it with the main screen. Furthermore, when the client performs rendering actions, it can accurately render based on the special effects data, thereby obtaining a rendering target associated with the main screen and enhancing the realism and immersion of the virtual scene.
[0029] For example, sending effect data to the client before the predetermined motion effect target is displayed on the main screen includes: Send indication information to the client, the indication information being used to mark the motion effect target in the 3D scene; Subsequently, special effects materials associated with the motion effect target are pushed to the client; By adopting the above technical solution, the client can accurately mark the moving special effects targets in the 3D scene, so as to ensure the accuracy of the position and movement path of the special effects targets, thereby improving the realism and immersion of the scene.
[0030] Thirdly, the system for displaying virtual scenes provided in this application adopts the following technical solution: A system for displaying virtual scenes, comprising: The data receiving unit is used to continuously receive the main screen and auxiliary presentation data from the server according to a preset frame order; A region building unit is used to build a first display region and a second display region; A rendering unit is used to perform corresponding rendering actions based on the auxiliary presentation data in order to obtain a rendering target associated with the main screen. A scene display unit is used to display the main screen in a first display area and to present the rendering target in a second display area according to the frame synchronization information indicated by the auxiliary presentation data.
[0031] By adopting the above technical solutions, this system is not only suitable for high-performance devices but can also provide a good virtual reality experience on devices with relatively weak computing power. This is because the system fully utilizes the server's computing power to perform complex operations on the main screen, while the client only needs to perform relatively simple operations, such as receiving data, rendering effects, and displaying the image in a designated area. This greatly reduces the computational burden on the client, making the system suitable for client devices with varying computing power. Furthermore, the rendering unit can accurately render the rendering target corresponding to the main screen based on the auxiliary rendering data sent by the server, allowing users to see high-quality, detailed rendering targets in the second display area, enhancing the realism and immersion of the virtual scene. Moreover, by determining the synchronization strategy based on frame synchronization information, the system can achieve seamless transitions between the first and second display areas for effects, avoiding visual breaks and providing users with a smooth and continuous experience.
[0032] In summary, through the collaborative work of the data receiving unit, the area building unit, the rendering unit, and the scene display unit, efficient data reception and processing, flexible scene construction, real-time rendering, and seamless scene presentation can be achieved, providing an optimized virtual reality experience, enhancing visual effects and immersion, and enabling users to better integrate into the virtual scene.
[0033] Fourthly, the storage medium provided in this application adopts the following technical solution: A storage medium storing at least one instruction, at least one program, a code set, or an instruction set, wherein the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by a processor to implement a method for displaying a virtual scene for a client.
[0034] Fifthly, the storage medium provided in this application adopts the following technical solution: A storage medium storing at least one instruction, at least one program, a code set, or an instruction set, wherein the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by a processor to implement a method for displaying a virtual scene for a server.
[0035] In summary, this application includes at least one of the following beneficial technical effects: 1. By leveraging the server's powerful computing and rendering capabilities, complex computational tasks are processed on the server side. The client only needs to receive and display the results transmitted by the server, improving the overall system efficiency and resource utilization. This allows the main screen to display virtual scenes with higher precision and detail, providing a more realistic visual experience. Furthermore, by receiving the main screen from the server, the client can also display high-quality virtual scenes with relatively low computing power, presenting users with high-quality 3D scenes.
[0036] 2. Through the control of the synchronization strategy, the images of the first display area and the second display area are seamlessly connected, eliminating the visual discontinuity and incoherence, so that users can enjoy a smooth and coherent visual effect when watching virtual scenes, enhancing immersion and realism.
[0037] 3. By gradually reducing the transparency of the moving effect target in the first display area and gradually increasing the transparency of the rendered target in the second display area, a natural "fade-in" effect is presented, which is more in line with human visual habits and achieves a smooth transition of the effect target, making it more natural and comfortable for users to watch virtual scenes. Attached Figure Description
[0038] Figure 1 The steps of a method for displaying a virtual scene Figure 1 .
[0039] Figure 2 This is a schematic diagram of the first and second display areas. Figure 1 .
[0040] Figure 3 This is a schematic diagram of the first and second display areas. Figure 2 .
[0041] Figure 4 The steps of a method for displaying a virtual scene Figure 2 .
[0042] Explanation of reference numerals in the attached diagram: 1. First display area; 2. Second display area; 3. Motion effect target; 4. Rendering target; 5. Path A; 6. Path B. Detailed Implementation
[0043] The present application will be further described in detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are merely illustrative of the application and are not intended to limit the scope of the application.
[0044] Embodiment 1 of this application discloses a method for displaying a virtual scene. (Refer to...) Figure 1A method for displaying a virtual scene, used on a client, the client having a preset first display area 1 and a second display area 2, specifically, the method includes: S1. Continuously receive the main screen from the server according to the preset frame order, and display the main screen in the first display area 1.
[0045] Specifically, the main screen is used to present the 3D scene. Since the server has more powerful computing and rendering capabilities than the client, the main screen transmitted from the server to the client can be the fully rendered main screen. Furthermore, the server is responsible for the calculation and rendering of the main screen used to present the 3D scene. The client mainly undertakes the decoding and display functions for the main screen. Therefore, a stable network connection needs to be established between the client and the server to ensure that the client can continuously receive the main screen according to the preset frame order, providing the user with a smooth visual experience and avoiding the discomfort caused by screen breaks. Furthermore, to ensure that the first display area 1 can smoothly display the main screen, a receive buffer can be set on the client to receive data packets, ensuring that the client can accurately and continuously receive and process data from the server, achieving smooth image display and a virtual reality experience.
[0046] S2. Receive the auxiliary rendering data pushed by the server and perform corresponding rendering actions based on the auxiliary rendering data to obtain the rendering target 4 associated with the main screen.
[0047] S3. Render target 4 in the second display area 2 according to the frame synchronization information indicated by the auxiliary rendering data.
[0048] Specifically, the supplementary presentation data can be special effects data or small model data. Taking special effects data as an example, the above step S2 may include the following steps: Before the predetermined motion effect target 3 is displayed on the main screen, receive the effect data pushed by the server; The rendering action is performed based on the special effects data to obtain the rendering target 4 corresponding to the motion effect target 3.
[0049] Furthermore, before the predetermined motion effect target 3 is displayed on the main screen, the special effects data pushed by the server is received, including: Before the predetermined motion effect target 3 is displayed on the main screen, receive the instruction information pushed by the server to mark the motion effect target 3 in the 3D scene; Subsequently, it receives special effects materials related to motion effects target 3, pushed by the server.
[0050] The special effects materials include explosion effects, lighting effects, and particle effects.
[0051] Specifically, the client can use indication information to mark which frame of the 3D scene contains the moving effect target 3, and the location of the moving effect target 3 in the 3D scene. This allows the client to accurately identify the moving effect target 3 and ensure that the appearance of the rendered target 4 matches the 3D scene. Furthermore, the special effects materials sent by the server are already associated with the moving effect target 3, and the client only needs to perform the corresponding rendering upon receiving them, which can reduce the computational burden on the client.
[0052] Furthermore, the special effects materials include explosion effects, lighting effects, particle effects, etc. The client receives special effects materials associated with the 3D scene from the server and renders various special effects materials (such as explosions, lighting, particles, etc.), which enriches the visual effects of the virtual scene, enhances the realism and attractiveness of the virtual scene, improves the user's immersion, and makes the user more engaged and enjoyable in the world of virtual reality.
[0053] Specifically, but not limitingly, step S3 above includes: When the motion effect target 3 is displayed on the main screen, the synchronization strategy is determined based on the frame synchronization information. Based on the sequential display method, motion method, and disappearance method defined by the synchronization strategy, the rendering target 4 is presented in the second display area 2, so that the presentation of the motion effect target 3 in the first display area 1 and the presentation of the rendering target 4 in the second display area 2 are seamlessly connected.
[0054] Specifically, the synchronization strategy can precisely control the sequential display, movement, and disappearance of special effects. This allows for accurate presentation of special effects and dynamic display based on the design requirements and scene requirements, enabling users to better experience the movement, changes, and interactions of the special effects targets, thereby improving the quality and visual appeal of the visual effects.
[0055] In different embodiments, corresponding synchronization strategies can be formulated for special effects data based on different frame synchronization information. As an example, this application adopts the method of formulating the continuous display method based on the connection time point, and the motion mode and disappearance mode based on the connection position, connection path and connection motion speed to form a synchronization strategy. The connection time point indicates the time when the motion special effects target 3 reaches the boundary of the first display area 1 according to the motion trajectory.
[0056] Specifically, the connection method is as follows: Starting from the transition point, gradually reduce the transparency of motion effect target 3 within the first display area 1; Starting from the connection point, the motion effect target 3 gradually appears in the second display area 2, showing the part that disappeared in the first display area 1, so as to present the rendering target 4 in the second display area 2.
[0057] Gradually decreasing the transparency of motion effect target 3 in the first display area 1, while gradually increasing the transparency of motion rendering target 4 in the second display area 2, this natural "fade-in" effect conforms to human visual habits, making users feel more natural and comfortable when watching virtual scenes.
[0058] The movement and disappearance modes are as follows: After the rendering target 4 is fully rendered in the second display area 2, the rendering target 4 starts from the connection position and moves along the connection path in the second display area 2 at the connection speed. Once the rendering target 4 moves to the preset position, the transparency of the rendering target 4 within the second display area 2 is gradually reduced until the rendering target 4 disappears.
[0059] By clearly defining the connection position, connection time, connection speed, and connection path, rendering target 4 is presented between the first display area 1 and the second display area 2, achieving seamless integration of special effects with the surrounding environment and enhancing the realism and immersion of the virtual environment. This seamless transition makes the special effects appear integrated with other elements in the virtual space, eliminating the discomfort caused by screen flickering or breaks.
[0060] The rendering target 4 moves along the connection path according to the connection speed, which can simulate the movement of objects in the real world, making the movement of the rendering target 4 smoother and further enhancing the continuity and dynamism of the picture.
[0061] Reference Figure 2 This application specifically, but not limitingly, proposes a representation of a first display area 1 and a second display area 2, wherein the first display area 1 is a planar display area and the second display area 2 is a three-dimensional surround area, and the first display area 1 is surrounded by the second display area 2.
[0062] Specifically, the first display area 1 is set as a flat display area, providing users with a reference plane to perceive depth and spatial sense in the virtual scene. The second display area 2, acting as a stereoscopic surround area, offers a more three-dimensional and immersive experience, allowing users to feel the scene's three-dimensionality and realism. Furthermore, the first display area 1 is surrounded by the second display area 2, which extends special effects around the user and presents effects or other small models in three-dimensional space, increasing the scene's realism and interactivity.
[0063] More importantly, when this method is applied to head-mounted display devices, users can also interact with elements in the second display area 2 through technologies such as head tracking and gesture recognition, increasing the sense of participation and enjoyment in the virtual reality experience.
[0064] Furthermore, with Figure 2Taking the motion effect target 3 as an example, in the virtual space built on the client, the motion effect target 3 can move along path A 5 or path B 6 within the first display area 1. Path A 5 intersects with the first display area 1 at point C, and path B 6 intersects with the first display area 1 at point D. When the motion effect target 3 moves along path A 5, the time when the motion effect target 3 reaches point C is the connection time point; when the motion effect target 3 moves along path B 6, the time when the motion effect target 3 reaches point D is the connection time point. (Refer to...) Figure 3 From the user's perspective, because the first display area 1 is a planar display area, when the motion effect target 3 is projected onto the plane within the first display area 1, regardless of whether the motion effect target 3 moves along path A 5 or path B 6, the user sees the motion effect target 3 moving along AB in the first display area 1, and it gradually enlarges, giving the visual impression that the motion effect target 3 is flying along the path. Furthermore, upon reaching point B, it gradually disappears in the first display area 1, and the rendered target 4 gradually appears in the second display area 2. When the motion effect target 3 moves along path A 5 in the first space, the rendered target 4 is displayed at point C in the second space and ends its motion at point E. When the motion effect target 3 moves along path B 6 in the first space, the rendered target 4 is displayed at point D in the second space and ends its motion at point F in the second space.
[0065] refer to Figure 4 This application discloses a method for displaying a virtual scene in Embodiment 2. Unlike Embodiment 1, the method for displaying a virtual scene disclosed in Embodiment 2 is used on a server. Specifically, the method includes: SA continuously sends the main screen to the client according to the preset frame order.
[0066] Specifically, sending the main screen to the client can trigger the client to display the main screen in the preset first display area 1, and the main screen is used to present a three-dimensional scene.
[0067] SB. Sends supplementary presentation data to the client.
[0068] Specifically, sending auxiliary rendering data to the client can trigger the client to perform corresponding rendering actions based on the auxiliary rendering data in order to obtain the rendering target 4 associated with the main screen.
[0069] Specifically, but not exclusively, step SB above includes the following steps: before the predetermined motion effect target 3 is presented on the main screen, effect data is sent to the client to trigger the client to perform a rendering action based on the effect data to obtain a rendering target 4 corresponding to the motion effect target 3. Further, the effect data sent to the client includes: indication information and effect materials associated with the motion effect target 3, the indication information being used to mark the motion effect target 3 in the 3D scene. The auxiliary presentation data can be effect data or small model data.
[0070] Specifically, the auxiliary presentation data transmitted to the client indicates that the presence of frame synchronization information can trigger the client to determine a synchronization strategy, and the client will present the rendering target 4 in the preset second display area 2 according to the synchronization strategy, so that the presentation of the motion effect target 3 in the first display area 1 and the presentation of the rendering target 4 in the second display area 2 are seamlessly connected.
[0071] Since servers typically possess greater computing power than clients, enabling them to handle more complex graphics rendering tasks, performing most of the processing and rendering on the server side allows for more efficient allocation of computing resources. Furthermore, the client does not need to handle a large amount of rendering work, allowing for faster response to user actions and an improved user experience.
[0072] Furthermore, by sending frame synchronization information to the client, the server can ensure that the main screen and the rendering target 4 are seamlessly connected in different areas, thereby creating a coherent and unified virtual scene and enhancing the user's sense of immersion.
[0073] Embodiment 3 of this application discloses a system for displaying a virtual scene. The system for displaying a virtual scene includes: a data receiving unit, a region construction unit, a rendering unit, and a scene display unit.
[0074] Specifically, the data receiving unit continuously receives main screen and auxiliary presentation data from the server according to a preset frame order. The region building unit builds a first display area 1 and a second display area 2. The rendering unit performs corresponding rendering actions based on the auxiliary presentation data to obtain a rendering target 4 associated with the main screen. The scene display unit displays the main screen in the first display area 1 and presents the rendering target 4 in the second display area 2 according to the frame synchronization information indicated by the auxiliary presentation data.
[0075] Furthermore, this system is not only suitable for high-performance devices but can also provide a good virtual reality experience on devices with relatively weak computing power. This is because the system fully utilizes the server's computing power for complex rendering operations, while the client only needs to perform relatively simple operations, such as receiving data, rendering effects, and displaying the image in a designated area. This significantly reduces the computational burden on the client, making the system suitable for client devices with varying computing power.
[0076] Furthermore, when this system is applied to a head-mounted display device, the rendering unit can accurately render the rendering target 4 corresponding to the main screen based on the special effects data sent by the server, so that users can see high-quality and detailed special effects in the second display area 2, which enhances the realism and immersion of the virtual scene and allows users to better integrate into the virtual scene.
[0077] Embodiment 4 of this application discloses a storage medium. The storage medium stores at least one instruction, at least one program, code set, or instruction set, wherein the at least one instruction, at least one program, code set, or instruction set is loaded and executed by a processor to implement a method for displaying a virtual scene for a client.
[0078] Embodiment 5 of this application also discloses a storage medium. A storage medium stores at least one instruction, at least one program, code set, or instruction set, wherein the at least one instruction, at least one program, code set, or instruction set is loaded and executed by a processor to implement a method for displaying a virtual scene for a server.
[0079] The above are all preferred embodiments of this application, and are not intended to limit the scope of protection of this application. Therefore, all equivalent changes made in accordance with the structure, shape and principle of this application should be covered within the scope of protection of this application.
Claims
1. A method for displaying a virtual scene, for a client, the client having a preset first display area (1) and a second display area (2) surrounding the first display area (1), characterized in that, The method includes: The main screen is continuously received from the server according to a preset frame order and displayed in the first display area (1). The main screen is used to present a three-dimensional scene. Receive the auxiliary presentation data pushed by the server and perform corresponding rendering actions based on the auxiliary presentation data to obtain the rendering target associated with the main screen (4); The rendering target (4) is rendered in the second display area (2) according to the frame synchronization information indicated by the auxiliary rendering data; The auxiliary rendering data is special effects data, and the step of receiving the auxiliary rendering data pushed by the server and performing corresponding rendering actions based on the auxiliary rendering data to obtain a rendering target associated with the main screen (4) includes: Before the predetermined motion effect target (3) is displayed on the main screen, the effect data pushed by the server is received; The rendering action is performed based on the special effects data to obtain the rendering target (4) corresponding to the motion special effects target (3); The rendering of the rendering target (4) within the second display area (2) according to the frame synchronization information indicated by the auxiliary rendering data includes: When the motion effect target (3) is presented on the main screen, a synchronization strategy is determined based on the frame synchronization information; According to the sequential display method, motion method, and disappearance method defined by the synchronization strategy, the rendering target (4) is presented in the second display area (2) so that the presentation of the motion effect target (3) in the first display area (1) and the presentation of the rendering target (4) in the second display area (2) are seamlessly connected.
2. The method for displaying a virtual scene according to claim 1, characterized in that, Before the predetermined motion effect target (3) is displayed on the main screen, receiving the special effects data pushed by the server includes: Before the predetermined motion effect target (3) is displayed on the main screen, the instruction information pushed by the server is received to mark the motion effect target (3) in the three-dimensional scene. Subsequently, special effects materials associated with the motion effect target (3) are received by the server; The special effects materials include explosion effects materials, light and shadow effects materials, and particle effects materials.
3. The method for displaying a virtual scene according to claim 2, characterized in that, The frame synchronization information includes a connection time point, which indicates the time when the motion effect target (3) reaches the boundary of the first display area (1) according to the motion trajectory. The step of presenting the rendering target (4) in the second display area (2) according to the sequential display method, motion method, and disappearance method defined by the synchronization strategy, so that the presentation of the motion effect target (3) in the first display area (1) and the presentation of the rendering target (4) in the second display area (2) are seamlessly connected, includes sequential display in the following manner: Starting from the connection point, gradually reduce the transparency of the motion effect target (3) within the first display area (1); Starting from the connection point, the portion of the motion effect target (3) that disappeared in the first display area (1) is gradually displayed in the second display area (2) to present the rendering target (4) in the second display area (2).
4. The method for displaying a virtual scene according to claim 3, characterized in that, The frame synchronization information includes the connection position, connection path, and connection motion speed. The step of presenting the rendering target (4) in the second display area (2) according to the sequential display method, motion method, and disappearance method defined by the synchronization strategy, so that the presentation of the motion effect target (3) in the first display area (1) and the presentation of the rendering target (4) in the second display area (2) are seamlessly connected, includes moving and disappearing in the following manner: After the rendering target (4) is fully rendered in the second display area (2), the rendering target (4) moves along the connection path in the second display area (2) from the connection position at the connection movement speed; When the rendering target (4) moves to the preset position, the transparency of the rendering target (4) in the second display area (2) is gradually reduced until the rendering target (4) disappears.
5. The method for displaying a virtual scene according to any one of claims 1-4, characterized in that, The first display area (1) is a planar display area, and the second display area (2) is a three-dimensional surround area. The first display area (1) is surrounded by the second display area (2).
6. The method for displaying a virtual scene according to claim 1, characterized in that, The main screen is a rendered screen.
7. A method for displaying a virtual scene, used on a server, characterized in that, The method includes: The main screen is continuously sent to the client according to a preset frame order to trigger the client to display the main screen in a preset first display area (1). The main screen is used to present a three-dimensional scene. The client has a preset first display area (1) and a second display area (2) surrounding the first display area (1). Send auxiliary presentation data to the client to trigger the client to perform corresponding rendering actions according to the auxiliary presentation data to obtain the rendering target (4) associated with the main screen, so that the client presents the rendering target (4) in the second display area (2) according to the frame synchronization information indicated by the auxiliary presentation data; The auxiliary rendering data is special effects data. Sending the auxiliary rendering data to the client to trigger the client to perform corresponding rendering actions based on the auxiliary rendering data to obtain the rendering target associated with the main screen (4) includes: Before the predetermined motion effect target (3) is displayed on the main screen, effect data is sent to the client to trigger the client to perform rendering actions according to the effect data to obtain a rendering target (4) corresponding to the motion effect target (3); Presenting the rendering target (4) within the second display area (2) according to the frame synchronization information indicated by the auxiliary presentation data includes: When the motion effect target (3) is presented on the main screen, a synchronization strategy is determined based on the frame synchronization information; According to the sequential display method, motion method, and disappearance method defined by the synchronization strategy, the rendering target (4) is presented in the second display area (2) so that the presentation of the motion effect target (3) in the first display area (1) and the presentation of the rendering target (4) in the second display area (2) are seamlessly connected.
8. A system for displaying virtual scenes, characterized in that, include: The data receiving unit is used to continuously receive the main screen and auxiliary presentation data from the server according to a preset frame order, wherein the auxiliary presentation data is special effects data; A region building unit is used to build a first display area (1) and a second display area (2) surrounding the first display area (1); The rendering unit is used to perform corresponding rendering actions based on the auxiliary presentation data to obtain a rendering target (4) associated with the main screen, including: receiving special effect data pushed by the server before the main screen presents a predetermined motion effect target (3), and performing rendering actions according to the special effect data to obtain a rendering target (4) corresponding to the motion effect target (3). A scene display unit is used to display the main screen in a first display area (1) and to present the rendering target (4) in a second display area (2) according to the frame synchronization information indicated by the auxiliary presentation data, including: when the motion effect target (3) is presented in the main screen, determining a synchronization strategy according to the frame synchronization information; According to the sequential display method, motion method, and disappearance method defined by the synchronization strategy, the rendering target (4) is presented in the second display area (2) so that the presentation of the motion effect target (3) in the first display area (1) and the presentation of the rendering target (4) in the second display area (2) are seamlessly connected.
9. A storage medium, characterized in that, The storage medium stores at least one instruction, at least one program, code set, or instruction set, wherein the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by a processor to implement the method for displaying a virtual scene as described in any one of claims 1-6.
10. A storage medium, characterized in that, The storage medium stores at least one instruction, at least one program, code set, or instruction set, wherein the at least one instruction, the at least one program, the code set, or instruction set is loaded and executed by a processor to implement the method for displaying a virtual scene as described in claim 7.
Citation Information
Patent Citations
Rendering interaction method for real-time interactive access of remote 3D scene by mobile terminal user
CN106127844A
Image picture display method and device, equipment and storage medium
CN113244614A
