A display control method and related device

By using the rendering hardware and software built into the VR device to render and display motion information transmitted from external terminals, the problem of data transmission lag in VR devices is solved, resulting in smoother VR effects and improved user experience.

CN116778056BActive Publication Date: 2026-06-30BOE TECHNOLOGY GROUP CO LTD +1

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
BOE TECHNOLOGY GROUP CO LTD
Filing Date
2023-06-29
Publication Date
2026-06-30

AI Technical Summary

Technical Problem

Existing portable VR devices are prone to lag during data transmission, especially when multiple VR devices are connected to external terminals, resulting in unsmooth image display during VR demonstrations.

Method used

VR devices acquire preset motion information transmitted from external terminals, use their built-in rendering hardware and software to perform rendering operations, generate rendered image data, and display it on the VR device. This includes segmenting motion fragments based on pause nodes for independent rendering and sorting and combining them according to temporal features.

Benefits of technology

It improves the synchronization and smoothness of VR display, enhances the user experience, and overcomes the problem of limited data transmission rate of rendered image data.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116778056B_ABST
    Figure CN116778056B_ABST
Patent Text Reader

Abstract

This application discloses a display control method and related equipment. The method includes: acquiring preset action information transmitted from an external terminal, wherein the preset action information includes pause node information; performing a rendering operation based on the preset action information to generate rendered image data; and displaying a VR effect based on the rendered image data.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This specification relates to the field of display control, and more specifically, this application relates to a display control method and related equipment. Background Technology

[0002] Existing portable VR (Virtual Reality) devices transmit rendered image data to an external terminal, which then displays the VR effect. Because the rendered image data is large, the communication quality between the external terminal and the VR device is crucial. This can easily lead to data transmission anomalies during VR demonstrations, causing image stuttering, especially when multiple VR devices are connected to the external terminal. Summary of the Invention

[0003] The summary section introduces a series of simplified concepts, which will be further explained in detail in the detailed description section. This summary section is not intended to limit the key and essential technical features of the claimed technical solution, nor is it intended to determine the scope of protection of the claimed technical solution.

[0004] To improve the smoothness of VR effect display, firstly, this application proposes a display control method for VR devices, the method comprising:

[0005] Obtain preset action information transmitted from an external terminal, wherein the preset action information includes pause node information;

[0006] Rendering operations are performed based on the preset action information to generate rendered image data;

[0007] VR effects are displayed based on the rendered image data.

[0008] Optionally, the step of rendering according to the preset action information to generate rendered image data includes:

[0009] Obtain the pause node information of the preset action information;

[0010] Based on the pause node information, the preset action information is divided into multiple action segment information;

[0011] Each motion segment is rendered to generate the rendered image data.

[0012] Optionally, the data value corresponding to the action data of the pause node information is less than or equal to a preset threshold, where the preset threshold is the data value corresponding to when the action stops.

[0013] Optionally, the step of obtaining the pause node information of the preset action information includes:

[0014] The preset action information is input into the target neural network model to obtain pause node information. The target neural network model is obtained by training a preset number of action information samples a preset number of times. The action information samples include pause node annotation information, which is formed by human experts through an annotation program.

[0015] Optionally, the step of rendering all motion fragment information to generate the rendered image data includes:

[0016] The duration of a segment is determined based on the start and end times of the aforementioned action segment information.

[0017] The preset rendering duration is determined based on the above segment length and rendering quality requirements;

[0018] The corresponding action segment information is rendered according to the preset rendering duration to generate the rendered image data.

[0019] Optionally, the VR effect display based on the rendered image data includes:

[0020] The rendered image data is sorted and combined based on temporal features to form a combined rendered image;

[0021] The combined rendered images are displayed in sequence using VR effects.

[0022] Optionally, the step of performing a sorting and combining operation on the rendered image data based on temporal features to form a combined rendered image includes:

[0023] The rendered image data is sorted based on temporal features to form a sorted rendered image dataset.

[0024] Set pause nodes at the element connections in the sorted rendered image dataset;

[0025] The image dataset and the pause nodes are combined to form a composite rendered image.

[0026] Optionally, the preset action information is obtained by a specific user through configuring the VR device, and the preset action information is standard action information.

[0027] Optionally, the step of rendering all motion fragment information to generate the rendered image data includes:

[0028] Obtain the number of segments and the timing of the segments in the action segment information;

[0029] Obtain the rendering matrix quantity information of the VR device;

[0030] The rendering operation is performed in parallel based on the number of segments, the timing of the segments, and the number of rendering matrices to generate the rendered image data.

[0031] Optionally, the above methods also include:

[0032] Obtain user action information;

[0033] Rendering operations are performed based on the aforementioned user action information to generate user action rendered image data.

[0034] Based on the above rendered image data and the above rendered image data of user actions, the user actions are synchronized with the preset actions to display VR effects.

[0035] Optionally, the above methods also include:

[0036] Obtain connection request information transmitted by the external terminal, wherein the connection request information is sent based on the client corresponding to the VR device installed on the external terminal;

[0037] A data transmission link is established with the external terminal based on the connection request information, wherein the data transmission link is used to transmit the preset action information.

[0038] Secondly, this application also proposes a display control device for VR devices, comprising:

[0039] The acquisition unit is used to acquire preset action information transmitted by an external terminal, wherein the preset action information includes pause node information.

[0040] A rendering unit is used to perform rendering operations based on the preset action information to generate rendered image data.

[0041] The display unit is used to display VR effects based on the rendered image data.

[0042] Thirdly, this application also proposes an electronic device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program stored in the memory to implement the steps of the display control method as described in any of the first aspects above.

[0043] Fourthly, this application also proposes a computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the display control method of any one of the first aspects.

[0044] In summary, the display control method proposed in this application includes: acquiring preset action information transmitted from an external terminal; performing rendering operations based on the preset action information to generate rendered image data; and displaying VR effects based on the rendered image data. In this display control method, the VR device acquires preset action information transmitted from an external terminal, performs rendering based on the preset action information using the VR device's built-in rendering hardware and software, generates rendered image data, and displays the rendered image data on the VR device, allowing users to view more vivid preset actions. Compared to related technologies that transmit rendered image information through external devices, the method proposed in this application, which first transmits the original action data and then renders it using the VR device's own rendering hardware and software, effectively overcomes the problem of limited transmission rate due to the large size of the rendered image data in related technologies. This effectively improves the synchronization of VR displays, enhances VR display effects, and improves the user experience.

[0045] The display control method proposed in the embodiments of this application, other advantages, objectives and features of this application will be partly apparent from the following description, and partly understood by those skilled in the art through study and practice of this application. Attached Figure Description

[0046] Various other advantages and benefits will become apparent to those skilled in the art upon reading the following detailed description of preferred embodiments. The accompanying drawings are for illustrative purposes only and are not intended to limit this specification. Furthermore, the same reference numerals denote the same parts throughout the drawings. In the drawings:

[0047] Figure 1 A flowchart illustrating a display control method provided in this application embodiment.

[0048] Figure 2 This is a structural schematic diagram of a VR device control system provided in an embodiment of this application;

[0049] Figure 3 This is a schematic diagram of the rendering matrix structure of a VR device provided in an embodiment of this application;

[0050] Figure 4 This is a structural schematic diagram of a display control device provided in an embodiment of this application;

[0051] Figure 5 This is a schematic diagram of a user display control electronic device provided in an embodiment of this application. Detailed Implementation

[0052] The terms "first," "second," "third," "fourth," etc. (if present) in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or apparatus that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or apparatus. The technical solutions of the embodiments of this application will now be clearly and completely described in conjunction with the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them.

[0053] Please see Figure 1 This is a schematic flowchart of a display control method provided in an embodiment of this application, which may specifically include:

[0054] S110. Obtain preset action information transmitted from an external terminal, wherein the preset action information includes pause node information;

[0055] For example, an external terminal is a terminal device capable of storing preset motion information and transmitting data with the VR device. The external terminal may include a mobile phone, computer, or other smart terminal. Transmission can be wired or wireless. The transmission method can be real-time or batch transmission. Data can be encrypted during transmission to prevent tampering with the preset motion information. Data transmission can be initiated automatically when the VR device and external terminal are powered on, or it can be initiated based on commands issued by the VR device and / or the external terminal. It should be noted that the VR device proposed in this application includes portable VR devices such as VR headsets and VR glasses. The preset motion information can be dance motion information, martial arts motion information, or other forms of motion information. The preset motion information also includes pause node information, which is the node corresponding to a pause in the dance motion, martial arts motion, or other motion information. The pause node information can be used to segment the preset motion information into multiple motion fragments.

[0056] S120. Perform a rendering operation according to the preset action information to generate rendered image data;

[0057] For example, the VR device proposed in this application includes rendering hardware and rendering software. After receiving preset action information from an external terminal, the VR device renders the preset action information using its rendering hardware and software, thereby generating rendered image data.

[0058] S130. Display VR effects based on the rendered image data.

[0059] For example, VR effects can be displayed on rendered image data through the display device of a VR device. By wearing a VR device, users can view a series of images of VR effects corresponding to preset action information, thereby obtaining the preset action information more vividly.

[0060] In summary, the display control method proposed in this application involves the VR device acquiring preset action information transmitted from an external terminal, rendering the preset action information using the VR device's built-in rendering hardware and software, generating rendered image data, and then displaying the rendered image data on the VR device. This allows users to view more vivid preset actions. Compared to related technologies that transmit rendered image information through external devices, the method proposed in this application, which first transmits the original action data and then renders it using the VR device's own rendering hardware and software, effectively overcomes the problem of limited transmission rate due to the large size of the rendered image data in related technologies. This method effectively improves the synchronization of VR displays, enhances VR display effects, and improves the user experience.

[0061] In some examples, the step of rendering based on the preset action information to generate rendered image data includes:

[0062] Obtain the pause node information of the preset action information;

[0063] Based on the pause node information, the preset action information is divided into multiple action segment information;

[0064] Each motion segment is rendered to generate the rendered image data.

[0065] For example, to further improve the efficiency of VR rendering, the preset motion information is divided into multiple continuous motion segments. These segments are then input into multiple rendering matrices for independent rendering. After rendering, the segments are combined to obtain the rendered image data, which is then displayed on a VR display device. The motion segments are divided based on pause points. For instance, in a dance sequence, the overall movement is continuous, but there is a natural pause after each beat. We can decompose the dance movement according to the beat.

[0066] In summary, the VR device display control method proposed in this application divides preset action information into multiple action segment information according to pause nodes, and renders multiple action segment information simultaneously through multiple VR rendering matrices, thereby improving rendering efficiency and enhancing the smoothness of VR display.

[0067] In some examples, the data value corresponding to the action data of the pause node information is less than or equal to a preset threshold, which is the data value corresponding to when the action stops.

[0068] For example, by obtaining the data value corresponding to the stop of a preset action as a preset threshold, when there is a case in the preset action information that is less than or equal to the preset threshold, the corresponding action information is the pause node information. The pause node is automatically determined according to the size of the data value, and the action segment is segmented.

[0069] In some examples, the pause node information for obtaining the preset action information includes:

[0070] The preset action information is input into the target neural network model to obtain pause node information. The target neural network model is obtained by training a preset number of action information samples a preset number of times. The action information samples include pause node annotation information, which is formed by human experts through an annotation program.

[0071] For example, pause node information can also be intelligently identified and obtained through a target neural network model. This model is obtained by training a preset number of motion information samples a preset number of times. Specifically, the process may include the following steps: Data Acquisition: Collecting motion data, for example, professional trainers wearing auxiliary acquisition devices similar to those used in VR devices to capture standard movements and obtain samples. Data Preprocessing: Preprocessing the collected data, including data cleaning, data format conversion, and data augmentation. Data Labeling: According to the model training objectives, human experts label the pause nodes in the collected data. Model Training: Training the neural network model using the labeled data. Model Evaluation: Evaluating the trained model using test data, assessing metrics such as accuracy and recall. Once the evaluation results are satisfactory, the target neural network can be obtained.

[0072] A well-trained target neural network can quickly identify pause nodes, thereby rapidly segmenting preset action information based on pause node information to form multiple action fragments.

[0073] In some examples, the step of rendering all motion fragment information to generate the rendered image data includes:

[0074] The duration of a segment is determined based on the start and end times of the aforementioned action segment information.

[0075] The preset rendering duration is determined based on the above segment length and rendering quality requirements;

[0076] The corresponding action segment information is rendered according to the preset rendering duration to generate the rendered image data.

[0077] For example, different segment information may correspond to different total durations. The total duration of an action segment can be determined based on its start and end times. Determining the rendering time of segments of different durations based on rendering quality requirements and segment durations ensures consistent rendering effects for all action segments. That is, the rendering duration is directly proportional to the total duration of the action segment, and the proportionality coefficient is determined by the rendering quality requirements; the higher the rendering quality requirements, the larger the proportionality coefficient.

[0078] In summary, the display control method proposed in this application determines the segment duration based on the start and end times, and determines the preset rendering duration based on the segment duration and rendering quality requirements. This ensures that the rendering effect of action segments of different lengths is the same, thereby improving the user's viewing experience.

[0079] In some examples, the VR effect display based on the rendered image data includes:

[0080] The rendered image data is sorted and combined based on temporal features to form a combined rendered image;

[0081] The combined rendered images are displayed in sequence using VR effects.

[0082] For example, during data transmission and rendering on an external terminal, the process may not follow the normal playback sequence of the actions, or the rendering end times of action segments may be inconsistent. In such cases, it is necessary to sort the rendered image data from front to back according to temporal characteristics, and combine them in order to form a combined rendered image. Playing the combined rendered image sequentially allows for the continuous display of preset VR effects through the VR device. The temporal characteristics can be the numerical ID of the image or the start time of the image display, etc.

[0083] In some examples, performing a sorting and combining operation on the rendered image data based on temporal features to form a combined rendered image includes:

[0084] The rendered image data is sorted based on temporal features to form a sorted rendered image dataset.

[0085] Set pause nodes at the element connections in the sorted rendered image dataset;

[0086] The image dataset and the pause nodes are combined to form a composite rendered image.

[0087] For example, during data transmission and rendering on an external terminal, the process may not follow the normal playback sequence of the action, or the rendering end times of the action segments may be inconsistent. In this case, it is necessary to sort the rendered image data from front to back according to the temporal characteristics. When performing segmented rendering, the segmentation is based on pause nodes. At this time, pause nodes need to be added to avoid ignoring pause nodes during continuous playback of multiple image datasets, which would result in inconsistencies with the original preset action information's rhythm. The image dataset and the pause nodes are combined to form a combined rendered image, thereby enabling the VR effect display of the preset action images to follow the predetermined rhythm.

[0088] In some examples, the preset action information is obtained by a specific user through configuring the VR device, and the preset action information is standard action information.

[0089] For example, the preset motion information is standard motion information. This standard motion can be captured by a specific user (e.g., a professional trainer) wearing an auxiliary acquisition device (i.e., a sensor) similar to that used on VR devices. These standard motions are saved according to the corresponding sensor signal data, thus obtaining the preset motion information. Since the preset motion information is the same as the data collected by the auxiliary acquisition device used on VR devices, no format conversion is required during rendering or other processing. This significantly reduces the processing cycle, improves processing speed, and enhances the smoothness and continuity of the VR effect display.

[0090] In some examples, the step of rendering all motion fragment information to generate the rendered image data includes:

[0091] Obtain the number of segments and the timing of the segments in the action segment information;

[0092] Obtain the rendering matrix quantity information of the VR device;

[0093] The rendering operation is performed in parallel based on the number of segments, the timing of the segments, and the number of rendering matrices to generate the rendered image data.

[0094] For example, preset action information can be divided into multiple action fragments. Rendering these fragments in parallel using multiple rendering matrices can save total rendering time. Furthermore, rendering should be performed according to the temporal order of the fragments to ensure smooth VR display. For instance, if a preset action information includes 5 action fragments, then 5 rendering units will be invoked. If there are 8 rendering tasks but only 5 rendering units, 5 will be allocated first, and the remaining 3 will queue up and wait. The rendering thread of each unit will be monitored, and if a unit completes, tasks will be automatically reassigned. The execution order of tasks is determined by the temporal order of the fragments.

[0095] In some examples, the above method also includes:

[0096] Obtain user action information;

[0097] Rendering operations are performed based on the aforementioned user action information to generate user action rendered image data.

[0098] Based on the above rendered image data and the above rendered image data of user actions, the user actions are synchronized with the preset actions to display VR effects.

[0099] For example, in a VR device, a mode switching button can be set. For instance, after a trainee observes a standard movement, they can switch to a normal mode. The VR device's built-in auxiliary acquisition device then collects the trainee's training movement information and inputs it into a rendering matrix for rendering. Multiple rendering matrices are configured such that at least one rendering unit renders image data based on the training movement information to generate user movement rendered image data. Correspondingly, at least one rendering unit loads the standard movement information corresponding to the training movement information and renders the image data to obtain rendered image data. Both the rendered image data and the user movement rendered image data are simultaneously displayed through the VR device, allowing the trainee to observe the difference between their movements and the standard movements in real time, facilitating adjustments and optimizations.

[0100] In some examples, the above method also includes:

[0101] Obtain connection request information transmitted by the external terminal, wherein the connection request information is sent based on the client corresponding to the VR device installed on the external terminal;

[0102] A data transmission link is established with the external terminal based on the connection request information, wherein the data transmission link is used to transmit the preset action information.

[0103] For example, an external terminal may have a control APP corresponding to the VR device installed. By operating the control icon set on the control desktop, a connection request is formed between the electronic device and the VR display device. In response to the connection request, a data transmission link between the external terminal and the VR display device is established by performing connection configuration operations on the VR display device. Preset action information is transmitted through the data transmission link.

[0104] In some examples, please refer to Figure 2 This is a structural schematic diagram of a VR device control system provided in an embodiment of this application. An external terminal electronic device establishes a connection link with the VR device through a synchronous application, transmitting preset action information. The VR device is equipped with a processing model and a rendering matrix. The processing model is used to identify the preset action information, obtain the pause nodes contained in the preset action information, and divide the preset action information into multiple continuous action segment information according to the pause nodes. The rendering matrix is ​​used to receive multiple continuous action segment information, input the multiple continuous action segment information into the rendering matrix for independent rendering, combine them after rendering to obtain the rendered image data, and display the image data on the VR display device. Please refer to... Figure 3 This is a schematic diagram of the rendering matrix structure of a VR device provided in an embodiment of this application. The rendering matrix includes: a monitor, a control unit, a combination unit, and multiple rendering units. The monitor is used to monitor rendering tasks and configure rendering unit activation instructions according to the number of rendering tasks. The control unit is connected to the monitoring unit and multiple rendering units and is used to activate the number of rendering units matching the number of rendering tasks according to the rendering unit activation instructions. The rendering units are used to independently render image data according to the information of each action segment. The combination unit is connected to multiple rendering units and is used to combine the independently rendered image data according to the time sequence.

[0105] Please see Figure 4 One embodiment of the display control device for VR devices in this application may include:

[0106] Acquisition unit 21 is used to acquire preset action information transmitted by an external terminal;

[0107] Rendering unit 22 is used to perform rendering operations according to the preset action information to generate rendered image data;

[0108] Display unit 23 is used to display VR effects based on the rendered image data.

[0109] like Figure 5As shown, this application embodiment also provides an electronic device 400, including a memory 410, a processor 420, and a computer program 411 stored in the memory 410 and executable on the processor. When the processor 420 executes the computer program 411, it implements the steps of any of the above-described user display control methods.

[0110] Since the electronic device described in this embodiment is a device used to implement a display control device in the embodiments of this application, those skilled in the art can understand the specific implementation method and various variations of the electronic device in this embodiment based on the method described in the embodiments of this application. Therefore, how the electronic device implements the method in the embodiments of this application will not be described in detail here. Any device used by those skilled in the art to implement the method in the embodiments of this application falls within the scope of protection of this application.

[0111] In practical implementation, when the computer program 411 is executed by the processor, it can achieve the following: Figure 1 Any of the corresponding implementation methods in the embodiments.

[0112] It should be noted that the descriptions of each embodiment in the above embodiments have different focuses. For parts that are not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0113] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0114] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create a machine for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0115] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0116] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0117] This application also provides a computer program product, which includes computer software instructions that, when executed on a processing device, cause the processing device to perform actions such as... Figure 1 The user display control process in the corresponding embodiment.

[0118] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces, or indirect coupling or communication connection between apparatuses or units, and may be electrical, mechanical, or other forms.

[0119] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0120] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0121] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0122] The above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. A display control method for a VR device, comprising: include: Acquire preset action information transmitted from an external terminal, wherein the preset action information includes pause node information; Rendering operations are performed based on the preset action information to generate rendered image data; VR effects are displayed based on the rendered image data; The step of rendering according to the preset action information to generate rendered image data includes: Obtain the pause node information of the preset action information; Based on the pause node information, the preset action information is divided into multiple action segment information; Each motion segment information is rendered to generate the rendered image data; The pause node is the node corresponding to the pause in the preset action information.

2. The method of claim 1, wherein, The data value corresponding to the action data of the pause node information is less than or equal to a preset threshold, where the preset threshold is the data value corresponding to when the action stops.

3. The method of claim 1, wherein, The pause node information for obtaining the preset action information includes: The preset action information is input into the target neural network model to obtain pause node information. The target neural network model is obtained by training a preset number of action information samples a preset number of times. The action information samples include pause node annotation information, which is formed by human experts through an annotation program.

4. The method of claim 1, wherein, The step of rendering all the motion fragment information to generate the rendered image data includes: The duration of a segment is determined based on the start and end times of the action segment information; The preset rendering duration is determined based on the segment duration and rendering quality requirements; The corresponding action segment information is rendered according to the preset rendering duration to generate the rendered image data.

5. The method of claim 1, wherein, The VR effect display based on the rendered image data includes: The rendered image data is sorted and combined based on temporal features to form a combined rendered image; The combined rendered images are displayed in sequence using VR effects.

6. The method of claim 5, wherein, The step of performing a sorting and combination operation on the rendered image data based on temporal features to form a combined rendered image includes: The rendered image data is sorted based on temporal features to form a sorted rendered image dataset. Set pause nodes at the element connections in the sorted rendered image dataset; The image dataset and the pause nodes are combined to form a composite rendered image.

7. The method according to claim 1, characterized in that, The preset action information is obtained by the user through configuring the VR device, and the preset action information is standard action information.

8. The method according to claim 1, characterized in that, The step of rendering all the motion fragment information to generate the rendered image data includes: Obtain the number of segments and the timing of the segments in the action segment information; Obtain the rendering matrix quantity information of the VR device; The rendering operation is performed in parallel based on the number of segments, the timing of the segments, and the number of rendering matrices to generate the rendered image data.

9. The method according to claim 1, characterized in that, Also includes: Obtain user action information; Rendering operations are performed based on the user action information to generate user action rendered image data. Based on the rendered image data and the user action rendered image data, the user actions are synchronized with preset actions to display VR effects.

10. The method according to claim 1, characterized in that, Also includes: Obtain connection request information transmitted by the external terminal, wherein the connection request information is sent based on the client corresponding to the VR device installed on the external terminal; Based on the connection request information, a data transmission link is established with the external terminal, wherein the data transmission link is used to transmit the preset action information.

11. A display control device, characterized in that, include: The acquisition unit is used to acquire preset action information transmitted by an external terminal, wherein the preset action information includes pause node information; A rendering unit is used to perform rendering operations based on the preset action information to generate rendered image data. The display unit is used to display VR effects based on the rendered image data; The rendering unit is specifically used for: acquiring pause node information of the preset action information; dividing the preset action information into multiple action segment information based on the pause node information; and performing rendering operations on all action segment information respectively to generate the rendered image data. The pause node is the node corresponding to the pause in the preset action information.

12. An electronic device, comprising: A memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that the processor, when executing the computer program stored in the memory, implements the steps of the display control method as described in any one of claims 1-10.

13. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by the processor, it implements the display control method as described in any one of claims 1-10.