Naked-eye 3D resource processing method and apparatus, storage medium, and electronic device

By creating new generation scenes, loading target interaction models and calling resource library adjustments, determining the number of viewpoints and lens parameters, and generating naked-eye 3D resources, solving the problem of low generation efficiency in the existing technology, and achieving efficient naked-eye 3D resource generation and adapting to multiple screen displays.

WO2025129624A1PCT designated stage expired Publication Date: 2025-06-26BOE TECHNOLOGY GROUP CO LTD

Patent Information

Application Number
PCT/CN2023/140975
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-12-22
Publication Date
2025-06-26

AI Technical Summary

Technical Problem

The existing naked-eye 3D resource generation methods are inefficient and require modeling, animation production and animation rendering, resulting in a long generation cycle and requires art and program cooperation.

Method used

Provides a method for processing naked-eye 3D resource, by creating new generated scenes, loading target interaction models, calling resource library adjustments, determining the number of viewpoints and lens parameters, generating naked-eye 3D resources, supporting users to import 3D models and simply editing, and output naked-eye 3D content.

Benefits of technology

The generation efficiency of naked-eye 3D resources is improved, the target resource scenes are visualized, and the generated naked-eye 3D resources are adapted to a variety of naked-eye 3D screens, reducing the difficulty of producing multi-view naked-eye 3D content.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2023140975_26062025_PF_FP_ABST
    Figure CN2023140975_26062025_PF_FP_ABST
Patent Text Reader

Abstract

The present disclosure relates to the technical field of computers, and relates to a naked-eye 3D resource processing method and apparatus, a storage medium, and an electronic device. The method comprises: creating a new generation scene corresponding to a target interaction model, loading the target interaction model into the new generation scene, and obtaining an original resource scene; calling a preset resource library to adjust the original resource scene to obtain a target resource scene, and determining the number of viewpoints of the target resource scene on the basis of a target device parameter in the new generation scene; on the basis of the number of viewpoints, configuring lens parameters of a virtual lens group corresponding to the target resource scene, and configuring the virtual lens group on the basis of the lens parameters; and on the basis of the target resource scene, the virtual lens group, and a zero point position, generating a naked-eye 3D resource corresponding to the target interaction model. The method improves the generation efficiency of naked-eye 3D resources.
Need to check novelty before this filing date? Find Prior Art

Description

Method and device for processing naked-eye 3D resources, storage medium, and electronic equipment Technical Field

[0001] The embodiments of the present disclosure relate to the field of computer technology, and in particular, to a method for processing naked-eye 3D resources, a processing device for naked-eye 3D resources, a computer-readable storage medium, and an electronic device. Background Art

[0002] In existing methods, when generating naked-eye 3D resources, it is necessary to obtain the naked-eye 3D resources through modeling, animation production, and animation rendering. This method makes the generation efficiency of naked-eye 3D resources low.

[0003] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute prior art known to ordinary technicians in this field.

[0004] Summary of the Invention

[0005] The purpose of the present disclosure is to provide a method for processing naked-eye 3D resources, a processing device for naked-eye 3D resources, a computer-readable storage medium, and an electronic device, thereby at least to some extent overcoming the problem of low efficiency in generating naked-eye 3D resources due to limitations and defects of related technologies.

[0006] According to one aspect of the present disclosure, a method for processing naked-eye 3D resources is provided, comprising:

[0007] Creating a new generation scene corresponding to the target interaction model, and loading the target interaction model into the new generation scene to obtain an original resource scene;

[0008] Calling a preset resource library to adjust the original resource scene to obtain a target resource scene, and determining the number of viewpoints of the target resource scene according to the target device parameters in the newly generated scene;

[0009] Configuring lens parameters of a virtual lens group corresponding to the target resource scene according to the number of viewpoints, and configuring the virtual lens group according to the lens parameters;

[0010] Based on the target resource scene, the virtual lens group and the zero point position, a naked-eye 3D resource corresponding to the target interaction model is generated.

[0011] In an exemplary embodiment of the present disclosure, creating a new generation scenario corresponding to a target interaction model includes:

[0012] In response to a touch operation on a first preset interactive control on a display interface of the resource creation terminal, displaying a project creation sub-interface;

[0013] In response to an input operation on the project creation sub-interface, determining target device parameters and naked-eye 3D interleaving parameters of a target display device that displays the naked-eye 3D resource corresponding to the target interaction model;

[0014] In response to a touch operation on a second preset interactive control in the project creation sub-interface, a new generation scene corresponding to the target interaction model is created.

[0015] In an exemplary embodiment of the present disclosure, loading the target interaction model into the newly generated scene to obtain the original resource scene includes:

[0016] According to the target model name of the target interaction model, the target interaction model is obtained from a preset model library; and / or

[0017] Importing the target interaction model from an external file according to the target model name of the target interaction model;

[0018] The model size of the target interaction model in the newly generated scene is adaptively adjusted to obtain the original resource scene.

[0019] In an exemplary embodiment of the present disclosure, adaptively adjusting the model size of the target interaction model in the newly generated scene to obtain the original resource scene includes:

[0020] Constructing a first rectangle according to the newly generated scene, and constructing a second rectangle according to the target interaction model;

[0021] Calculating a model scaling coefficient of the target interaction model in the newly generated scene based on the first rectangle and the second rectangle;

[0022] The model size of the target interaction model is adaptively adjusted based on the model scaling coefficient to obtain the original resource scene.

[0023] In an exemplary embodiment of the present disclosure, constructing a first rectangle according to the newly generated scene includes:

[0024] Displaying the newly added generated scene on a display interface of the resource creation terminal;

[0025] Taking the center point of the display interface as the center point of the first rectangle, and determining a first rectangle length and a first rectangle width of the first rectangle according to the interface length and interface width occupied by the newly generated scene on the display interface;

[0026] A first rectangle is constructed according to the center point of the first rectangle, the length of the first rectangle, and the width of the first rectangle.

[0027] In an exemplary embodiment of the present disclosure, constructing a second rectangle according to the target interaction model includes:

[0028] Obtain pixel coordinates of pixel points in the target interaction model, and obtain a maximum abscissa value, a maximum ordinate value, a minimum abscissa value, and a minimum ordinate value in the pixel coordinates;

[0029] Determine the height of the second rectangle according to the maximum horizontal coordinate value and the minimum horizontal coordinate value, and determine the length of the second rectangle according to the maximum vertical coordinate value and the minimum vertical coordinate value;

[0030] The center point of the target interaction model is used as the center point of the second rectangle, and the second rectangle is constructed according to the center point of the second rectangle, the height of the second rectangle, and the length of the second rectangle.

[0031] In an exemplary embodiment of the present disclosure, calculating the model scaling coefficient of the target interaction model in the newly generated scene according to the first rectangle and the second rectangle includes:

[0032] Mapping the first rectangle to the three-dimensional coordinates of the resource generation engine to obtain a rectangle mapping result;

[0033] Calculating a first ratio between a height of the rectangle mapped in the rectangle mapping result and a height of the second rectangle, and calculating a second ratio between a length of the rectangle mapped in the rectangle mapping result and a length of the second rectangle;

[0034] Based on the first ratio and the second ratio, a model scaling coefficient of the target interaction model in the newly generated scenario is determined.

[0035] In an exemplary embodiment of the present disclosure, the method for processing naked-eye 3D resources further includes:

[0036] In response to the model loading operation, loading the newly added virtual model into the original resource scene, and / or importing the newly added virtual model into the original resource scene;

[0037] A model tag corresponding to the newly added virtual model is generated, and the model tag is displayed in the original resource scene.

[0038] In an exemplary embodiment of the present disclosure, the method for processing naked-eye 3D resources further includes:

[0039] In response to a touch operation on the model tag, a newly added virtual model corresponding to the model tag is displayed in the original resource scene, and a target interaction model in the original resource scene is switched based on the newly added virtual model.

[0040] In an exemplary embodiment of the present disclosure, the method for processing naked-eye 3D resources further includes:

[0041] In response to a touch operation on the model tag, adjusting the display order of the model tag in the original resource scene; and / or

[0042] Displaying a mode timing setting interface of the newly added virtual model and / or target interaction model;

[0043] In response to an input operation on the mode timing setting interface, a model display duration of the newly added virtual model and / or the target interaction model is determined.

[0044] In an exemplary embodiment of the present disclosure, the preset resource library includes at least one of a scene library, a model library, an animation library, a material library, a lighting library, and a sound library.

[0045] In an exemplary embodiment of the present disclosure, calling a preset resource library to adjust the original resource scene to obtain a target resource scene includes:

[0046] Loading an original three-dimensional scene corresponding to the target interaction model from the scene library, and adding the original three-dimensional scene to the newly generated scene; and / or

[0047] Loading the original three-dimensional animation from the animation library, and applying the original three-dimensional animation to the target interaction model; and / or

[0048] Loading original lights from the light library and adding the original lights to the newly generated scene; and / or

[0049] Loading a model material corresponding to the target interaction model from the material library, and applying the model material to the target interaction model; and / or

[0050] Loading audio data corresponding to the target interaction model from the sound library, and adding the audio data to the newly generated scene;

[0051] The model properties and / or animation properties and / or lighting properties and / or material properties and / or sound properties of the target interaction model in the newly generated scene are adjusted to obtain the target resource scene.

[0052] In an exemplary embodiment of the present disclosure, the original three-dimensional animation includes procedural animation and / or key-frame animation;

[0053] The step of applying the original three-dimensional animation to the target interaction model includes:

[0054] adding the procedural animation to the target interaction model; and / or

[0055] The target interaction model is mounted under the animation object in the key frame animation, so as to make the target interaction model a child object of the animation object.

[0056] In an exemplary embodiment of the present disclosure, applying the model material to the target interaction model includes:

[0057] In response to dragging the model material onto the target interaction model, the original material in the target interaction model is replaced based on the model material.

[0058] In an exemplary embodiment of the present disclosure, the model attributes include structure level attributes and / or location attributes;

[0059] Adjusting the model attributes of the target interaction model includes:

[0060] In response to a touch operation on the model property interaction control, displaying a model adjustment interface for the model property of the target interaction model;

[0061] In response to an input operation on the model adjustment interface, the attribute values ​​of the structural hierarchical attributes and / or the attribute values ​​of the position attributes of the target interaction model are adjusted.

[0062] In an exemplary embodiment of the present disclosure, adjusting the model attributes of the target interaction model further includes:

[0063] In response to a movement event acting on the target interaction model, the current model position of the target interaction model in the newly generated scene is adjusted, and / or the target interaction model is rotated.

[0064] In an exemplary embodiment of the present disclosure, adjusting the animation attribute includes:

[0065] In response to a touch operation on the animation setting interactive control, displaying an animation adjustment interface corresponding to the animation attribute;

[0066] In response to an input operation on the animation adjustment interface, the animation cycle time length and / or animation amplitude in the animation properties are adjusted; and / or the offset of the animation track in the animation properties in the newly generated scene is adjusted.

[0067] In an exemplary embodiment of the present disclosure, the original light includes at least one of parallel light, point light source, spotlight, and a combined light consisting of a point light source and a spotlight;

[0068] Among them, adjust the light properties, including:

[0069] In response to a touch operation on the light setting interactive control, displaying a light adjustment interface corresponding to the light attribute;

[0070] In response to an input operation on the light adjustment interface, the light position and / or light intensity and / or light color of the parallel light and / or point light source and / or spotlight and / or combined light in the newly generated scene are adjusted.

[0071] In an exemplary embodiment of the present disclosure, the material attribute includes at least one of model color, texture map, normal map, transparency, glossiness, and refraction;

[0072] Among them, the material properties are adjusted, including:

[0073] In response to a touch operation on a material setting interactive control, displaying a material adjustment interface corresponding to the material attribute;

[0074] In response to an input operation on the material adjustment interface, the model color and / or texture map and / or normal map and / or transparency and / or glossiness and / or refraction of the target interactive model are adjusted.

[0075] In an exemplary embodiment of the present disclosure, adjusting the sound attributes includes:

[0076] In response to a touch operation on the sound setting interactive control, displaying a sound adjustment interface corresponding to the sound attribute;

[0077] In response to an input operation on the sound adjustment interface, the volume of the audio data is adjusted.

[0078] In an exemplary embodiment of the present disclosure, determining the number of viewpoints of the target resource scene according to the target device parameters in the newly generated scene includes:

[0079] Determining device attribute information of a target display device corresponding to the target device parameters according to the target device parameters in the newly generated scene;

[0080] The number of viewpoints required by the target display device for displaying the target resource scene is determined according to the device attribute information.

[0081] In an exemplary embodiment of the present disclosure, determining lens parameters of a virtual lens group corresponding to the target resource scene according to the number of viewpoints includes: determining, according to the number of viewpoints, the number of lenses of the virtual lens group corresponding to the target resource scene, the zero point position of the target resource scene, the lens spacing between each virtual lens in the virtual lens group, and the distance difference between the virtual lens group and the zero plane.

[0082] In an exemplary embodiment of the present disclosure, configuring the virtual lens group according to the lens parameters includes:

[0083] The original lens position of each virtual lens in the virtual lens group is determined according to the lens parameters; the virtual lens is placed at the original lens position, and the lens parameters of the virtual lens at the original lens position are adjusted to obtain the virtual lens group according to the virtual lens after the parameters are adjusted.

[0084] In an exemplary embodiment of the present disclosure, adjusting the lens parameters of the virtual lens at the original lens position includes:

[0085] In response to a touch operation on the naked eye setting interactive control, displaying a naked eye parameter setting interface;

[0086] In response to an input operation in the naked eye parameter setting interface, the lens spacing and / or lens posture information and / or lens viewing angle information of the virtual lens at the original lens position are adjusted; and / or the original lens position of the virtual lens is adjusted.

[0087] In an exemplary embodiment of the present disclosure, generating a naked-eye 3D resource corresponding to the target interaction model based on the target resource scene, the virtual lens group, and the zero point position includes:

[0088] Determining a zero plane position according to the zero point position, and adjusting the zero plane position;

[0089] Determine a stereoscopic display area and a plane display area of ​​the target interaction model in the target resource scene according to the adjusted zero plane position;

[0090] Determining a model placement area of ​​the target interaction model in the target resource scene according to the stereoscopic display area and the plane display area, and adjusting a target model position of the target interaction model based on the model placement area;

[0091] The target resource scene after position adjustment and the virtual lens group are published to obtain naked-eye 3D resources corresponding to the target interaction model.

[0092] In an exemplary embodiment of the present disclosure, publishing the target resource scene after position adjustment and the virtual lens group to obtain a naked-eye 3D resource corresponding to the target interaction model includes:

[0093] In response to a touch operation on the resource publishing interactive control, displaying a resource publishing interface;

[0094] In response to a touch operation on the resource publishing interface, determining a resource publishing type;

[0095] Based on the resource publishing type, the target resource scene after position adjustment and the virtual lens group are published to obtain naked-eye 3D resources corresponding to the target interaction model.

[0096] In an exemplary embodiment of the present disclosure, the resource publishing type includes at least one of a program resource category, a video resource category, and a sequence frame resource category.

[0097] In an exemplary embodiment of the present disclosure, when the resource publishing type is a program resource category, publishing the target resource scene after position adjustment and the virtual lens group based on the resource publishing type to obtain a naked-eye 3D resource corresponding to the target interaction model includes:

[0098] Displaying a resource publishing interface corresponding to the program resource category;

[0099] In response to an input operation on a resource publishing interface corresponding to the program resource category, determining a storage path for the naked-eye 3D resource;

[0100] The target resource scene after position adjustment and the virtual lens group are packaged to obtain a naked-eye 3D resource with a program resource category.

[0101] In an exemplary embodiment of the present disclosure, when the resource publishing type is a video resource category and / or a sequence frame resource category, based on the resource publishing type, publishing the position-adjusted target resource scene and the virtual lens group to obtain a naked-eye 3D resource corresponding to the target interaction model includes:

[0102] Displaying a resource parameter adjustment interface corresponding to the video resource category and / or sequence frame resource category;

[0103] In response to an input operation on the resource parameter adjustment interface, determining a target resource parameter corresponding to the video resource category and / or the sequence frame resource category;

[0104] The target resource parameters, the target resource scene after position adjustment, and the virtual lens group are saved to obtain a naked-eye 3D resource with a video resource category and / or a sequence frame resource category.

[0105] In an exemplary embodiment of the present disclosure, the target resource parameter includes at least one of a rendering style parameter, a resolution parameter, and an output type parameter;

[0106] The target resource parameters, the target resource scene after position adjustment, and the virtual lens group are saved to obtain a naked-eye 3D resource having a video resource category and / or a sequence frame resource category, including:

[0107] Determine a target rendering style of the naked eye 3D resource according to the rendering style parameters in the target resource parameters;

[0108] Determining a target picture type of the output picture based on an input type parameter in the target resource parameters, and determining a target resolution of the output picture based on a resolution parameter in the target resource parameters;

[0109] In response to a touch operation on a third preset interactive control in the resource parameter adjustment interface, a naked-eye 3D resource having a target rendering style and a target resolution and having a video resource category and / or a sequence frame resource category is output.

[0110] In an exemplary embodiment of the present disclosure, the target rendering style includes a multi-view stitching mode or a rendering result mode, and the target picture type includes a video picture type or a sequence frame picture type;

[0111] In response to a touch operation on a third preset interactive control in the resource parameter adjustment interface, outputting a naked-eye 3D resource having a target rendering style and a target resolution and having a video resource category and / or a sequence frame resource category includes:

[0112] In response to a touch operation on a third preset interactive control in the resource parameter adjustment interface, outputting a naked-eye 3D resource having a multi-viewpoint stitching mode and a target resolution and a video picture type; or

[0113] In response to a touch operation on a third preset interactive control in the resource parameter adjustment interface, outputting a naked-eye 3D resource having a rendering result mode and a target resolution and a video picture type; or

[0114] In response to a touch operation on a third preset interactive control in the resource parameter adjustment interface, outputting a naked-eye 3D resource having a multi-viewpoint stitching mode and a target resolution and a sequence frame type; or

[0115] In response to a touch operation on a third preset interactive control in the resource parameter adjustment interface, a naked-eye 3D resource having a rendering result mode and a target resolution and a sequence frame picture type is output.

[0116] In an exemplary embodiment of the present disclosure, the method for processing naked-eye 3D resources further includes:

[0117] Outputting the naked-eye 3D resource having the program resource category to a target display device, and displaying the naked-eye 3D resource having the program resource category through the target display device; and / or

[0118] The naked-eye 3D resource having the video resource category and / or the sequence frame resource category is output to a target display device, and the target display device displays the resource having the video resource category and / or the sequence frame resource category.

[0119] In an exemplary embodiment of the present disclosure, after the target display device displays the naked-eye 3D resource having the program resource category, the method for processing the naked-eye 3D resource further includes:

[0120] In response to the input current interaction gesture, obtaining hand state information and finger movement direction, and determining a current interaction instruction to be executed by a target interaction model in the naked-eye 3D resource based on the hand state information and finger movement direction;

[0121] The target interaction model in the naked-eye 3D resource is controlled to execute the current interaction instruction, the target interaction model is switched from an original model state to a target model state corresponding to the current interaction instruction, and the model animation generated by executing the current interaction instruction is displayed.

[0122] In an exemplary embodiment of the present disclosure, the current interaction gesture includes at least one of a human body interaction gesture, a somatosensory controller interaction gesture, an external device interaction gesture, and a handle interaction gesture.

[0123] In an exemplary embodiment of the present disclosure, controlling the target interaction model in the naked-eye 3D resource to execute the current interaction instruction includes:

[0124] Controlling the target interactive model in the naked-eye 3D resource to execute an up-down movement instruction and / or a left-right movement instruction; and / or

[0125] Controlling the target interactive model in the naked-eye 3D resource to execute a rotation instruction; and / or

[0126] The target interactive model in the naked-eye 3D resource is controlled to execute an explosion instruction.

[0127] In an exemplary embodiment of the present disclosure, controlling a target interactive model in the naked-eye 3D resource to execute an explosion instruction includes:

[0128] Controlling the model component submodule of the target interactive model in the naked eye 3D resource to move in a preset direction and at a preset angle to achieve an explosion effect;

[0129] The preset direction includes a free movement direction or a coordinate axis movement direction, and the preset angle includes a local angle of the model component submodule relative to the target interaction model.

[0130] In an exemplary embodiment of the present disclosure, the method for processing naked-eye 3D resources further includes:

[0131] The target interaction model is controlled to recover from the target model state to the original model state at intervals of a preset duration.

[0132] According to one aspect of the present disclosure, a device for processing naked-eye 3D resources is provided, comprising:

[0133] An original resource scene generation module is used to create a new generation scene corresponding to the target interaction model, and load the target interaction model into the new generation scene to obtain an original resource scene;

[0134] A viewpoint number determination module is used to call a preset resource library to adjust the original resource scene to obtain a target resource scene, and determine the number of viewpoints of the target resource scene according to the target device parameters in the newly generated scene;

[0135] a virtual lens group configuration module, configured to configure lens parameters of a virtual lens group corresponding to the target resource scene according to the number of viewpoints, and configure the virtual lens group according to the lens parameters;

[0136] The naked-eye 3D resource generation module is used to generate a naked-eye 3D resource corresponding to the target interaction model based on the target resource scene, the virtual lens group and the zero point position.

[0137] According to one aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the computer program implements any one of the above-mentioned methods for processing naked-eye 3D resources.

[0138] According to one aspect of the present disclosure, there is provided an electronic device, including:

[0139] processor; and

[0140] a memory for storing executable instructions of the processor;

[0141] The processor is configured to execute any one of the above-mentioned methods for processing naked-eye 3D resources by executing the executable instructions.

[0142] The embodiment of the present disclosure provides a method for processing naked-eye 3D resources. On the one hand, a new generation scene corresponding to a target interaction model is created, and the target interaction model is loaded into the new generation scene to obtain an original resource scene; then a preset resource library is called to adjust the original resource scene to obtain a target resource scene, and the number of viewpoints of the target resource scene is determined according to the target device parameters in the new generation scene; then a virtual lens group corresponding to the target resource scene is configured according to the number of viewpoints, and the zero point position of the target resource scene is determined; finally, based on the target resource scene, the virtual lens group and the zero point position, a naked-eye 3D resource corresponding to the target interaction model is generated, thereby realizing the automatic generation of naked-eye 3D resources and solving the problems of the existing technology. During the operation, the problem of low generation efficiency of naked-eye 3D resources caused by the need to obtain naked-eye 3D resources through modeling, animation production and animation rendering is improved. On the other hand, since the target interaction model can be loaded in the newly generated scene to obtain the original resource scene, and then the preset resource library is called to adjust the original resource scene to obtain the target resource scene, the visualization of the target resource scene generation is realized. On the other hand, since the number of viewpoints of the target resource scene can be determined according to the target device parameters in the newly generated scene, and the virtual lens group corresponding to the target resource scene is configured according to the number of viewpoints, the generated naked-eye 3D resources can be adapted to a variety of different naked-eye 3D screens.

[0143] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0144] The accompanying drawings are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification, are used to explain the principles of the present disclosure. Obviously, the drawings described below are only some embodiments of the present disclosure, and those skilled in the art can derive other drawings based on these drawings without inventive effort.

[0145] FIG1 schematically shows a flow chart of a method for processing naked-eye 3D resources according to an exemplary embodiment of the present disclosure.

[0146] FIG2 schematically shows a block diagram of an editor system for viewing and producing multi-view naked-eye 3D content according to an exemplary embodiment of the present disclosure.

[0147] FIG3 schematically shows an example interface diagram of a project list created according to an exemplary embodiment of the present disclosure.

[0148] FIG4 schematically shows an example diagram of an interface for deleting a project according to an exemplary embodiment of the present disclosure.

[0149] FIG5 schematically shows an example diagram of the structure of a resource library according to an example embodiment of the present disclosure.

[0150] FIG6 schematically shows an example diagram of a project creation sub-interface according to an example embodiment of the present disclosure.

[0151] FIG7 schematically shows an example diagram of a scenario of a model label list according to an exemplary embodiment of the present disclosure.

[0152] FIG8 schematically shows an example diagram of a model timing setting interface according to an example embodiment of the present disclosure.

[0153] FIG9 schematically shows an example diagram of a scene of a scene resource library according to an example embodiment of the present disclosure.

[0154] FIG10 schematically shows an example diagram of a scene of an animation resource library according to an example embodiment of the present disclosure.

[0155] FIG11 schematically shows an exemplary diagram of a line of sight principle of a process of adjusting model attributes according to an exemplary embodiment of the present disclosure.

[0156] FIG12 schematically shows an example diagram of an animation property adjustment interface according to an example embodiment of the present disclosure.

[0157] FIG. 13 schematically illustrates an example diagram of an animation property adjustment interface according to an example embodiment of the present disclosure.

[0158] FIG14 schematically shows an example diagram of a material property adjustment interface according to an example embodiment of the present disclosure.

[0159] FIG15 schematically illustrates an example diagram of a sound attribute setting interface according to an exemplary embodiment of the present disclosure.

[0160] FIG. 16 schematically illustrates an example diagram of a virtual lens group according to an example embodiment of the present disclosure.

[0161] FIG. 17 schematically illustrates an example diagram of an interface for setting lens parameters according to an exemplary embodiment of the present disclosure.

[0162] FIG18 schematically illustrates a principle example diagram of a field of view of a virtual lens according to an exemplary embodiment of the present disclosure.

[0163] FIG19 schematically shows a flow chart of a method for generating a naked-eye 3D resource corresponding to a target interaction model based on the target resource scene, the virtual lens group, and the zero point position according to an exemplary embodiment of the present disclosure.

[0164] FIG20 schematically shows an example diagram of a scene obtained after adjusting the target model position of a target interaction model according to an example embodiment of the present disclosure.

[0165] FIG21 schematically shows an example diagram of a resource publishing interface according to an example embodiment of the present disclosure.

[0166] FIG22 schematically illustrates an example diagram of a resource parameter adjustment interface corresponding to a video resource category and / or a sequence frame resource category according to an example embodiment of the present disclosure.

[0167] FIG23 schematically shows an example diagram of a multi-view video picture according to an example embodiment of the present disclosure.

[0168] FIG. 24 schematically shows an example diagram of a composite screen according to an exemplary embodiment of the present disclosure.

[0169] FIG25 schematically shows a principle example diagram of a left-handed rectangular coordinate system according to an example embodiment of the present disclosure.

[0170] FIG26 schematically shows an example diagram of a scene obtained by controlling a single component of a target interaction model to move along its own forward direction according to an example embodiment of the present disclosure.

[0171] FIG27 schematically shows an example scene diagram of a single component of a control target interaction model expanded toward both sides along a fixed axis according to an example embodiment of the present disclosure.

[0172] FIG28 schematically shows an example diagram of 21 3D key points of a hand according to an example embodiment of the present disclosure.

[0173] FIG29 schematically shows a block diagram of a device for processing naked-eye 3D resources according to an exemplary embodiment of the present disclosure.

[0174] FIG30 schematically illustrates an electronic device for implementing the above-mentioned method for processing naked-eye 3D resources according to an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0175] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that the present disclosure will be more comprehensive and complete and will fully convey the concepts of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced while omitting one or more of the specific details, or that other methods, components, devices, steps, etc. may be employed. In other cases, well-known technical solutions are not shown or described in detail to avoid obscuring various aspects of the present disclosure.

[0176] In addition, the accompanying drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. Identical reference numerals in the figures denote identical or similar parts, and thus repetitive descriptions thereof will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities that do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0177] In the multi-view naked-eye 3D industry, if you want to generate corresponding naked-eye 3D resources, you need to rely on professional software developers to implement it through professional customization; that is, in the actual application process, if you need to generate naked-eye 3D videos or naked-eye 3D sequence frames, you need professional artists to use modeling software (such as 3DMax) to model, create animations and finally render the output video; however, the production cycle of a single video obtained in this way takes about 1 month; and, during the generation process of the naked-eye 3D program, it requires the cooperation of artists and programmers to achieve the purpose of developing content and adjusting effects, which takes more time than producing videos.

[0178] Based on this, an example embodiment of the present disclosure provides a method for processing naked-eye 3D resources. In the method for processing naked-eye 3D resources provided by the example embodiment of the present disclosure, a model library, scene library, animation library, lighting library, material library, sound library, and naked-eye 3D imaging and effect adjustment system can be built into the resource editor, supporting users to import 3D models in any format and output their own naked-eye 3D content after simple editing, thereby improving the situation where multi-viewpoint naked-eye 3D content production is difficult and there is a lack of industry content.

[0179] In an exemplary embodiment, the exemplary embodiment of the present disclosure first provides a method for generating naked-eye 3D resources. The method for generating naked-eye 3D resources can be run on a terminal device, server, server cluster, or cloud server where a resource editor is located. Of course, those skilled in the art can also run the method of the present disclosure on other platforms as needed, and this exemplary embodiment does not specifically limit this. Specifically, referring to Figure 1, the method for generating naked-eye 3D resources may include the following steps:

[0180] Step S110: creating a new generation scene corresponding to the target interaction model, and loading the target interaction model into the new generation scene to obtain an original resource scene;

[0181] Step S120: calling a preset resource library to adjust the original resource scene to obtain a target resource scene, and determining the number of viewpoints of the target resource scene according to the target device parameters in the newly generated scene;

[0182] Step S130. configuring lens parameters of a virtual lens group corresponding to the target resource scene according to the number of viewpoints, and configuring the virtual lens group according to the lens parameters;

[0183] Step S140: Based on the target resource scene, the virtual lens group and the zero point position, generate a naked-eye 3D resource corresponding to the target interaction model.

[0184] In the above-mentioned method for processing naked-eye 3D resources, on the one hand, by creating a new generated scene corresponding to the target interaction model and loading the target interaction model in the new generated scene, the original resource scene is obtained; then the preset resource library is called to adjust the original resource scene to obtain the target resource scene, and the number of viewpoints of the target resource scene is determined according to the target device parameters in the new generated scene; then the virtual lens group corresponding to the target resource scene is configured according to the number of viewpoints, and the zero point position of the target resource scene is determined; finally, based on the target resource scene, the virtual lens group and the zero point position, the naked-eye 3D resource corresponding to the target interaction model is generated, thereby realizing the automatic generation of naked-eye 3D resources, thereby solving the problem in the prior art caused by The problem of low generation efficiency of naked-eye 3D resources caused by the need to obtain naked-eye 3D resources through modeling, animation production and animation rendering is improved. On the other hand, since the target interaction model can be loaded in the newly generated scene to obtain the original resource scene, and then the preset resource library is called to adjust the original resource scene to obtain the target resource scene, the visualization of the target resource scene generation is realized. On the other hand, since the number of viewpoints of the target resource scene can be determined according to the target device parameters in the newly generated scene, and the virtual lens group corresponding to the target resource scene is configured according to the number of viewpoints, the generated naked-eye 3D resources can be adapted to a variety of different naked-eye 3D screens.

[0185] Hereinafter, the method for processing naked-eye 3D resources described in the exemplary embodiments of the present disclosure will be further explained and illustrated with reference to the accompanying drawings.

[0186] First, the specific terms involved in the exemplary embodiments of the present disclosure are explained and illustrated.

[0187] 3DMax: A three-dimensional digital modeling tool that can create three-dimensional models and animations.

[0188] C4D: A three-dimensional digital modeling tool that can create three-dimensional models and animations.

[0189] Unity3D: A three-dimensional game engine that can be used to develop three-dimensional games and three-dimensional software, also known as Unity or U3D.

[0190] UE: A 3D game engine, also known as Ureal Engine in Chinese, which includes two major versions: UE4 and UE5.

[0191] Unity3D scene: The concept of the game engine. A virtual scene can be called a virtual stage. At the same time, in actual application, virtual objects can be placed in the virtual scene, and multiple scenes can be loaded at the same time.

[0192] Object: refers to the virtual objects in the game engine. Each virtual object can be made into a corresponding virtual model through modeling software; at the same time, the objects included in the game engine itself may include lights, cameras, etc.

[0193] Camera: refers to the virtual camera in the Unity3D engine. It is a virtual concept. The picture presented by the software is the virtual scene picture captured by the virtual camera.

[0194] Multi-viewpoint naked-eye 3D: refers to a grating-type naked-eye 3D screen that can present a 3D effect on specific screen content through optical effects.

[0195] Camera system: Assuming that the camera system includes 9 virtual lenses (or virtual cameras), the camera system can be composed of 9 equally spaced cameras arranged in a row. At the same time, the 9 cameras are facing a point, and the resulting point can be called the zero point, and the zero point is the center point of the zero plane. In actual application, the angle of each camera is automatically adapted because it is facing the zero point. Of course, the camera system also has a camera for editing and a 2D mode used when producing content.

[0196] Zero plane: In the three-dimensional space of the software, a zero plane is set to determine the dividing point between the multi-view naked-eye 3D screen exit and screen entry based on the zero plane.

[0197] Off-screen and on-screen: refers to the feeling that objects extend beyond the plane or sink into the screen when people look at the naked-eye 3D plane; in the corresponding software 3D space, the effective area between the zero plane and the camera is the off-screen area, and the effective area after the zero plane is the on-screen area.

[0198] Adjustment interface: The adjustment interface controls the adjustment of camera parameters and saves and reads them. At the same time, since naked-eye 3D imaging is a composite image of images from multiple cameras, the adjustment factors here will affect the difference in the images of the objects seen in these images. In addition, the greater the difference in the images, the stronger the screen effect. However, if the difference in the images is too great, they will be blurred and produce ghosting. Therefore, the difference in the images needs to be controlled within a certain range.

[0199] Secondly, an editor system for viewing and producing multi-view naked-eye 3D content involved in an example embodiment of the present disclosure is explained and illustrated; specifically, the system has built-in core functions such as professional art scene resources, naked-eye 3D layout algorithms, models, animations and naked-eye 3D parameter editing, allowing non-professional and professional users to import models and perform simple editing to obtain naked-eye 3D content with good effects; further, the output naked-eye 3D content (or it can also be called naked-eye 3D resources) can be directly connected to a naked-eye 3D screen for viewing, and naked-eye 3D programs and naked-eye 3D videos can also be output for use on a naked-eye 3D screen.

[0200] Specifically, as shown in FIG2 , the editor system for viewing and creating multi-view glasses-free 3D content may include a project management component 210, a model import component 220, a resource library 230, a property editing component 240, a human-computer interaction component 250, a glasses-free 3D imaging component 260, and a resource preview and publishing component 270. In actual use, the project management component may be used to create new scenes, the model import component may be used to import object models, the resource library may be used to store various resources, the property editing component may be used to edit the properties of models or resources, the human-computer interaction component may be used to interact with the displayed glasses-free 3D program, the glasses-free 3D imaging component may be used to determine the zero point position, and the resource preview and publishing component may be used to preview and / or publish generated glasses-free 3D resources.

[0201] In an exemplary embodiment, the naked-eye 3D imaging component described herein may be composed of a camera system, an adjustment interface, and an interweaving algorithm. Furthermore, the editor system for viewing and producing multi-view naked-eye 3D content and the resource preview and publishing component may include the naked-eye 3D imaging component. Furthermore, the naked-eye 3D imaging component may support not only naked-eye 3D mode imaging but also 2D mode imaging. Furthermore, the principle of naked-eye 3D imaging is as follows: in the software, there are as many cameras as there are viewpoints. For example, with nine cameras, the nine cameras can be arranged in a row at equal distances, with the goal of each camera "seeing" the target object from a certain angle, thus obtaining nine pictures of the object from nine different angles. Finally, an interweaving algorithm is used to synthesize a single image, which can then be displayed on a naked-eye 3D screen with a 3D effect.

[0202] In an example embodiment, in an editor system for viewing and producing multi-view naked-eye 3D content, the content edited by the user can be saved in the concept of a project, that is, the naked-eye 3D resource can be described in the concept of a project; at the same time, the project recorded here can include resources imported and used by the user and the user's editing data; further, the data of the project is saved in the form of a file on the local disk; and the data and resources recorded and saved by the project can be used to build a Unity3D scene, and the scene recorded here can be used to represent a new generated scene, and it is necessary to load the scene library scene at the same time to achieve the effect of the generated scene loading the scene library scene. Furthermore, in the actual application process, the project management recorded above includes operations such as project creation, project opening, project saving, project deletion, and project import. The multiple projects created can be managed in the form of a list. The specific interface diagram obtained can be referred to as shown in Figure 3.

[0203] In an example embodiment, the above-described project opening can be implemented as follows: click on an element icon in the project file list to open a project; at the same time, the process of opening the project is to use the project data and resources to build a Unity scene, that is, generate a scene. In an example embodiment, the specific implementation process of project saving is: save the editing status of the current project, and the specific data and resources saved in the project include: the used scene, imported model, model position\rotation\scaling, animation, lighting, sound, material, naked eye 3D related information. In an example embodiment, the specific implementation process of project deletion is: click on the delete button in the lower right corner of the project element on the project interface to delete the project; at the same time, if the project deletion operation is performed, all data and resources of the project need to be deleted, specifically the file recording the project data; wherein, the specific example diagram of the project deletion scene can be referred to as shown in Figure 4. In an example embodiment, the project import described above can be implemented in the following way: click the "Import Project" button on the display interface shown in Figure 3 to import the external project file. After importing, the external project is added to the project list of the current software; at the same time, the import process is to completely import the external project data into the directory where the current software stores the project data.

[0204] In an exemplary embodiment, as shown in reference to FIG5 , the resource library recorded herein may include, but is not limited to, a model resource library 501, a scene resource library 502, an animation resource library 503, a lighting resource library 504, a material resource library 505, and a sound resource library 506, etc.; wherein, the model resource library includes object models, the scene resource library includes various scene resources, such as indoor scenes, outdoor scenes, sunny scenes, rainy scenes, and snowy scenes, etc.; the animation resource library includes various animation resources, such as rotation, scaling, explosion, etc.; the lighting resource library includes lighting resources with various display effects, such as strong light, weak light, point light source, warm tones, and cold tones, etc.; the material resource library includes various materials associated with the object model, which can be determined according to the object model, and no further restrictions are made here; the sound resource library includes sound resources for a variety of different scenes, such as natural sounds, noise, crying, laughing, car sounds, etc.

[0205] In an example embodiment, the viewpoint naked-eye 3D content viewing and production editor system described above can adopt an offline stand-alone mode or a CS (Client / Server) client-server mode in the specific implementation process; the main difference between the two modes is whether the resource library is stored locally or on the server; in the actual application process, whether it adopts a stand-alone mode or a client-server mode, it can be called a client; at the same time, the client is implemented using Unity3D, and of course it can also be implemented using the UE engine. Of course, it is not limited to Unity3D and the UE engine, and all other technologies that can implement the system solution are acceptable. This example does not impose special restrictions on this. Furthermore, the viewpoint naked-eye 3D content viewing and production editor system described above fills the gap in the naked-eye industry 3D content production editor, greatly reduces the difficulty of naked-eye 3D content production, improves production efficiency, and will improve the industry dilemma of the lack of naked-eye 3D content.

[0206] Furthermore, the application scenarios of the example embodiments of the present disclosure are explained and illustrated. Specifically, the method for processing naked-eye 3D resources recorded in the example embodiments of the present disclosure can be applied to scenarios of data three-dimensional twin simulation of traffic simulators, three-dimensional visualization simulation of traffic data, and verification of traffic light timing schemes. In an example embodiment, if the scheme is applied to a data three-dimensional twin simulation scenario of a traffic simulator, then a traffic simulator naked-eye 3D resource corresponding to the three-dimensional twin simulation scenario of the traffic simulator can be generated based on the method for processing naked-eye 3D resources, and the traffic simulator naked-eye 3D resource can be displayed to simulate and test the actual traffic scenario, and to allocate the actual traffic resources based on the simulation test results. In another example embodiment, if the scheme is applied to a three-dimensional visualization simulation scenario of traffic data, then a traffic data naked-eye 3D resource corresponding to the three-dimensional visualization simulation scenario of traffic data can be generated based on the method for processing naked-eye 3D resources, and the traffic data naked-eye 3D resource can be displayed to simulate and analyze the actual traffic data, and to analyze traffic anomalies appearing in the actual traffic data based on the simulation analysis results. In another example embodiment, if the scheme is applied to the scenario of verifying the timing scheme of a traffic light, a naked-eye 3D resource of a traffic light corresponding to the verification scenario of the timing scheme of a traffic light can be generated based on the processing method of the naked-eye 3D resource, and the naked-eye 3D resource of the traffic light can be displayed to simulate and analyze the actual timing scheme of the traffic light, and further adjust the actual timing scheme of the traffic light based on the simulation analysis results.

[0207] The following will further explain and illustrate the method for processing the naked eye 3D resource shown in FIG1 in conjunction with FIG2 and FIG5. Specifically:

[0208] In step S110 , a new generation scene corresponding to the target interaction model is created, and the target interaction model is loaded into the new generation scene to obtain an original resource scene.

[0209] In this example embodiment, first, a new generation scene corresponding to the target interaction model is created; specifically, it can be achieved in the following way: first, in response to a touch operation on a first preset interactive control on the display interface of the resource creation terminal, a project creation sub-interface is displayed; secondly, in response to an input operation on the project creation sub-interface, target device parameters and naked-eye 3D interleaving parameters of a target display device that displays naked-eye 3D resources corresponding to the target interaction model are determined; then, in response to a touch operation on a second preset interactive control in the project creation sub-interface, a new generation scene corresponding to the target interaction model is created. That is, in the actual application process, if you need to generate a new generation scene, you can touch the interactive control (the first preset interactive control) of the creation project as shown in Figure 3 to display the project creation sub-interface as shown in Figure 6; then, enter the target device parameters of the target display device and the naked-eye 3D interlacing parameters in the project creation sub-interface; the target device parameters can be selected directly from the editor or set in a customized way; at the same time, the naked-eye 3D interlaced parameters can include interlacedX and interlacedA, and the naked-eye 3D interlaced parameters can be set by the interlaced parameters associated with the target device parameters, or by a customized way. In this example There is no special restriction on this; it should be noted here that, in actual application, the default parameters of the target display device are built-in configurations in the software according to the device, and users can use the default parameters of the corresponding device without modification; at the same time, the naked-eye 3D interlaced parameters recorded here are parameters adapted to the naked-eye 3D screen and the software imaging module. They are two parameters, which are the basic parameters of naked-eye 3D imaging and are parameters agreed upon by the industry; and each naked-eye 3D screen has one set of such parameters; further, when the parameter configuration is completed, the create button in the touch project creation sub-interface can be used to obtain a newly generated scene corresponding to the target interaction model; for example, taking the target interaction model as a package as an example, a newly generated scene named package can be obtained.

[0210] Secondly, the target interaction model is loaded into the newly generated scene to obtain the original resource scene; specifically, this can be achieved in the following ways: according to the target model name of the target interaction model, the target interaction model is obtained from a preset model library; and / or according to the target model name of the target interaction model, the target interaction model is imported from an external file; the model size of the target interaction model in the newly generated scene is adaptively adjusted to obtain the original resource scene. That is, in actual application, the loading of the target interaction model can be achieved by external import or directly obtained from the model library; at the same time, the data format of the target interaction model recorded here can include but is not limited to common formats such as .fbx format, .gltf format, .obj format, .3mf format, .ply format and .stl format, and can also support Unity's AssetBundle resource format.

[0211] In an example embodiment, after the target interaction model is loaded into the newly generated scene, the model size needs to be adaptively adjusted; specifically, the model size of the target interaction model in the newly generated scene is adaptively adjusted to obtain the original resource scene, which can be achieved in the following way: first, a first rectangle is constructed according to the newly generated scene, and a second rectangle is constructed according to the target interaction model; secondly, based on the first rectangle and the second rectangle, the model scaling coefficient of the target interaction model in the newly generated scene is calculated; then, based on the model scaling coefficient, the model size of the target interaction model is adaptively adjusted to obtain the original resource scene.

[0212] In an example embodiment, constructing a first rectangle based on the newly generated scene can be achieved in the following manner: displaying the newly generated scene on the display interface of the resource creation terminal; taking the center point of the display interface as the center point of the first rectangle, and determining the first rectangle length and the first rectangle width of the first rectangle based on the interface length and interface width occupied by the newly generated scene on the display interface; constructing the first rectangle based on the center point, the first rectangle length and the first rectangle width of the first rectangle.

[0213] In an example embodiment, constructing a second rectangle based on the target interaction model can be achieved as follows: obtaining pixel coordinates of pixel points in the target interaction model, and obtaining the maximum horizontal coordinate value, maximum vertical coordinate value, minimum horizontal coordinate value and minimum vertical coordinate value in the pixel coordinates; determining the height of the second rectangle based on the maximum horizontal coordinate value and the minimum horizontal coordinate value, and determining the length of the second rectangle based on the maximum vertical coordinate value and the minimum vertical coordinate value; using the center point of the target interaction model as the center point of the second rectangle, and constructing the second rectangle based on the center point of the second rectangle, the height of the second rectangle and the length of the second rectangle.

[0214] In an example embodiment, the model scaling coefficient of the target interaction model in the newly generated scene is calculated based on the first rectangle and the second rectangle, which can be achieved as follows: mapping the first rectangle to the three-dimensional coordinates of the resource generation engine to obtain a rectangle mapping result; calculating a first ratio between the rectangle mapping height and the second rectangle height in the rectangle mapping result, and calculating a second ratio between the rectangle mapping length and the second rectangle length in the rectangle mapping result; based on the first ratio and the second ratio, determining the model scaling coefficient of the target interaction model in the newly generated scene.

[0215] The following will further explain and illustrate the process of adaptively adjusting the model size. Specifically, the adaptive adjustment of the model size of the target interaction model can be achieved through an automatic scaling matching mechanism; wherein, the automatic scaling matching medium described herein refers to the process of adaptively adjusting the target interaction model through an automatically set model scaling factor during the import or loading process, so that the loaded or imported target interaction model is displayed within the optimal range of the system software interface, that is, the optimal viewing range of the camera.

[0216] Furthermore, during adaptive adjustment, the zero point (0,0,0) position of the display interface can be used as the default import position of the model; at the same time, based on the fact that the zero point position has been determined, it is only necessary to determine the scaling factor of the model and scale the model size based on the model scaling factor, so that the target interactive model can be displayed at a more appropriate size in the display interface. Among them, the specific calculation process of the model scaling factor can be achieved in the following way: first, determine a rectangle (first rectangle) with a fixed length and width centered on the center point of the screen; secondly, calculate the length w1 and height h1 of the mapping rectangle (rectangular mapping result) of the first rectangle in the world coordinate space of the zero point (0,0,0); then, calculate the leftmost and rightmost, topmost and rightmost sides of the just imported model to obtain a rectangle (second rectangle) with a length w2 and a height h2; further, calculate w1 / w2, h1 / h2 respectively to obtain two coefficients, and take the smaller value of the two coefficients, which is named Scale here. min ;Finally, the final model scaling factor = the coefficient when the model is imported X*Scale min .

[0217] In an exemplary embodiment, the editor system for viewing and producing multi-view naked-eye 3D content described in the exemplary embodiment of the present disclosure can also support the display of multiple models; wherein, the multiple models described above refer to multiple models that can appear in one scene. For simplicity, only one model can appear in the same screen; when a model already exists in the current screen, a new label will be created when a model is imported. A maximum of 10 models can be supported. Specifically, in actual application, this can be achieved by: in response to a model loading operation, loading a new virtual model in the original resource scene, and / or importing a new virtual model into the original resource scene; generating a model label corresponding to the new virtual model, and displaying the model label in the original resource scene. That is, in actual application, if other models (such as new virtual models) are imported in addition to the target interaction model, corresponding model labels can be generated based on the model names of each model and displayed in a list; wherein the resulting scene example diagram can be shown in Figure 7.

[0218] In an example embodiment, in a multi-model display scenario, each model can be switched for display. Specifically, this can be achieved as follows: in response to a touch operation on the model tag, a newly added virtual model corresponding to the model tag is displayed in the original resource scene, and the target interactive model in the original resource scene is switched based on the newly added virtual model. In other words, in actual application, if you need to switch the display of the model, you can click the corresponding model tag to switch the model for viewing; at the same time, if you move the cursor to the corresponding model tag, a thumbnail of the model corresponding to the model tag will pop up at the corresponding location.

[0219] In an example embodiment, in a scenario where multiple models are displayed, the display order and display timing of each model can also be adjusted. Specifically, this can be achieved in the following ways: in response to a touch operation on the model label, the display order of the model label in the original resource scenario is adjusted; the mode timing setting interface of the newly added virtual model and / or target interaction model is displayed; in response to an input operation on the mode timing setting interface, the model display duration of the newly added virtual model and / or target interaction model is determined. That is, in the actual application process, if the number of times a model is displayed needs to be adjusted, the model label of the model can be directly dragged to the corresponding display position; further, if the display timing of the model needs to be adjusted, it can be achieved through the mode timing setting interface.

[0220] In an example embodiment, the display timing of the model recorded above refers to the order of display of model resources and the display duration of a single model in the preview and published project; at the same time, the display timing is an automatic display timing when there is no operation for the published program, and the display timing is stopped when there is interactive operation; in the actual application process, there are two types of model display timing: one display timing is: using an animation with a fixed duration, and the display duration is the animation duration; the other display timing is: no animation or animation has no fixed duration (such as a rotating animation), and the display duration is the default time of 3 seconds; further, in the process of setting the display timing of multiple models, it can be achieved through the model timing setting interface; wherein, the model timing is set in the preview interface, and when the user previews the model display, if he is not satisfied with the order and display time, he can set it; wherein, the specific model timing setting interface can be shown in Figure 8. Furthermore, when the model timing setting interface is opened, the information of all models imported into the current project will be automatically displayed. Each model can correspond to a corresponding display timing information. When timing adjustment is required, the display order can be adjusted by dragging the display timing information corresponding to the model, or the display duration can be adjusted by clicking the "-" or "+" symbols in the display timing information. It should be noted here that the minimum display time of the model is 1 second. Of course, you can also use a model with a fixed-duration animation, and its display time cannot be modified.

[0221] In step S120, a preset resource library is called to adjust the original resource scene to obtain a target resource scene, and the number of viewpoints of the target resource scene is determined according to the target device parameters in the newly generated scene.

[0222] In this example embodiment, first, the preset resource library is called to adjust the original resource scene, and then the target resource scene is obtained; wherein, the content in the preset resource library recorded here may include but is not limited to the data information of the resource and the resource file itself; wherein, the data information of the resource refers to the information recording the specifications of the resource; for example, in terms of the scene resource distance, the data information of the scene resource may include the English name of the scene resource, the Chinese name, the resource loading address, the resource introduction picture address, etc.; and, corresponding to the offline client of the system, the resources and data are stored locally; corresponding to the online client of the system, the resources and data are stored on the server and need to be obtained and downloaded.

[0223] Furthermore, the preset resource library recorded herein may include, but is not limited to, a scene resource library, a model resource library, an animation resource library, a material resource library, a lighting resource library, and a sound resource library, etc.; wherein, the scene resource library recorded herein may be used to represent a three-dimensional scene library produced by art design; wherein, the three-dimensional scene library uses Unity3D's AssetBundle to package the produced scene, and then loads it into the system through the system software to obtain the scene resource library; wherein, a specific scene example diagram of the scene resource library can be shown in FIG9. The animation implementation of the animation library recorded herein may include the following methods: one implementation method is: using the Unity3D program to implement animation, such as rotation, floating up and down, directly adding it to the model object, and then acting on the model; another implementation method is: using an art tool (such as 3DMax) to create a keyframe animation, which records the trajectory of an object moving, rotating, or scaling; at the same time, when exporting the art tool, export the animation object alone, and then in the client, hang the model object under the animation object as a child object of the animation object; wherein, the scene diagram of the animation resource can be specifically shown in FIG10. The lights in the light resource library recorded here can be implemented based on the lights in the Unity3D engine; they can include basic parallel lights, point lights, spotlights, and combined lights of point lights and spotlights in Unity3D, etc.; among them, the combined lights recorded here can be a new light source composed of two point lights at different positions and angles. The material resource library described here is a code that controls the performance of 3D objects. The materials in the material library can be objects in some scenes, such as glass, brushed metal, frosted metal, and diamonds. In actual application, different models can correspond to different materials, and this example does not impose special restrictions on this. In the process of importing or loading a model, the model information will be automatically recognized by default, and the default material and the texture and color information carried by the model itself will be used. Of course, if the user is not satisfied with the default effect, the corresponding material provided in the material resource library can be used. In addition, the use of the material library requires selecting a material icon in the material library and then dragging the selected material icon to the corresponding part of the corresponding model. When the control of the material icon is released, the material of the current part of the model will use the dragged material to replace the original material. Of course, the texture and color use the original texture and color of the part. The sound resource library described here can be used to set background music for the edited content, which can provide audio data in audio formats such as MP3.

[0224] On the premise of the above-mentioned contents, calling the preset resource library to adjust the original resource scene to obtain the target resource scene can be achieved in the following ways: loading the original three-dimensional scene corresponding to the target interaction model from the scene library, and adding the original three-dimensional scene to the newly generated scene; and / or loading the original three-dimensional animation from the animation library, and applying the original three-dimensional animation to the target interaction model; and / or loading the original light from the light library, and adding the original light to the newly generated scene; wherein, the original light recorded here may include but is not limited to parallel light, point light source, spotlight, and combination light composed of point light source and spotlight, etc.; and / or loading the model material corresponding to the target interaction model from the material library, and applying the model material to the target interaction model; and / or loading the audio data corresponding to the target interaction model from the sound library, and adding the audio data to the newly generated scene; adjusting the model properties and / or animation properties and / or light properties and / or material properties and / or sound properties of the target interaction model in the newly generated scene to obtain the target resource scene.

[0225] The following will further explain and illustrate the specific adjustment process of the original resource scenario.

[0226] In an example embodiment, loading the original three-dimensional scene corresponding to the target interaction model from the scene library and adding the original three-dimensional scene to the newly generated scene can be achieved in the following manner: first, determining the scene name of the original three-dimensional scene corresponding to the target interaction model, for example, when the target interaction model is a package, determining that the scene name of the corresponding original three-dimensional scene is an interior decoration scene; then, based on the scene name, loading the original three-dimensional scene from the scene library (i.e., the scene resource library), and adding the original three-dimensional scene as a background to the newly generated scene to modify the package in the scene for better display.

[0227] In an exemplary embodiment, loading an original three-dimensional animation from the animation library and applying the original three-dimensional animation to the target interaction model can be achieved as follows: first, determining the original three-dimensional animation to be loaded corresponding to the target interaction model, and then loading the original three-dimensional animation from the animation library (i.e., the animation resource library); wherein, the original three-dimensional animation recorded here can include program animation and keyframe animation, etc.; the program animation can also be called Unity program animation, and the animation properties of Unity program animation can include the animation cycle time length and animation amplitude of the animation; the keyframe animation can also be called art keyframe animation, and the art keyframe animation can include up, down, left, right, front, and back offset properties; wherein the up, down, left, right, front, and back offset properties can be used to characterize the offset when the entire animation trajectory is offset. Under this premise, in the process of applying the original three-dimensional animation to the target interaction model, it can be achieved as follows: adding the program animation to the target interaction model; and / or mounting the target interaction model under the animation object in the keyframe animation, so that the target interaction model is used as a child object of the animation object. That is to say, for program animation, the rotation program or up and down floating program corresponding to the target interaction model can be directly added to the model object to act on the target interaction model; for key frame animation, the target interaction model can be directly mounted under the animation object in the key frame animation, so that the target interaction model can be used as a child object of the animation object in the key frame animation, thereby realizing operations such as moving, rotating or scaling the target interaction model.

[0228] In an exemplary embodiment, loading the model material corresponding to the target interaction model from the material library and applying the model material to the target interaction model can be achieved in the following manner: first, the material name of the model material corresponding to the target interaction model can be determined, and then the model material can be loaded from the material library (i.e., the material resource library), and the model material can be applied to the target interaction model; wherein, in the process of applying the model material to the target interaction model, it can be achieved in the following manner: in response to dragging the model material to the target interaction model, the original material in the target interaction model is replaced based on the model material. That is, after determining the model material, the model material can be directly dragged to the corresponding position of the target interaction model.

[0229] In an exemplary embodiment, the model properties and / or animation properties and / or lighting properties and / or material properties and / or sound properties of the target interaction model in the newly generated scene are adjusted to obtain the target resource scene, which can be achieved in the following manner: first, the model properties of the target interaction model in the newly generated scene are adjusted; wherein the model properties recorded here may include structural hierarchy properties and position properties; secondly, the animation properties of the target interaction model in the newly generated scene are adjusted; immediately afterwards, the lighting properties of the target interaction model in the newly generated scene are adjusted; then, the material properties of the target interaction model in the newly generated scene are adjusted; wherein the material properties recorded here may include but are not limited to material properties including model color, texture map, normal map, transparency, glossiness and refraction, etc.; finally, the sound properties of the target interaction model in the newly generated scene are adjusted. Specifically:

[0230] On the one hand, adjusting the model properties of the target interaction model in the newly generated scene can be achieved in the following two ways: one implementation method is: in response to the touch operation of the model property interaction control, the model adjustment interface of the model properties of the target interaction model is displayed; in response to the input operation of the model adjustment interface, the attribute value of the structural hierarchy attribute and / or the attribute value of the position attribute of the target interaction model is adjusted. Another implementation method is: in response to the movement event acting on the target interaction model, the current model position of the target interaction model in the newly generated scene is adjusted, and / or the target interaction model is rotated. That is, in the actual application process, if the target interaction model is a target interaction model that can be positioned, when the target interaction model is loaded into the scene, the system interface can display the position attribute parameters corresponding to the target interaction model, and the user can directly modify the position attribute parameters of the target interaction model. In actual application, the position properties of the model can support shortcut modification, for example: holding down the left button of the mouse to move, the target interaction model can be moved up, down, left, and right; for example, holding down the right button of the mouse to move, the target interaction model can be rotated; sliding the mouse wheel can zoom the target interaction model; for example, holding down Ctrl+mouse wheel can move the target interaction model forward and backward. Among them, the specific implementation principle example diagram of the model property adjustment process can be referred to as shown in Figure 11. It should be noted here that in the process of adjusting the target interaction model, if the user is not satisfied with the adjustment result of the target interaction model, the property reset function control in the display interface can be used to reset the operation to control the target interaction model to return from the adjusted state to the state at the time of import or loading.

[0231] On the other hand, adjusting the animation properties of the target interaction model in the newly generated scene can be achieved in the following ways: in response to a touch operation on the animation setting interaction control, displaying the animation adjustment interface corresponding to the animation properties; in response to an input operation on the animation adjustment interface, adjusting the animation cycle time length and / or animation amplitude in the animation properties; and / or adjusting the offset of the animation trajectory in the animation properties in the newly generated scene. That is, in actual application, when it is necessary to adjust the animation properties, the animation setting control can be touched to display the animation property adjustment interface; wherein, the animation property adjustment interface can be specifically shown in FIG12; further, based on the animation property adjustment interface shown in FIG12, it can be known that the upper and lower offset positions, the front and rear offset positions, and the animation running speed of the target interaction model can be directly adjusted.

[0232] On the other hand, adjusting the lighting properties of the target interaction model in the newly generated scene can be achieved in the following ways: in response to a touch operation on the light setting interactive control, a lighting adjustment interface corresponding to the lighting properties is displayed; in response to an input operation on the lighting adjustment interface, the lighting position and / or light intensity and / or light color of the parallel light and / or point light source and / or spotlight and / or combined light in the newly generated scene are adjusted. That is, in the actual application process, since the light properties can include the light position properties and the properties of the light itself; wherein, the properties of the light itself can include light intensity and light color, etc.; therefore, if it is necessary to adjust the light properties of the target interaction model, the light setting control can be touched to display the light property adjustment interface; wherein, the light property adjustment interface can be specifically shown in Figure 13; further, based on the light property adjustment interface shown in Figure 13, it can be known that the light intensity of parallel light, point light source, spotlight, and combination light can be adjusted directly based on the light property adjustment interface, and the light color of parallel light, point light source, spotlight, and combination light can also be adjusted. The light position and light angle of parallel light, point light source, spotlight, combination light can also be adjusted.

[0233] On the other hand, adjusting the material properties of the target interaction model in the newly generated scene can be achieved in the following way: in response to the touch operation of the material setting interactive control, the material adjustment interface corresponding to the material properties is displayed; in response to the input operation of the material adjustment interface, the model color and / or texture map and / or normal map and / or transparency and / or glossiness and / or refraction of the target interaction model are adjusted. That is, in the actual application process, since the material properties may include common parameters such as base color, main texture, normal map, transparency, and some individual ones such as glossiness, refraction parameters, etc.; therefore, if the material properties of the target interaction model need to be adjusted, the material property setting control can be touched to display the material property adjustment interface; wherein, the displayed material property interface can be specifically shown in Figure 14; further, based on the material property adjustment interface shown in Figure 14, it can be known that the main texture, metallic gloss map and discovery map of the target interaction model can be directly adjusted based on the material property adjustment interface; taking the metallic gloss map as an example, if the metallic gloss of the target interaction model needs to be adjusted, the metallic gloss and smoothness of the target interaction model can be directly adjusted; at the same time, through the material property adjustment interface, the model color, main texture map, and normal map of the target interaction model can also be adjusted; for example, if the target interaction model is a strawberry model, the concavity of the model surface of the strawberry model can be adjusted through the discovery map, and then the strawberry seeds can be placed based on the adjusted model surface.

[0234] Furthermore, the sound properties of the target interaction model in the newly generated scene can be adjusted in the following manner: in response to a touch operation on the sound setting interactive control, a sound adjustment interface corresponding to the sound properties is displayed; in response to an input operation on the sound adjustment interface, the volume of the audio data is adjusted. That is, in actual application, if the sound properties of the target interaction model need to be adjusted, the sound setting control can be clicked to display the sound property setting interface; wherein, the sound property setting interface can be specifically shown in FIG15; at the same time, based on the sound property setting interface shown in FIG15, it can be known that the playback mode and volume of the audio data can be adjusted directly based on the sound property setting interface.

[0235] Secondly, it is also necessary to determine the number of viewpoints of the target resource scene based on the target device parameters in the newly generated scene; specifically, this can be achieved in the following ways: first, based on the target device parameters in the newly generated scene, determine the device attribute information of the target display device corresponding to the target device parameters; secondly, based on the device attribute information, determine the number of viewpoints required for the target display device to display the target resource scene. That is, in actual application, different models of target display devices can support different numbers of viewpoints; for example, some models of display devices can support 2 viewpoints, some models of display devices can support 9 viewpoints, and some models of devices can support 18 viewpoints; when determining the corresponding number of viewpoints, it can be determined directly based on the device attribute information of the target display device.

[0236] In step S130, lens parameters of a virtual lens group corresponding to the target resource scene are configured according to the number of viewpoints, and the virtual lens group is configured according to the lens parameters.

[0237] In this example embodiment, first, the lens parameters of the virtual lens group corresponding to the target resource scene are configured based on the number of viewpoints. The virtual lens group described herein is composed of multiple virtual lenses, which can also be referred to as a virtual camera. In the method for processing naked-eye 3D resources described in this example embodiment, the number of virtual lenses included in the virtual lens group is determined based on the number of viewpoints. For example, if the number of viewpoints is 3, the virtual lens group can be composed of 3 virtual lenses. For another example, if the number of viewpoints is 9, the virtual lens group can be composed of 9 virtual lenses. Furthermore, the lens parameters of the virtual lens group described herein include not only the number of lenses in the virtual lens group, but also the lens spacing between each virtual lens in the virtual lens group, the distance difference between the virtual lens group and the zero plane, and so on.

[0238] It should be noted that these lens parameters are pre-adjusted. For example, when the number of viewpoints is 9, the lens spacing between the 9 virtual lenses in the virtual lens group and the distance difference between the virtual lens group and the zero plane are all pre-adjusted. Of course, in order to obtain the zero plane, it is first necessary to determine the zero point position. Furthermore, in order to obtain the zero point position of the target resource scene, it is first necessary to determine the zero point. The zero point of the target resource scene recorded here is the intersection of the lens orientations of the virtual lenses in the virtual lens group. At the same time, the zero point position can be determined by the original coordinate position (0,0,0) of the virtual engine, or it can be determined based on the intersection position of the lens orientations of the virtual lenses. Based on this, the specific determination process of the zero point position can be implemented in the following two ways: the first implementation method is to determine the original coordinate position of the three-dimensional coordinates where the resource generation engine is located, and determine the original zero point position based on the original coordinate position; adjust the original zero point position to obtain the zero point position of the target resource scene. The adjustment of the original zero point position can include but is not limited to moving forward and backward, moving left and right, and moving up and down. The second implementation method is: based on the lens orientations of the virtual lenses in the virtual lens group, the lens orientation intersection of the virtual lenses is calculated, and based on the lens orientation intersection, the zero point position of the target resource scene is determined. That is, since the zero point position is the intersection position of the lens orientations, the intersection point of the orientations of each virtual lens can be directly calculated based on the orientations of the virtual lenses in the virtual lens group, and the zero point position can be obtained based on the intersection position of the intersection points; of course, in the process of calculating the lens orientation intersection point, the lens parameters of each virtual lens in the virtual lens group can also be adjusted, for example, the overall camera spacing of the virtual lens can be adjusted, and the front-to-back spacing, the upper-lower spacing, and the left-right spacing of the virtual lens can also be adjusted separately; of course, the field of view (FOV) of the virtual lens can also be adjusted, etc.

[0239] Furthermore, after obtaining the lens parameters, a virtual lens group can be determined based on the lens parameters. Specifically, this can be achieved by: determining the original lens position of each virtual lens in the virtual lens group based on the lens parameters; placing the virtual lens at the original lens position, and adjusting the lens parameters of the virtual lens at the original lens position to obtain the virtual lens group based on the adjusted virtual lens parameters. That is, in actual application, the original lens position can be directly determined based on the lens spacing, zero point position, and the distance difference between the zero plane and the virtual lens group in the lens parameters, and the virtual lenses can be arranged and placed in sequence based on the original lens position. Furthermore, after the arrangement is completed, the lens parameters of the virtual lenses need to be adjusted. The lens parameter adjustment can include adjusting the lens spacing, lens posture information, lens angle information, original lens position, etc. The obtained virtual lens group can be specifically shown in Figure 16.

[0240] In an example embodiment, adjusting the lens parameters of the virtual lens at the original lens position can be achieved in the following manner: first, in response to a touch operation on the naked eye setting interactive control, a naked eye parameter setting interface is displayed; second, in response to an input operation in the naked eye parameter setting interface, the lens spacing and / or lens posture information and / or lens viewing angle information of the virtual lens at the original lens position is adjusted; and / or the original lens position of the virtual lens is adjusted. Specifically, in actual application, if the lens parameters of the virtual lens need to be adjusted, the naked eye setting control can be used to display the naked eye parameter setting interface; then, click the camera setting control in the naked eye parameter setting interface to display the lens parameter setting interface; wherein, the lens parameter setting interface can be specifically shown in Figure 17; based on the lens parameter setting interface shown in Figure 17, it can be seen that the overall camera spacing of the virtual lens can be set directly based on the lens parameter setting interface, or the front-to-back camera spacing, the upper-lower camera spacing, and the left-right camera spacing of the virtual lens can be set separately; of course, the field of view (FOV) of the virtual lens can be set through advanced setting parameters (wherein the field of view of each virtual lens in the virtual lens group is the same); and, the larger the spacing between the virtual lenses in the virtual lens group, the stronger the off-screen effect of the target interaction model when it is displayed.

[0241] It should be noted here that, in theory, all parameters can be adjusted manually when adjusting lens parameters; however, in actual application, in order to improve the efficiency of generating naked-eye 3D resources, generally, only the left and right spacing of the camera is adjusted to achieve a better screen effect.

[0242] It's important to note that when adjusting the lens parameters of a virtual lens, you can also adjust the target device parameters of the target display device. However, when adjusting the target device parameters, you can only adjust the device interleaving parameters; you can't adjust the device type. This is because the number of viewpoints and the virtual lens group have already been determined. Adjusting the device type requires adjusting the number of viewpoints. However, since the number of viewpoints is already fixed, the device type cannot be adjusted.

[0243] In an example embodiment, the specific principle example diagram of the field of view angle of the virtual lens recorded here can be referred to as shown in Figure 18; at the same time, the field of view angle of the virtual lens recorded here can be used to adjust the viewport size of the virtual lens; in actual application, the viewport size of the virtual lens can affect the display size of the target interaction model captured by the virtual lens on the display screen of the target display device; wherein, the smaller the field of view angle of the virtual lens, the greater the display effect of the target interaction model captured by the virtual lens on the display screen; conversely, the larger the field of view angle of the virtual lens, the smaller the display effect of the target interaction model captured by the virtual lens on the display screen; that is, the size of the field of view angle is inversely proportional to the display size of the target interaction model on the display screen.

[0244] In step S140 , a naked-eye 3D resource corresponding to the target interaction model is generated based on the target resource scene, the virtual lens group, and the zero point position.

[0245] Specifically, as shown in FIG19 , generating a naked-eye 3D resource corresponding to the target interaction model based on the target resource scene, the virtual lens group, and the zero point position may include the following steps:

[0246] Step S1910: Determine the zero plane position according to the zero point position, and adjust the zero plane position.

[0247] Specifically, the zero plane recorded here can be used as the dividing point between the screen exit and screen entry of multi-view naked-eye 3D; in actual application, after the zero point position is determined, the position of the zero plane can be determined with the zero point position as the center point; of course, after the position of the zero plane is determined, the position of the zero plane can also be adjusted; among them, the position adjustment of the zero plane can be achieved through the lens parameter setting interface shown in Figure 17; by adjusting the front and back positions of the zero plane, the distance between the virtual lens group and the zero plane can be adjusted, thereby achieving the purpose of adjusting the screen exit effect of the target interaction model.

[0248] Step S1920: determining a stereoscopic display area and a plane display area of ​​the target interaction model in the target resource scene according to the adjusted zero plane position.

[0249] Specifically, the stereoscopic display area recorded here is also the off-screen area, and the planar display area is also the on-screen area; among them, in actual application, the off-screen area is the effective area between the zero plane and the virtual camera group, and the on-screen area is the effective area after the zero plane.

[0250] Step S1930: determining a model placement area of ​​the target interaction model in the target resource scene according to the stereoscopic display area and the plane display area, and adjusting a target model position of the target interaction model based on the model placement area.

[0251] Specifically, in the actual application process, in order to allow users to easily produce the best naked-eye 3D effect, the model placement area can be determined through the top view auxiliary function; wherein, the implementation of the top view auxiliary function depends on the stereoscopic display area and the plane display area; wherein, the scene example diagram obtained after adjusting the target model position of the target interaction model can be referred to as shown in Figure 20; in the example diagram shown in Figure 20, the model placement area can be referred to as shown in 2001; in the model placement area shown in 2001, the front boundary of the model placement area is the maximum value of the naked-eye 3D off-screen area, and the rear boundary of the model placement area is the position of the zero plane, and the position of the model placement area moves as the position of the zero plane moves.

[0252] Step S1940 , publishing the target resource scene after position adjustment and the virtual lens group to obtain naked-eye 3D resources corresponding to the target interaction model.

[0253] Specifically, publishing the adjusted target resource scene and the virtual lens group to obtain the naked-eye 3D resource corresponding to the target interaction model can be achieved by: displaying a resource publishing interface in response to a touch operation on a resource publishing interactive control; determining a resource publishing type in response to a touch operation on the resource publishing interface; and publishing the adjusted target resource scene and the virtual lens group based on the resource publishing type to obtain the naked-eye 3D resource corresponding to the target interaction model. The resource publishing types described herein may include program resource categories, video resource categories, and sequence frame resource categories. That is, in actual application, if it is necessary to execute a naked-eye 3D resource publishing operation, the publishing control can be clicked to display the resource publishing interface. The resource publishing interface can be specifically shown in FIG21. At the same time, based on the resource publishing interface shown in FIG21, it can be seen that when publishing a resource, it can be published as a naked-eye 3D program or as a naked-eye 3D video. In actual application, the corresponding publishing type can be selected according to actual needs to publish and obtain the corresponding naked-eye 3D resource.

[0254] In an exemplary embodiment, when the resource publishing type is a program resource category, based on the resource publishing type, the target resource scene after position adjustment and the virtual lens group are published to obtain a naked-eye 3D resource corresponding to the target interaction model. This can be achieved by: displaying a resource publishing interface corresponding to the program resource category; determining a save path for the naked-eye 3D resource in response to an input operation on the resource publishing interface corresponding to the program resource category; and packaging the target resource scene after position adjustment and the virtual lens group to obtain a naked-eye 3D resource with the program resource category. The resource publishing interface corresponding to the program resource category described herein can continue to refer to FIG. 21 . Among them, the naked-eye 3D resources with program resource categories recorded here refer to the data and resources of a project packaged together and published as a naked-eye 3D program that can run independently; at the same time, the published naked-eye 3D program, like a parser, parses the data and restores it to a generated scene at runtime; for example, it can load scene library scenes and models at runtime, and restore animation, lighting, sound, material and other properties; and the published naked-eye 3D program supports the naked-eye 3D imaging module mentioned above, and when running on a naked-eye 3D screen, it can adjust the effect in real time according to the actual display situation. Under this premise, after touching the release control, the system can automatically package the target resource scene after position adjustment and the virtual lens group, and then obtain the naked-eye 3D resources with program resource categories.

[0255] In an example embodiment, when the resource publishing type is a video resource category and / or a sequence frame resource category, based on the resource publishing type, the target resource scene after position adjustment and the virtual lens group are published to obtain naked-eye 3D resources corresponding to the target interaction model. This can be achieved in the following manner: displaying a resource parameter adjustment interface corresponding to the video resource category and / or sequence frame resource category; determining the target resource parameters corresponding to the video resource category and / or sequence frame resource category in response to input operations on the resource parameter adjustment interface; saving the target resource parameters, the target resource scene after position adjustment, and the virtual lens group to obtain naked-eye 3D resources with video resource categories and / or sequence frame resource categories. That is, if it is necessary to publish a video resource category or a sequence frame resource category, the publish video control in the resource publishing interface can be clicked to display the resource parameter adjustment interface corresponding to the video resource category and / or the sequence frame resource category; wherein, the resource parameter adjustment interface corresponding to the video resource category and / or the sequence frame resource category can be specifically shown in FIG22; based on the resource parameter adjustment interface shown in FIG22, it can be known that the target resource parameters that need to be adjusted may include but are not limited to rendering style parameters, resolution parameters, and output type parameters, etc.; at the same time, due to the existence of different rendering styles, resolutions, and output types, therefore, the above-described target resource parameters, the target resource scene after position adjustment, and the virtual lens group are saved to obtain naked-eye 3D resources with video resource categories and / or sequence frame resource categories, which can be achieved in the following manner:

[0256] First, a target rendering style of the naked-eye 3D resource is determined according to the rendering style parameters in the target resource parameters; secondly, a target screen type of the output screen is determined based on the input type parameters in the target resource parameters, and a target resolution of the output screen is determined based on the resolution parameters in the target resource parameters; then, in response to a touch operation on a third preset interactive control in the resource parameter adjustment interface, a naked-eye 3D resource having a target rendering style and a target resolution, and having a video resource category and / or a sequence frame resource category is output; wherein the target rendering style recorded here includes a multi-viewpoint stitching mode or a rendering result mode, and the target screen type includes a video screen type or a sequence frame screen type.

[0257] In an exemplary embodiment, in response to a touch operation on the third preset interactive control in the resource parameter adjustment interface, outputting a naked-eye 3D resource having a target rendering style and a target resolution, and having a video resource category and / or a sequence frame resource category can be achieved in the following manner: in response to a touch operation on the third preset interactive control in the resource parameter adjustment interface, outputting a naked-eye 3D resource having a multi-view stitching mode and a target resolution, and having a video picture type; or in response to a touch operation on the third preset interactive control in the resource parameter adjustment interface, outputting a naked-eye 3D resource having a rendering result mode and a target resolution, and having a video picture type; or in response to a touch operation on the third preset interactive control in the resource parameter adjustment interface, outputting a naked-eye 3D resource having a multi-view stitching mode and a target resolution, and having a sequence frame picture type; or in response to a touch operation on the third preset interactive control in the resource parameter adjustment interface, outputting a naked-eye 3D resource having a rendering result mode and a target resolution, and having a sequence frame picture type.

[0258] Below, the specific generation process of naked-eye 3D resources with video resource category and / or sequence frame resource category will be further explained and illustrated in conjunction with Figure 22. Specifically, in the actual application process, the implementation principle of the release process of naked-eye 3D resources with video resource category is roughly the same as the implementation principle of the release process of naked-eye 3D resources with sequence frame resource category. The difference is that the naked-eye 3D resources with sequence frame resource category save each frame image in the naked-eye 3D resources with video resource category; at the same time, in the process of releasing naked-eye 3D resources with video resource category and / or sequence frame resource category, the output format may include multi-viewpoint mode and rendering result mode; wherein, multi-viewpoint mode refers to the scene picture captured by each virtual lens in the virtual lens group, according to The arrangement positions of the virtual lenses in the virtual lens group are arranged in sequence on a picture; the obtained multi-viewpoint video picture can be shown in Figure 23; the rendering result mode refers to synthesizing the above multi-viewpoint pictures into one picture through the image interlacing algorithm; the obtained synthetic picture can be specifically shown in Figure 24; at the same time, in the synthetic picture shown in Figure 24, the blurred picture is the picture that can be displayed in stereoscopic effect on the naked eye 3D screen; further, the image interlacing algorithm recorded here refers to the process of synthesizing the picture contents of multiple cameras into one picture through the corresponding algorithm, which can finally be displayed on the naked eye 3D screen.

[0259] At this point, the specific process of generating the naked-eye 3D resource described in the exemplary embodiments of the present disclosure has been fully realized. The specific process of displaying the generated naked-eye 3D resource on the target display device will be explained and illustrated below with reference to the accompanying drawings.

[0260] In an exemplary embodiment, the display of naked-eye 3D resources can be achieved in the following manner: outputting naked-eye 3D resources with a program resource category to a target display device, and displaying the naked-eye 3D resources with a program resource category through the target display device; and / or outputting naked-eye 3D resources with a video resource category and / or a sequence frame resource category to a target display device, and displaying the naked-eye 3D resources with a video resource category and / or a sequence frame resource category through the target display device. That is, based on the above-mentioned records, it can be known that the output naked-eye 3D resources may include naked-eye 3D resources with program categories, multi-view naked-eye 3D video resources, rendering result video resources, multi-view naked-eye 3D sequence frames, and rendering result sequence frames; based on the different forms of naked-eye 3D resources published, for target display devices with naked-eye 3D screens and conference all-in-one machines with high configuration, the published programs and multi-view naked-eye 3D video resources and multi-view naked-eye 3D sequence frames can be displayed; further, for low-configuration all-in-one machines, such as photo frames, only rendering result videos or sequential rendering result frames can be published; during playback, the naked-eye 3D photo frame has a built-in player that can play rendering result videos or pictures produced according to the system.

[0261] Of course, since the target device parameters of the target display device are set in the process of generating naked-eye 3D resources, the target display device can automatically adapt to the received naked-eye 3D resources when displaying the naked-eye 3D resources. Of course, the adjustment interface of the naked-eye 3D imaging component can also be called to adjust the display effect, thereby achieving the purpose of further matching the display screen of the target display device; however, only the screen interlacing parameters can be changed here, and the device type cannot be modified; for multi-view naked-eye 3D video resources and multi-view naked-eye 3D sequence frames, it is also necessary to call the image interlacing algorithm for processing and display the obtained results; further, when playing multi-view naked-eye 3D video resources and multi-view naked-eye 3D sequence frames, the specific playback process can also be realized by calling the naked-eye 3D video player.

[0262] In an example embodiment, during actual application, when the naked-eye 3D resource displayed by the target display device is a naked-eye 3D resource with a program resource category, intelligent interaction can be performed on the displayed naked-eye 3D resource; the reason for the need for intelligent interaction is that the naked-eye 3D screen of the target display device is a large-size wide screen. In order to view the displayed naked-eye 3D resource, the viewing position is at a certain distance from the target display device; therefore, in a long-distance viewing scenario, the target interaction model cannot be directly operated through a keyboard or mouse. In order to solve this technical problem and improve the interactive experience, a naked-eye 3D resource with a program resource category is introduced. That is, when the naked-eye 3D resource displayed by the target display device is a naked-eye 3D resource with a program resource category, human-computer interaction instructions can also be executed on the displayed target interaction model after the target display device displays the naked-eye 3D resource with a program resource category. Specifically, it can be achieved in the following way: in response to the current interaction gesture input, hand state information and finger movement direction are obtained, and based on the hand state information and finger movement direction, the current interaction instruction that needs to be executed by the target interaction model in the naked eye 3D resource is determined; the target interaction model in the naked eye 3D resource is controlled to execute the current interaction instruction, the target interaction model is switched from the original model state to the target model state corresponding to the current interaction instruction, and the model animation generated by executing the current interaction instruction is displayed; wherein, the current interaction gesture recorded here may include but is not limited to human body interaction gestures, somatosensory controller interaction gestures, external device interaction gestures, and handle interaction gestures, etc.

[0263] In an example embodiment, naked-eye 3D resources with a program resource category can support camera-based gesture algorithm interaction, Leapmotion (body sensing controller) interaction, Kinect (external device) interaction, 3Dof (degree of free) Bluetooth handle interaction, and 6Dof Bluetooth handle interaction; during actual interaction, if there is a corresponding effect animation in the target interaction model in the program, then during intelligent interaction, the effect animation will stop playing and automatically place the position of the target interaction model to the initial position at the time of import, and then execute the corresponding interaction instruction based on the scene; at the same time, when the interaction instruction is completed, the animation effect is restored.

[0264] In an example embodiment, the specific implementation principle of camera-based gesture algorithm interaction, Leapmotion interaction, and Kinect interaction is: through gesture recognition algorithm and Leapmotion, the state and movement direction of the hand are obtained to control the movement and rotation of the object; wherein, the specific operation rules may include but are not limited to: if the recognized gesture is a palm state and the movement direction of the palm is up, down, left and right, then the response operation instruction that the target interaction model needs to execute is: the target interaction model gradually shifts to a certain position in an up, down, left and right manner within a certain period of time; further, when the target interaction model does not receive other operation instructions after a preset time interval, it will gradually reset according to a certain period of time; at the same time, if the recognized gesture is a fist state and the fist is rotated, the target interaction model will execute the rotation operation instruction according to the rotation angle of the fist.

[0265] In an example embodiment, the specific implementation principle of the above-mentioned 3Dof Bluetooth controller interaction and 6Dof Bluetooth controller interaction is: pressing and holding the OK button of the controller can trigger the control of the target interaction model, and releasing it will lose the model of the target interaction model and return to the initial state when imported; further, after pressing and holding the OK button, rotating the 3Dof Bluetooth controller can control the rotation of the model; at the same time, for the 6Dof controller, the target interaction model follows the movement and rotation of the controller at the same time; and, when pressing and holding the Home button of the controller, the model returns to the initial state when imported, triggering the explosion interaction operation, and pressing the Home button again will restore the explosion effect to its original position.

[0266] In an example embodiment, the explosion interaction operation recorded above refers to the movement of the various parts of the object in a certain direction when the palm is clenched and then opened, and the object gradually splits apart. From opening to clenching the fist, the various parts of the object gradually move back to their original state; at the same time, in order to switch between ordinary palm translation and fist operations, it is necessary to clench and open the fist quickly more than 3 times in succession, and turn the explosion interaction operation on and off to reduce the direct false triggering of each operation; in actual application, the explosion direction angle of the object can choose the free direction angle or the XYZ axis direction angle; the direction angle recorded here is the local angle of the object submodule relative to the entire object. Taking Unity's left-hand coordinate system as an example, the left-hand coordinate system refers to In the spatial rectangular coordinate system, let the left thumb point to the positive direction of the x-axis and the index finger point to the positive direction of the y-axis. If the middle finger can point to the positive direction of the z-axis, then this coordinate system is called a left-hand rectangular coordinate system, otherwise it is a right-hand rectangular coordinate system. The specific scene example diagram can be referred to as shown in Figure 25. Furthermore, for the free direction angle, it refers to the single component of the target interaction model, which moves along its own forward direction. The specific scene example diagram obtained can be referred to as shown in Figure 26. For the XYZ axis direction angle, the object can be selected according to a single X, Y, and Z direction, which means that the sub-module of the object is expanded to both sides along the fixed axis of the object with the center point of the object as the center. Among them, taking the expansion along the Z axis as an example, the obtained scene example diagram can be referred to as shown in Figure 27.

[0267] Under the premise of the specific application scenario described above, controlling the target interaction model in the naked-eye 3D resource to execute the current interaction instruction can be achieved in the following ways: controlling the target interaction model in the naked-eye 3D resource to execute an up-down movement instruction and / or a left-right movement instruction; and / or controlling the target interaction model in the naked-eye 3D resource to execute a rotation instruction; and / or controlling the target interaction model in the naked-eye 3D resource to execute an explosion instruction. In other words, when performing intelligent interaction with the target interaction model in the naked-eye 3D resource, the target interaction model can be moved up-down, left-right, or rotated, and the various components of the target interaction model can be obtained based on the explosion operation.

[0268] Furthermore, the target interaction model in the naked eye 3D resource is controlled to execute the explosion instruction, which can be achieved in the following way: the model composition submodule of the target interaction model in the naked eye 3D resource is controlled to move in a preset direction and a preset angle to achieve the explosion effect; wherein, the preset direction includes the free movement direction or the coordinate axis movement direction, and the preset angle includes the local angle of the model composition submodule relative to the target interaction model. In other words, the model composition submodule of the target interaction model can be controlled to execute the model dispersion instruction at different scattering angles. Finally, after the target interaction model has executed the corresponding interaction instruction, it is necessary to control the target interaction model to be restored from the target model state to the original model state at an interval of a preset time, and then execute other interaction instructions based on the original model state.

[0269] In an example embodiment, when performing interactive operations through a camera-based gesture algorithm, it can be achieved in the following manner: first, a gesture depth map of the gesture to be detected is obtained, and based on the gesture depth map, the current point cloud data of the gesture to be detected is calculated; then, based on the current point cloud data, a target geometric gesture is matched for the gesture to be detected in a preset gesture search space; finally, when it is determined that a target geometric gesture corresponding to the gesture to be detected exists in the preset gesture search space, an interactive operation instruction corresponding to the target geometric gesture is obtained, and the target interaction model is controlled to execute the corresponding interactive operation instruction.

[0270] In an example embodiment, obtaining a gesture depth map of a gesture to be detected and calculating the current point cloud data of the gesture to be detected based on the gesture depth map can be achieved in the following manner: first, the gesture depth map of the gesture to be detected can be acquired by an image acquisition device; wherein, the image acquisition device can be a depth image acquisition device, which can be embedded in the target display device or can be independently set, and this example does not impose any special restrictions on this; further, after the gesture depth map is acquired, the gesture depth map can be input into the algorithm (for example, it can be MediaPipe), and the algorithm can output the 3D positions of all key points in the gesture depth map, and obtain the current point cloud data according to the 3D position of each key point; wherein, the hand key points can also be understood as the joint points of the hand skeleton, which are usually described by 21 3D key points (see Figure 28 for details).

[0271] In an example embodiment, matching the target geometric gesture for the gesture to be detected in a preset gesture search space based on the current point cloud data can be achieved in the following manner: first, based on a preset image processing model, calculating the distance difference between the three-dimensional point coordinates in the current point cloud data and the model surface of the standard geometric gesture included in the preset gesture search space; secondly, taking the minimum value from the distance differences, and taking the standard geometric gesture corresponding to the minimum value as the target geometric gesture. That is, in the process of matching the target geometric gesture, it can be achieved by calculating the distance difference between the three-dimensional point coordinates in the current point cloud data and the model surface of the standard geometric gesture; wherein, the specific generation of the standard geometric gesture can include: first, generating a series of standard geometric gesture models of the hand through the hand pose (pose can refer to the hand posture parameters or node positions), and then establishing a search space based on the generated standard geometric gesture models; wherein, in the process of generating the standard geometric gesture model, it can be achieved through linear blend skinning (skeletal skinning animation algorithm), and its specific implementation principle is: covering the hand skeleton with a layer of skin, and letting the skin change with the movement of the skeleton, which is mostly used in the animation field; in the specific generation process, the pose can be first converted into the corresponding mesh, and then further converted into a smooth surface model, and then the standard geometric gesture model is obtained; and, in the generation process, the pose can be used as an independent variable, the standard geometric gesture model can be calculated through the pose, and the annotated geometric gesture model is one-to-one corresponding to the pose.

[0272] Furthermore, after obtaining the standard geometric gesture, the specific matching process can be implemented; in the specific matching process, the standard geometric gesture can be divided into the current frame standard geometric gesture, the previous frame standard geometric gesture corresponding to the current frame standard geometric gesture, and the next frame standard geometric gesture corresponding to the current frame standard geometric gesture. Specifically, based on a preset image processing model, calculating the distance difference between the three-dimensional point coordinates in the current point cloud data and the model surface of the standard geometric gesture included in the preset gesture search space can include the following steps: initializing the image processing model to be trained to obtain the parameters to be optimized included in the image processing model to be trained; inputting the current point cloud data of the gesture depth map and the hand posture parameters of the previous frame standard geometric gesture into the image processing model to be trained to obtain the predicted distance between the gesture depth map and the previous frame standard geometric gesture; constructing a loss function based on the actual distance and predicted distance between the gesture depth map and the previous frame standard geometric gesture, and optimizing the parameters to be optimized based on the preset optimization algorithm and the loss function; updating the image processing model to be trained based on the optimized parameters to obtain the trained image processing model, and using the trained image processing model to calculate the distance difference between the current frame standard geometric gesture and / or the next frame standard geometric gesture and the deep gesture depth map.

[0273] Furthermore, the preset optimization algorithm includes a particle swarm optimization algorithm and / or a closest point optimization algorithm. Furthermore, when the preset optimization algorithm is a particle swarm optimization algorithm, optimizing the parameters to be optimized according to the preset optimization algorithm and the loss function can be achieved in the following manner: first, generating a particle population according to the parameters to be optimized, and randomly setting the starting position and starting speed of each particle in the particle population; wherein each parameter to be optimized corresponds to a particle; second, calculating the fitness of each particle according to the loss function, and comparing the fitness of each particle at the current position and its fitness at the best position; if the fitness of the particle at the current position is better than its fitness at the best position, then taking the current position as the individual best position; otherwise, leaving it unchanged; then, comparing the fitness of each particle at the current position and the fitness of the population best position; if the fitness of the particle at the current position is better than the fitness of the population best position, then taking the current position as the global best position; otherwise, leaving it unchanged; finally, updating the speed and position of the particles in the particle population according to the individual best position, the global best position and the particle speed to achieve optimization of the parameters to be optimized.

[0274] In an exemplary embodiment, the optimization steps of the particle swarm algorithm are as follows: First, the starting position x of the particle is randomly set. i and speed vi , set the population size and parameters to be adjusted based on the problem to be solved; secondly, calculate the fitness of each particle according to the fitness function formula, and compare the fitness of each particle's current position with the fitness value of its best position pbest. If it is better, the current position is used as pbest; otherwise, pbest remains unchanged; then, compare the fitness of each particle's current position with the fitness value of the population's best position pbest. If it is better, it is used as the current global best position pbest; finally, update the particle's speed and position according to the formula; of course, if the algorithm's preset termination condition is not met, continue to calculate the fitness of each particle; if the termination condition is met, end the loop and output the optimal position information. It should be noted here that using the particle swarm optimization algorithm to optimize the parameters of the image processing model can greatly shorten network training time and solve the local optimality problem of the traditional backpropagation (BP) optimization algorithm.

[0275] It is important to further explain that during the training of the image processing model, the input of the training image processing model is the gesture depth map and the pose of the standard geometric gesture. The output is the predicted distance between the gesture depth map and the standard geometric gesture. A loss function can then be constructed based on the predicted distance and the actual distance. The smaller the loss function, the more similar the input gesture depth map and the standard geometric gesture are. Furthermore, during the matching process, the pose with the smallest predicted distance in the search space is the desired pose (i.e., the target geometric gesture). However, because the search space cannot be expressed in an analytical form, the minimum distance difference cannot be found in one go. Therefore, during the training process, optimization based on the corresponding optimization algorithm is required to calculate the optimal solution through continuous iteration. Furthermore, since iterative numerical solutions often have high initialization requirements, if the initialization is not good, it will take a long time for the iteration to converge, and it may not converge to the global minimum (because the loss function is non-convex). Therefore, when implementing the algorithm, the pose of the standard geometric gesture of the previous frame is usually used to initialize the standard geometric gesture of the current frame to implement the specific calculation process.

[0276] At this point, the processing method of naked-eye 3D resources in the exemplary embodiment of the present disclosure has been fully realized. Based on the aforementioned recorded content, it can be known that the processing method of naked-eye 3D resources recorded in the exemplary embodiment of the present disclosure can, on the one hand, reduce the difficulty of naked-eye 3D content production and improve the efficiency of naked-eye 3D content generation; on the other hand, it can support naked-eye 3D screens with a variety of different viewpoints such as 2, 9, 18, 24, and 49, and it can also adjust and modify naked-eye 3D parameters to adapt to more naked-eye 3D screens, and the supported devices can be arbitrarily expanded; on the other hand, the output naked-eye 3D content can adjust parameters on the same type of screens with different parameters; further, the visualized naked-eye 3D effect adjustment process, model operation, and attribute editing process make the operation more intuitive and simple.

[0277] Furthermore, after obtaining the glasses-free 3D resource, the corresponding glasses-free 3D resource can be applied. Specifically, the glasses-free 3D resource obtained based on the glasses-free 3D resource processing method described in the exemplary embodiments of this disclosure can be applied in e-commerce scenarios, teaching scenarios, new product display scenarios, new product launch scenarios, and so on. In actual application, the glasses-free 3D resource can be configured with the corresponding number of viewpoints and corresponding lens parameters based on the actual needs of the requesting party.

[0278] In an application scenario, such as displaying corresponding virtual items in an e-commerce scenario, this can be achieved in the following manner: in response to a touch operation acting on the current display interface, determining the product to be displayed; obtaining a naked-eye 3D resource corresponding to the product to be displayed; wherein the naked-eye 3D resource is generated by the naked-eye 3D resource processing method described in this application; displaying the naked-eye 3D resource corresponding to the product to be displayed, and interacting with the displayed product to display the internal component structure of the displayed product. That is to say, in an e-commerce scenario, if a user clicks on a product and the terminal device where the client is located can support naked-eye 3D display, the product can be displayed in naked-eye 3D; at the same time, if it is necessary to display the components or internal structure of the product, gesture interaction can be performed to disperse the product based on the specific components, thereby facilitating the user to view the internal structure of the product in detail, thereby achieving the purpose of improving the accuracy of the displayed product, so that the user can purchase the product according to actual needs.

[0279] In one application scenario, for example, displaying corresponding teaching props in a teaching scenario can be achieved by: determining the teaching props to be displayed, and obtaining the naked-eye 3D resources corresponding to the teaching props to be displayed; wherein the naked-eye 3D resources are generated by the naked-eye 3D resource processing method described in this application; displaying the naked-eye 3D resources corresponding to the teaching props to be displayed, and interacting with the displayed teaching props to display the internal structure of the teaching props. That is, in a teaching scenario, if a certain teaching prop needs to be displayed, the naked-eye 3D resources corresponding to the teaching props can be obtained and displayed accordingly; at the same time, if the internal structure needs to be displayed, gesture interaction or interaction with other external devices can be performed; at the same time, when interacting, taking the teaching prop as a blackboard eraser as an example, the blackboard eraser can be split based on its specific structure, and then each component can be displayed separately.

[0280] The following are embodiments of the apparatus disclosed herein, which can be used to implement the method embodiments disclosed herein. For details not disclosed in the apparatus embodiments disclosed herein, please refer to the method embodiments disclosed herein.

[0281] The exemplary embodiments of the present disclosure also provide a device for processing naked-eye 3D resources. Specifically, as shown in FIG29 , the device for processing naked-eye 3D resources may include an original resource scene generation module 2910, a viewpoint number determination module 2920, a virtual lens group configuration module 2930, and a naked-eye 3D resource generation module 2940. Specifically:

[0282] The original resource scene generation module 2910 may be used to create a new generated scene corresponding to the target interaction model, and load the target interaction model into the new generated scene to obtain the original resource scene;

[0283] The viewpoint number determination module 2920 may be configured to call a preset resource library to adjust the original resource scene to obtain a target resource scene, and determine the viewpoint number of the target resource scene based on the target device parameters in the newly generated scene;

[0284] A virtual lens group configuration module 2930 may be configured to configure lens parameters of a virtual lens group corresponding to the target resource scene according to the number of viewpoints, and configure the virtual lens group according to the lens parameters;

[0285] The naked-eye 3D resource generation module 2940 may be configured to generate a naked-eye 3D resource corresponding to the target interaction model based on the target resource scene, the virtual lens group, and the zero point position.

[0286] In an exemplary embodiment of the present disclosure, creating a new generation scene corresponding to the target interaction model includes: displaying a project creation sub-interface in response to a touch operation on a first preset interactive control on a display interface of a resource creation terminal; determining target device parameters and naked-eye 3D interleaving parameters of a target display device that displays naked-eye 3D resources corresponding to the target interaction model in response to an input operation on the project creation sub-interface; and creating a new generation scene corresponding to the target interaction model in response to a touch operation on a second preset interactive control in the project creation sub-interface.

[0287] In an exemplary embodiment of the present disclosure, the target interaction model is loaded into the newly generated scene to obtain the original resource scene, including: obtaining the target interaction model from a preset model library according to the target model name of the target interaction model; and / or importing the target interaction model from an external file according to the target model name of the target interaction model; and adaptively adjusting the model size of the target interaction model in the newly generated scene to obtain the original resource scene.

[0288] In an exemplary embodiment of the present disclosure, the model size of the target interaction model in the newly generated scene is adaptively adjusted to obtain the original resource scene, including: constructing a first rectangle according to the newly generated scene, and constructing a second rectangle according to the target interaction model; calculating the model scaling coefficient of the target interaction model in the newly generated scene based on the first rectangle and the second rectangle; and adaptively adjusting the model size of the target interaction model based on the model scaling coefficient to obtain the original resource scene.

[0289] In an exemplary embodiment of the present disclosure, constructing a first rectangle based on the newly generated scene includes: displaying the newly generated scene on the display interface of the resource creation terminal; taking the center point of the display interface as the center point of the first rectangle, and determining the first rectangle length and the first rectangle width of the first rectangle based on the interface length and interface width occupied by the newly generated scene on the display interface; constructing the first rectangle based on the center point, the first rectangle length and the first rectangle width of the first rectangle.

[0290] In an exemplary embodiment of the present disclosure, constructing a second rectangle according to the target interaction model includes: obtaining pixel coordinates of pixel points in the target interaction model, and obtaining the maximum horizontal coordinate value, maximum vertical coordinate value, minimum horizontal coordinate value and minimum vertical coordinate value in the pixel coordinates; determining the height of the second rectangle according to the maximum horizontal coordinate value and the minimum horizontal coordinate value, and determining the length of the second rectangle according to the maximum vertical coordinate value and the minimum vertical coordinate value; taking the center point of the target interaction model as the center point of the second rectangle, and constructing the second rectangle according to the center point of the second rectangle, the height of the second rectangle and the length of the second rectangle.

[0291] In an exemplary embodiment of the present disclosure, the model scaling coefficient of the target interaction model in the newly generated scene is calculated based on the first rectangle and the second rectangle, including: mapping the first rectangle to the three-dimensional coordinates of the resource generation engine to obtain a rectangle mapping result; calculating a first ratio between the rectangle mapping height and the second rectangle height in the rectangle mapping result, and calculating a second ratio between the rectangle mapping length and the second rectangle length in the rectangle mapping result; based on the first ratio and the second ratio, determining the model scaling coefficient of the target interaction model in the newly generated scene.

[0292] In an exemplary embodiment of the present disclosure, the apparatus for processing naked-eye 3D resources further includes:

[0293] A newly added virtual model loading module may be configured to load the newly added virtual model into the original resource scene in response to a model loading operation, and / or import the newly added virtual model into the original resource scene;

[0294] The model label generation module can be used to generate a model label corresponding to the newly added virtual model and display the model label in the original resource scene.

[0295] In an exemplary embodiment of the present disclosure, the apparatus for processing naked-eye 3D resources further includes:

[0296] The model switching display module can be used to display the newly added virtual model corresponding to the model tag in the original resource scene in response to the touch operation of the model tag, and switch the target interaction model in the original resource scene based on the newly added virtual model.

[0297] In an exemplary embodiment of the present disclosure, the apparatus for processing naked-eye 3D resources further includes:

[0298] A display order adjustment module may be configured to adjust the display order of the model tags in the original resource scene in response to a touch operation on the model tags; and / or

[0299] A mode timing setting interface display module, which can be used to display the mode timing setting interface of the newly added virtual model and / or target interaction model;

[0300] The model display duration determination module can be used to determine the model display duration of the newly added virtual model and / or the target interaction model in response to an input operation on the mode timing setting interface.

[0301] In an exemplary embodiment of the present disclosure, the preset resource library includes at least one of a scene library, a model library, an animation library, a material library, a lighting library, and a sound library.

[0302] In an exemplary embodiment of the present disclosure, a preset resource library is called to adjust the original resource scene to obtain a target resource scene, including: loading the original three-dimensional scene corresponding to the target interaction model from the scene library, and adding the original three-dimensional scene to the newly generated scene; and / or loading the original three-dimensional animation from the animation library, and applying the original three-dimensional animation to the target interaction model; and / or loading the original light from the light library, and adding the original light to the newly generated scene; and / or loading the model material corresponding to the target interaction model from the material library, and applying the model material to the target interaction model; and / or loading the audio data corresponding to the target interaction model from the sound library, and adding the audio data to the newly generated scene; adjusting the model properties and / or animation properties and / or light properties and / or material properties and / or sound properties of the target interaction model in the newly generated scene to obtain the target resource scene.

[0303] In an exemplary embodiment of the present disclosure, the original three-dimensional animation includes procedural animation and / or key-frame animation; wherein, applying the original three-dimensional animation to the target interaction model includes: adding the procedural animation to the target interaction model; and / or mounting the target interaction model under the animation object in the key-frame animation to make the target interaction model a child object of the animation object.

[0304] In an exemplary embodiment of the present disclosure, applying the model material to the target interaction model includes: in response to dragging the model material onto the target interaction model, replacing the original material in the target interaction model based on the model material.

[0305] In an exemplary embodiment of the present disclosure, the model attributes include structural hierarchy attributes and / or position attributes; adjusting the model attributes of the target interaction model includes: displaying a model adjustment interface of the model attributes of the target interaction model in response to a touch operation on the model attribute interaction control; and adjusting the attribute values ​​of the structural hierarchy attributes and / or position attributes of the target interaction model in response to an input operation on the model adjustment interface.

[0306] In an exemplary embodiment of the present disclosure, adjusting the model properties of the target interaction model also includes: adjusting the current model position of the target interaction model in the newly generated scene, and / or rotating the target interaction model in response to a movement event acting on the target interaction model.

[0307] In an exemplary embodiment of the present disclosure, adjusting the animation properties includes: displaying an animation adjustment interface corresponding to the animation properties in response to a touch operation on an animation setting interactive control; adjusting the animation cycle time length and / or animation amplitude in the animation properties in response to an input operation on the animation adjustment interface; and / or adjusting the offset of the animation trajectory in the animation properties in the newly generated scene.

[0308] In an exemplary embodiment of the present disclosure, the original light includes at least one of parallel light, point light source, spotlight and combined light composed of point light source and spotlight; wherein, adjusting the light properties includes: displaying a light adjustment interface corresponding to the light properties in response to a touch operation on the light setting interactive control; and adjusting the light position and / or light intensity and / or light color of the parallel light and / or point light source and / or spotlight and / or combined light in the newly generated scene in response to an input operation on the light adjustment interface.

[0309] In an exemplary embodiment of the present disclosure, the material properties include at least one of model color, texture map, normal map, transparency, glossiness and refraction; wherein, adjusting the material properties includes: displaying a material adjustment interface corresponding to the material properties in response to a touch operation on a material setting interactive control; adjusting the model color and / or texture map and / or normal map and / or transparency and / or glossiness and / or refraction of the target interactive model in response to an input operation on the material adjustment interface.

[0310] In an exemplary embodiment of the present disclosure, adjusting the sound attributes includes: displaying a sound adjustment interface corresponding to the sound attributes in response to a touch operation on a sound setting interactive control; and adjusting the volume of the audio data in response to an input operation on the sound adjustment interface.

[0311] In an exemplary embodiment of the present disclosure, the number of viewpoints of the target resource scene is determined based on the target device parameters in the newly generated scene, including: determining the device attribute information of the target display device corresponding to the target device parameters based on the target device parameters in the newly generated scene; and determining the number of viewpoints required by the target display device when displaying the target resource scene based on the device attribute information.

[0312] In an exemplary embodiment of the present disclosure, determining lens parameters of a virtual lens group corresponding to the target resource scene according to the number of viewpoints includes: determining, according to the number of viewpoints, the number of lenses of the virtual lens group corresponding to the target resource scene, the zero point position of the target resource scene, the lens spacing between each virtual lens in the virtual lens group, and the distance difference between the virtual lens group and the zero plane.

[0313] In an exemplary embodiment of the present disclosure, configuring the virtual lens group according to the lens parameters includes:

[0314] The original lens position of each virtual lens in the virtual lens group is determined according to the lens parameters; the virtual lens is placed at the original lens position, and the lens parameters of the virtual lens at the original lens position are adjusted to obtain the virtual lens group according to the virtual lens after the parameters are adjusted.

[0315] In an exemplary embodiment of the present disclosure, adjusting the lens parameters of the virtual lens at the original lens position includes: displaying a naked eye parameter setting interface in response to a touch operation on a naked eye setting interactive control; adjusting the lens spacing and / or lens posture information and / or lens viewing angle information of the virtual lens at the original lens position in response to an input operation in the naked eye parameter setting interface; and / or adjusting the original lens position of the virtual lens.

[0316] In an exemplary embodiment of the present disclosure, a naked-eye 3D resource corresponding to the target interaction model is generated based on the target resource scene, the virtual lens group and the zero point position, including: determining the zero plane position according to the zero point position, and adjusting the zero plane position; determining the stereoscopic display area and the plane display area of ​​the target interaction model in the target resource scene according to the adjusted zero plane position; determining the model placement area of ​​the target interaction model in the target resource scene according to the stereoscopic display area and the plane display area, and adjusting the target model position of the target interaction model based on the model placement area; publishing the target resource scene and the virtual lens group after position adjustment to obtain the naked-eye 3D resource corresponding to the target interaction model.

[0317] In an exemplary embodiment of the present disclosure, the target resource scene after position adjustment and the virtual lens group are published to obtain naked-eye 3D resources corresponding to the target interaction model, including: displaying a resource publishing interface in response to a touch operation on a resource publishing interaction control; determining a resource publishing type in response to a touch operation on the resource publishing interface; and publishing the target resource scene after position adjustment and the virtual lens group based on the resource publishing type to obtain naked-eye 3D resources corresponding to the target interaction model.

[0318] In an exemplary embodiment of the present disclosure, the resource publishing type includes at least one of a program resource category, a video resource category, and a sequence frame resource category.

[0319] In an exemplary embodiment of the present disclosure, when the resource publishing type is a program resource category, the target resource scene after position adjustment and the virtual lens group are published based on the resource publishing type to obtain a naked-eye 3D resource corresponding to the target interaction model, including: displaying a resource publishing interface corresponding to the program resource category; determining a save path of the naked-eye 3D resource in response to an input operation on the resource publishing interface corresponding to the program resource category; and packaging the target resource scene after position adjustment and the virtual lens group to obtain a naked-eye 3D resource with a program resource category.

[0320] In an exemplary embodiment of the present disclosure, when the resource publishing type is a video resource category and / or a sequence frame resource category, the target resource scene after position adjustment and the virtual lens group are published based on the resource publishing type to obtain naked-eye 3D resources corresponding to the target interaction model, including: displaying a resource parameter adjustment interface corresponding to the video resource category and / or sequence frame resource category; determining the target resource parameters corresponding to the video resource category and / or sequence frame resource category in response to an input operation on the resource parameter adjustment interface; saving the target resource parameters, the target resource scene after position adjustment, and the virtual lens group to obtain naked-eye 3D resources with video resource category and / or sequence frame resource category.

[0321] In an exemplary embodiment of the present disclosure, the target resource parameters include at least one of a rendering style parameter, a resolution parameter, and an output type parameter; wherein, the target resource parameters, the target resource scene after position adjustment, and the virtual lens group are saved to obtain a naked-eye 3D resource with a video resource category and / or a sequence frame resource category, including: determining a target rendering style of the naked-eye 3D resource according to the rendering style parameter in the target resource parameters; determining a target screen type of the output screen based on an input type parameter in the target resource parameters, and determining a target resolution of the output screen based on a resolution parameter in the target resource parameters; and outputting a naked-eye 3D resource with a target rendering style and a target resolution, and with a video resource category and / or a sequence frame resource category, in response to a touch operation on a third preset interactive control in the resource parameter adjustment interface.

[0322] In an exemplary embodiment of the present disclosure, the target rendering style includes a multi-view stitching mode or a rendering result mode, and the target picture type includes a video picture type or a sequence frame picture type; wherein, in response to a touch operation on a third preset interactive control in the resource parameter adjustment interface, outputting a naked-eye 3D resource having a target rendering style and a target resolution and having a video resource category and / or a sequence frame resource category, comprises: in response to a touch operation on the third preset interactive control in the resource parameter adjustment interface, outputting a naked-eye 3D resource having a multi-view stitching mode and a target resolution and having a video picture type D resource; or in response to a touch operation on the third preset interactive control in the resource parameter adjustment interface, output a naked-eye 3D resource with a rendering result mode and a target resolution, and a video picture type; or in response to a touch operation on the third preset interactive control in the resource parameter adjustment interface, output a naked-eye 3D resource with a multi-viewpoint stitching mode and a target resolution, and a sequence frame picture type; or in response to a touch operation on the third preset interactive control in the resource parameter adjustment interface, output a naked-eye 3D resource with a rendering result mode and a target resolution, and a sequence frame picture type.

[0323] In an exemplary embodiment of the present disclosure, the apparatus for processing naked-eye 3D resources further includes:

[0324] A first naked-eye 3D resource display module may be configured to output the naked-eye 3D resource having a program resource category to a target display device, and display the naked-eye 3D resource having a program resource category through the target display device; and / or

[0325] The second naked-eye 3D resource display module can be used to output the naked-eye 3D resources with video resource category and / or sequence frame resource category to the target display device, and display the naked-eye 3D resources with video resource category and / or sequence frame resource category through the target display device.

[0326] In an exemplary embodiment of the present disclosure, the apparatus for processing naked-eye 3D resources further includes:

[0327] A current interaction instruction determination module may be configured to obtain hand state information and finger movement direction in response to a current interaction gesture input, and determine a current interaction instruction to be executed by a target interaction model in the naked-eye 3D resource based on the hand state information and finger movement direction;

[0328] The model state switching module can be used to control the target interaction model in the naked eye 3D resource to execute the current interaction instruction, switch the target interaction model from the original model state to the target model state corresponding to the current interaction instruction, and display the model animation generated by executing the current interaction instruction.

[0329] In an exemplary embodiment of the present disclosure, the current interaction gesture includes at least one of a human body interaction gesture, a somatosensory controller interaction gesture, an external device interaction gesture, and a handle interaction gesture.

[0330] In an exemplary embodiment of the present disclosure, controlling the target interaction model in the naked-eye 3D resource to execute the current interaction instruction includes: controlling the target interaction model in the naked-eye 3D resource to execute an up and down movement instruction and / or a left and right movement instruction; and / or controlling the target interaction model in the naked-eye 3D resource to execute a rotation instruction; and / or controlling the target interaction model in the naked-eye 3D resource to execute an explosion instruction.

[0331] In an exemplary embodiment of the present disclosure, controlling the target interaction model in the naked-eye 3D resource to execute an explosion instruction includes: controlling the model composition sub-module of the target interaction model in the naked-eye 3D resource to move in a preset direction and a preset angle to achieve an explosion effect; wherein the preset direction includes a free movement direction or a coordinate axis movement direction, and the preset angle includes a local angle of the model composition sub-module relative to the target interaction model.

[0332] In an exemplary embodiment of the present disclosure, the apparatus for processing naked-eye 3D resources further includes:

[0333] The model state recovery module can be used to control the target interaction model to recover from the target model state to the original model state at intervals of a preset time.

[0334] The specific details of each module in the above-mentioned naked-eye 3D resource processing device have been described in detail in the corresponding naked-eye 3D resource processing method, and therefore will not be repeated here.

[0335] It should be noted that although several modules or units of the device for performing action are mentioned in the detailed description above, this division is not mandatory. In fact, according to the embodiment of the present disclosure, the features and functions of two or more modules or units described above can be concretized in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided into multiple modules or units to be concretized. In addition, although the various steps of the method in the present disclosure are described in a specific order in the accompanying drawings, this does not require or imply that these steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired result. Additionally or alternatively, certain steps can be omitted, multiple steps can be combined into one step for execution, and / or one step can be decomposed into multiple steps for execution, etc.

[0336] In an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.

[0337] Those skilled in the art will appreciate that various aspects of the present disclosure may be implemented as systems, methods, or program products. Therefore, various aspects of the present disclosure may be implemented in the following forms: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software implementations, which may be collectively referred to herein as "circuits," "modules," or "systems."

[0338] The electronic device 3000 according to this embodiment of the present disclosure is described below with reference to FIG30 . The electronic device 3000 shown in FIG30 is merely an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure. As shown in FIG30 , the electronic device 3000 is presented in the form of a general-purpose computing device. The components of the electronic device 3000 may include, but are not limited to, the at least one processing unit 3010 described above, the at least one storage unit 3020 described above, a bus 3030 connecting different system components (including the storage unit 3020 and the processing unit 3010), and a display unit 3040.

[0339] The storage unit stores program code, which can be executed by the processing unit 3010, so that the processing unit 3010 performs the steps described in the "Exemplary Method" section of the present specification according to various exemplary embodiments of the present disclosure. For example, the processing unit 3010 can perform step S110 as shown in Figure 1: creating a newly generated scene corresponding to the target interaction model, and loading the target interaction model into the newly generated scene to obtain an original resource scene; step S120: calling a preset resource library to adjust the original resource scene to obtain a target resource scene, and determining the number of viewpoints of the target resource scene based on the target device parameters in the newly generated scene; step S130: configuring the lens parameters of the virtual lens group corresponding to the target resource scene based on the number of viewpoints, and configuring the virtual lens group based on the lens parameters; step S140: generating a naked-eye 3D resource corresponding to the target interaction model based on the target resource scene, the virtual lens group, and the zero point position.

[0340] The storage unit 3020 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 30201 and / or a cache memory unit 30202, and may further include a read-only memory unit (ROM) 30203. The storage unit 3020 may also include a program / utility 30204 having a set (at least one) of program modules 30205. Such program modules 30205 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each of these examples, or some combination thereof, may include an implementation of a network environment. The bus 3030 may represent one or more of several types of bus structures, including a storage unit bus or storage unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus structures.

[0341] The electronic device 3000 can also communicate with one or more external devices 3100 (e.g., a keyboard, a pointing device, a Bluetooth device, etc.), one or more devices that enable a user to interact with the electronic device 3000, and / or any device that enables the electronic device 3000 to communicate with one or more other computing devices (e.g., a router, a modem, etc.). Such communication can occur via an input / output (I / O) interface 3050. Furthermore, the electronic device 3000 can also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network such as the Internet) via a network adapter 3060. As shown, the network adapter 3060 communicates with other modules of the electronic device 3000 via a bus 3030. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in conjunction with the electronic device 3000, including but not limited to microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0342] Through the description of the above embodiments, it is easy for those skilled in the art to understand that the example embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.

[0343] In exemplary embodiments of the present disclosure, a computer-readable storage medium is also provided, on which is stored a program product capable of implementing the aforementioned methods of this specification. In some possible implementations, various aspects of the present disclosure may also be implemented in the form of a program product comprising program code. When the program product is executed on a terminal device, the program code is configured to cause the terminal device to execute the steps described in the "Exemplary Methods" section of this specification according to various exemplary embodiments of the present disclosure.

[0344] According to the program product for implementing the above method of the embodiment of the present disclosure, it can adopt a portable compact disc read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present disclosure is not limited to this. In this document, a readable storage medium can be any tangible medium that contains or stores a program, and the program can be used by an instruction execution system, device or device or used in combination with it. The program product can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of readable storage media (non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0345] Computer readable signal media may include a data signal propagated in baseband or as part of a carrier wave, wherein readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the readable medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination thereof.

[0346] The program code for performing the operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, and the like, as well as conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a stand-alone software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0347] Furthermore, the figures above are merely illustrative of the processes included in the methods according to exemplary embodiments of the present disclosure and are not intended to be limiting. It is readily understood that the processes illustrated in the figures above do not indicate or limit the temporal order of these processes. Furthermore, it is readily understood that these processes may be executed synchronously or asynchronously, for example, in multiple modules.

[0348] Other embodiments of the present disclosure will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow from the general principles of the present disclosure and include common knowledge or customary techniques in the art not invented herein. The specification and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the claims.

Claims

1. A method for processing naked-eye 3D resources, characterized in that, Including: Create a new generation scene corresponding to the target interaction model, and load the target interaction model in the new generation scene to obtain the original resource scene; Call a preset resource library to adjust the original resource scene to obtain the target resource scene, and determine the number of viewpoints of the target resource scene according to the target device parameters in the new generation scene; Configure the lens parameters of the virtual lens group corresponding to the target resource scene according to the number of viewpoints, and configure the virtual lens group according to the lens parameters; Generate a naked-eye 3D resource corresponding to the target interaction model based on the target resource scene, the virtual lens group, and the zero point position.

2. The processing method of the naked-eye 3D resource according to claim 1, wherein Create a new generation scene corresponding to the target interaction model, including: In response to a touch operation on a first preset interactive control on the display interface of the resource creation terminal, display an engineering creation sub-interface; In response to an input operation on the engineering creation sub-interface, determine the target device parameters of the target display device for displaying the naked-eye 3D resource corresponding to the target interaction model and the naked-eye 3D interleaving parameters; In response to a touch operation on a second preset interactive control in the engineering creation sub-interface, create a new generation scene corresponding to the target interaction model.

3. The processing method of the naked-eye 3D resource according to claim 1, characterized in that Load the target interaction model in the new generation scene to obtain the original resource scene, including: Obtain the target interaction model from a preset model library according to the target model name of the target interaction model; and / or Import the target interaction model from an external file according to the target model name of the target interaction model; Perform adaptive adjustment on the model size of the target interaction model in the new generation scene to obtain the original resource scene.

4. The method for processing naked-eye 3D resources according to claim 3, wherein Perform adaptive adjustment on the model size of the target interaction model in the new generation scene to obtain the original resource scene, including: Construct a first rectangle according to the new generation scene, and construct a second rectangle according to the target interaction model; Calculate the model scaling factor of the target interaction model in the new generation scene according to the first rectangle and the second rectangle; Perform adaptive adjustment on the model size of the target interaction model based on the model scaling factor to obtain the original resource scene.

5. The method for processing naked-eye 3D resources according to claim 4, wherein Construct a first rectangle according to the new generation scene, including: Display the new generation scene on the display interface of the resource creation terminal; Use the center point of the display interface as the center point of the first rectangle, and determine the first rectangle length and the first rectangle width of the first rectangle according to the interface length and interface width occupied by the new generation scene on the display interface; Construct a first rectangle according to the center point, the first rectangle length, and the first rectangle width of the first rectangle.

6. The method for processing the naked-eye 3D resource according to claim 4, wherein Construct a second rectangle according to the target interaction model, including: Obtain the pixel coordinates of the pixel points in the target interaction model, and obtain the maximum abscissa value, the maximum ordinate value, the minimum abscissa value, and the minimum ordinate value in the pixel coordinates; Determine the height of the second rectangle according to the maximum abscissa value and the minimum abscissa value, and determine the length of the second rectangle according to the maximum ordinate value and the minimum ordinate value; Use the center point of the target interaction model as the center point of the second rectangle, and construct the second rectangle according to the center point of the second rectangle, the height of the second rectangle, and the length of the second rectangle.

7. The method for processing naked-eye 3D resources according to claim 4, wherein Calculate the model scaling factor of the target interaction model in the newly added generation scenario according to the first rectangle and the second rectangle, including: Map the first rectangle to the three-dimensional coordinate where the resource generation engine is located to obtain a rectangle mapping result; Calculate a first ratio between the rectangle mapping height in the rectangle mapping result and the height of the second rectangle, and calculate a second ratio between the rectangle mapping length in the rectangle mapping result and the length of the second rectangle; Determine the model scaling factor of the target interaction model in the newly added generation scenario based on the first ratio and the second ratio.

8. The processing method of the naked-eye 3D resource according to claim 1, wherein The preset resource library includes at least one of a scene library, a model library, an animation library, a material library, a lighting library, and a sound library.

9. The method for processing the naked-eye 3D resource according to claim 8, wherein Call the preset resource library to adjust the original resource scene to obtain a target resource scene, including: Load the original three-dimensional scene corresponding to the target interaction model from the scene library and add the original three-dimensional scene to the newly added generation scenario; and / or Load the original three-dimensional animation from the animation library and apply the original three-dimensional animation to the target interaction model; and / or Load the original lighting from the lighting library and add the original lighting to the newly added generation scenario; and / or Load the model material corresponding to the target interaction model from the material library and apply the model material to the target interaction model; and / or Load the audio data corresponding to the target interaction model from the sound library and add the audio data to the newly added generation scenario; Adjust the model attributes and / or animation attributes and / or lighting attributes and / Or material attributes and / or sound attributes in the newly added generation scenario to obtain the target resource scene.

10. The processing method of the naked-eye 3D resource according to claim 9, characterized in that The original three-dimensional animation includes program animation and / or keyframe animation; Among them, applying the original three-dimensional animation to the target interaction model includes: Adding the program animation to the target interaction model; and / or Mounting the target interaction model under the animation object in the keyframe animation so that the target interaction model is a child object of the animation object.

11. The processing method of the naked-eye 3D resource according to claim 9, characterized in that, Applying the model material to the target interaction model includes: In response to dragging the model material to the target interaction model, replace the original material in the target interaction model based on the model material.

12. The processing method of the naked-eye 3D resource according to claim 9, characterized in that, The model attributes include structural hierarchy attributes and / or position attributes; Adjusting the model attributes of the target interaction model includes: In response to a touch operation on the model attribute interaction control, display a model adjustment interface for the model attributes of the target interaction model; In response to an input operation on the model adjustment interface, the attribute value of the structural level attribute and / or the attribute value of the position attribute of the target interaction model are adjusted.

13. The processing method of the naked-eye 3D resource according to claim 9, characterized in that, Adjusting the model attributes of the target interaction model further includes: In response to a movement event acting on the target interaction model, adjusting the current model position of the target interaction model in the newly generated scene, and / or rotating the target interaction model.

14. The method for processing naked-eye 3D resources according to claim 9, wherein Adjusting the animation attributes includes: In response to a touch operation on the animation setting interactive control, displaying an animation adjustment interface corresponding to the animation attributes; In response to an input operation on the animation adjustment interface, adjusting the animation cycle time length and / or the animation amplitude in the animation attributes; and / or adjusting the offset of the animation track in the animation attributes in the newly generated scene.

15. The processing method of the naked-eye 3D resource according to claim 9, characterized in that The original light includes at least one of a directional light, a point light source, a spotlight, and a combined light composed of a point light source and a spotlight; Among them, adjusting the light attributes includes: In response to a touch operation on the light setting interactive control, displaying a light adjustment interface corresponding to the light attributes; In response to an input operation on the light adjustment interface, adjusting the light position and / or the light intensity and / or the light color of the directional light and / or the point light source and / or the spotlight and / or the combined light in the newly generated scene.

16. The processing method of the naked-eye 3D resource according to claim 9, wherein The material attributes include at least one of model color, texture map, normal map, transparency, glossiness, and refractive index; Among them, adjusting the material attributes includes: In response to a touch operation on the material setting interactive control, displaying a material adjustment interface corresponding to the material attributes, and in response to an input operation on the material adjustment interface, adjusting the model color and / or the texture map and / or the normal map and / or the transparency and / or the glossiness and / or the refractive index of the target interaction model.

17. The processing method of the naked-eye 3D resource according to claim 9, wherein Adjusting the sound attributes includes: In response to a touch operation on the sound setting interactive control, displaying a sound adjustment interface corresponding to the sound attributes, and in response to an input operation on the sound adjustment interface, adjusting the volume of the audio data.

18. The method for processing naked-eye 3D resources according to claim 1, wherein Generating a naked-eye 3D resource corresponding to the target interaction model based on the target resource scene, the virtual lens group, and the zero position, includes: Determining the zero plane position according to the zero position, and adjusting the zero plane position; Determining the stereoscopic display area and the planar display area of the target interaction model in the target resource scene according to the adjusted zero plane position; Determining the model placement area of the target interaction model in the target resource scene according to the stereoscopic display area and the planar display area, and adjusting the target model position of the target interaction model based on the model placement area; Publishing the target resource scene and the virtual lens group after position adjustment to obtain a naked-eye 3D resource corresponding to the target interaction model.

19. The method for processing naked-eye 3D resources according to claim 18, wherein Publish the target resource scene after position adjustment and the virtual lens group to obtain a naked-eye 3D resource corresponding to the target interaction model, including: In response to a touch operation on the resource publishing interaction control, display the resource publishing interface; In response to a touch operation on the resource publishing interface, determine the resource publishing type; Based on the resource publishing type, publish the target resource scene after position adjustment and the virtual lens group to obtain a naked-eye 3D resource corresponding to the target interaction model.

20. The method for processing naked-eye 3D resources according to claim 19, wherein The resource publishing type includes at least one of a program resource category, a video resource category, and a sequence frame resource category.

21. The method for processing naked-eye 3D resources according to claim 20, characterized in that, When the resource publishing type is a program resource category, based on the resource publishing type, publish the target resource scene after position adjustment and the virtual lens group to obtain a naked-eye 3D resource corresponding to the target interaction model, including: Display the resource publishing interface corresponding to the program resource category; In response to an input operation on the resource publishing interface corresponding to the program resource category, determine the saving path of the naked-eye 3D resource; Package the target resource scene after position adjustment and the virtual lens group to obtain a naked-eye 3D resource with a program resource category.

22. The method for processing naked-eye 3D resources according to claim 20, wherein When the resource publishing type is a video resource category and / or a sequence frame resource category, based on the resource publishing type, publish the target resource scene after position adjustment and the virtual lens group to obtain a naked-eye 3D resource corresponding to the target interaction model, including: Display the resource parameter adjustment interface corresponding to the video resource category and / or the sequence frame resource category; In response to an input operation on the resource parameter adjustment interface, determine the target resource parameters corresponding to the video resource category and / or the sequence frame resource category; Save the target resource parameters, the target resource scene after position adjustment, and the virtual lens group to obtain a naked-eye 3D resource with a video resource category and / or a sequence frame resource category.

23. The method for processing the naked-eye 3D resource according to claim 22, wherein The target resource parameters include at least one of a rendering style parameter, a resolution parameter, and an output type parameter; Among them, saving the target resource parameters, the target resource scene after position adjustment, and the virtual lens group to obtain a naked-eye 3D resource with a video resource category and / or a sequence frame resource category includes: Determine the target rendering style of the naked-eye 3D resource according to the rendering style parameter in the target resource parameters; Determine the target picture type of the output picture based on the input type parameter in the target resource parameters, and determine the target resolution of the output picture based on the resolution parameter in the target resource parameters; In response to a touch operation on the third preset interaction control in the resource parameter adjustment interface, output a naked-eye 3D resource with a target rendering style and a target resolution, and with a video resource category and / or a sequence frame resource category.

24. The processing method of the naked-eye 3D resource according to claim 23, characterized in that, The target rendering style includes a multi-viewpoint stitching mode or a rendering result mode, and the target picture type includes a video picture type or a sequence frame picture type; Among them, in response to a touch operation on a third preset interaction control in the resource parameter adjustment interface, a naked-eye 3D resource with a target rendering style, a target resolution, and a video resource category and / or a sequence frame resource category is output, including: In response to a touch operation on a third preset interaction control in the resource parameter adjustment interface, a naked-eye 3D resource with a multi-viewpoint stitching mode, a target resolution, and a video picture type is output; or In response to a touch operation on a third preset interaction control in the resource parameter adjustment interface, a naked-eye 3D resource with a rendering result mode, a target resolution, and a video picture type is output; or In response to a touch operation on a third preset interaction control in the resource parameter adjustment interface, a naked-eye 3D resource with a multi-viewpoint stitching mode, a target resolution, and a sequence frame picture type is output; or In response to a touch operation on a third preset interaction control in the resource parameter adjustment interface, a naked-eye 3D resource with a rendering res ult mode and a target resolution and a sequence frame picture type is output.

25. The method for processing naked-eye 3D resources according to claim 1, characterized in that, The processing method of the naked-eye 3D resource further includes: Outputting the naked-eye 3D resource with a program resource category to a target display device, and displaying the naked-eye 3D resource with a program resource category through the target display device; and / or Outputting the naked-eye 3D resource with a video resource category and / or a sequence frame resource category to a target display device, and displaying the naked-eye 3D resource with a video resource category and / or a sequence frame resource category through the target display device.

26. The processing method of the naked-eye 3D resource according to claim 25, characterized in that After displaying the naked-eye 3D resource with a program resource category through the target display device, the processing method of the naked-eye 3D resource further includes: In response to a current interaction gesture input, obtaining hand state information and a finger movement direction, and determining a current interaction instruction to be executed by a target interaction model in the naked-eye 3D resource based on the hand state information and the finger movement direction; Controlling the target interaction model in the naked-eye 3D resource to execute the current interaction instruction, switching the target interaction model from an original model state to a target model state corresponding to the current interaction instruction, and displaying a model animation generated by executing the current interaction instruction.

27. The processing method of the naked-eye 3D resource according to claim 25, wherein Controlling the target interaction model in the naked-eye 3D resource to execute the current interaction instruction includes: Controlling the target interaction model in the naked-eye 3D resource to execute an up and down movement instruction and / or a left and right movement instruction; and / or Controlling the target interaction model in the naked-eye 3D resource to execute a rotation instruction; and / or Controlling the target interaction model in the naked-eye 3D resource to execute an explosion instruction.

28. The method for processing naked-eye 3D resources according to claim 27, wherein, Controlling the target interaction model in the naked-eye 3D resource to execute an explosion instruction includes: Controlling model composition sub-modules in the naked-eye 3D resource to move in a preset direction and at a preset angle to achieve an explosion effect; Among them, the preset direction includes a free movement direction or a coordinate axis movement direction, and the preset angle includes a local angle of the model composition sub-module relative to the target interaction model.

29. An article display method in an e-commerce scenario, characterized in that, Including: Determine the product to be displayed in response to a touch operation on the current display interface; Obtain the naked-eye 3D resource corresponding to the product to be displayed; wherein, the naked-eye 3D resource is generated by the processing method of the naked-eye 3D resource according to any one of claims 1-24; Display the naked-eye 3D resource corresponding to the product to be displayed, and interact with the displayed product to display the internal composition structure of the displayed product.

30. An article display method in a teaching scenario, characterized in that, Comprising: Determine the teaching prop to be displayed, and obtain the naked-eye 3D resource corresponding to the teaching prop to be displayed; wherein, the naked-eye 3D resource is generated by the processing method of the naked-eye 3D resource according to any one of claims 1-24; Display the naked-eye 3D resource corresponding to the teaching prop to be displayed, and interact with the displayed teaching prop to display the internal composition structure of the teaching prop.

31. A processing device for naked-eye 3D resources, characterized in that, Comprising: An original resource scene generation module, configured to create a new generation scene corresponding to the target interaction model, and load the target interaction model in the new generation scene to obtain an original resource scene; A viewpoint number determination module, configured to call a preset resource library to adjust the original resource scene to obtain a target resource scene, and determine the number of viewpoints of the target resource scene according to the target device parameters in the new generation scene; A virtual lens group configuration module, configured to configure the lens parameters of the virtual lens group corresponding to the target resource scene according to the number of viewpoints, and configure the virtual lens group according to the lens parameters; A naked-eye 3D resource generation module, configured to generate a naked-eye 3D resource corresponding to the target interaction model based on the target resource scene, the virtual lens group, and the zero point position.

32. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by a processor, it implements the processing method of the naked-eye 3D resource according to any one of claims 1-28, and the article display method in the e-commerce scenario according to claim 29, and the article display method in the teaching scenario according to claim 30.

33. An electronic device, characterized in that, Comprising: A processor; And A memory, configured to store the executable instructions of the processor; Wherein, the processor is configured to execute the processing method of the naked-eye 3D resource according to any one of claims 1-28, and the article display method in the e-commerce scenario according to claim 29, and the article display method in the teaching scenario according to claim 30 by executing the executable instructions.

Citation Information

Patent Citations

  • Image processing method and device, electronic device and storage medium

    CN107393017A

  • Information processing method and device, electronic equipment and storage medium

    CN116524094A

  • Virtual light processing method and device, equipment, storage medium and program product

    CN116597069A

  • Three-dimensional scene rendering method, device, and storage medium

    WO2023138471A1

  • Virtual reality interaction method and apparatus, and device and storage medium

    WO2023138559A1

Cited By

  • Intelligent sound and scene sound mixing method and system of sound and intelligent film

    CN120434277A