A two-dimensional and three-dimensional fusion form processing method and system

Abstract

The present invention relates to a two-dimensional and three-dimensional fusion form processing method and system thereof, the method at least comprising: displaying at least one three-dimensional model, wherein a form recording the attribute information of the three-dimensional model is set on a server; in a virtual reality environment, the display mode of the three-dimensional model is switched from three-dimensional to two-dimensional by applying a driving action to the three-dimensional model, or the display mode of the two-dimensional model is switched from two-dimensional to three-dimensional by applying a driving action to the two-dimensional model to form a three-dimensional model, wherein the two-dimensional model is displayed in at least one area that meets the display requirements of the two-dimensional model in the same virtual reality scene. The present invention simplifies the data configuration method by configuring the data elements of the two-dimensional model or the three-dimensional form in a three-dimensional manner, so that users can quickly configure hundreds of forms of a large project in a virtual reality environment, thereby improving the work efficiency of data configuration.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality technology, and in particular to a two-dimensional and three-dimensional fusion form processing method and system. Background Art

[0002] VR is the abbreviation of virtual reality technology. With the popularization of VR display devices, more and more users use VR display devices not only for entertainment, but also as work tools. With the further development and popularization of virtual reality display devices, now and in the future, virtual reality display devices will be more widely used in the daily work of the general public, further improving work efficiency.

[0003] For example, for a large project of a large company, an engineering project consists of several sub-projects in the engineering phase. The completion of a large project, especially an engineering project, requires the cooperation of several subsidiaries. There are many links in the engineering project, and each sub-project involves design management, procurement management, construction management, commissioning management, progress management, cost management, quality management, human resource management, document management, GIS management, handover management, etc. These management links almost all involve multiple forms of data. Since each management link is related to each other and has mutual influence, the data of different forms are also related to each other, and most of the data have the effect of mutual influence. It is conceivable that when a user views and manages a link of a project or even the overall progress of the project, he needs to face dozens or even hundreds of forms at the same time. Based on management needs and data accuracy verification, users also need to organize and form new forms based on the data of each form. This leads to insufficient display area of ​​the display screen of current electronic devices. Users prefer to use VR display devices to display several forms in a virtual reality environment. Users can set forms at any position in three-dimensional space. Compared with the limited display area of ​​electronic devices in real life, the three-dimensional space of virtual reality can undoubtedly provide a wide, unlimited display surface, which is convenient for users to view dozens or even hundreds of forms at the same time to manage projects. However, the above-mentioned three-dimensional virtual reality environment also has defects that hinder user work efficiency.

[0004] The data between different forms are related, and it is tedious to reorganize the data from different forms into a new form. The workload of copying, pasting, transferring, etc. of data is huge, which makes users miserable. When users manage data between different forms, they cannot directly and concisely view the relationship between data, nor can they directly move, copy, and manage data with simple actions.

[0005] Moreover, the data is presented in different formats and has no correlation, which makes it impossible for users to quickly view data of different formats related to the same thing. Instead, they need to find the required one from several forms, which undoubtedly takes a lot of time and reduces the user's work efficiency. For example, for a three-dimensional building image, the user needs to quickly view the two-dimensional model data of each building location, but the user can only call up the relevant form and find the corresponding form to check, which increases the probability of error. How to enable users to trigger the three-dimensional building image in a simple and quick way, so that the corresponding and correct two-dimensional insurance policy can be automatically popped up in the virtual reality environment, which is convenient for users to view, manage and configure data, is a technical problem that has not been solved by current technology.

[0006] Chinese patent CN110599600 A discloses a method for automatically converting a multidimensional visualization model of data, including static generation and dynamic generation. The static generation process is: importing a static table data file generated by a user, obtaining a multidimensional data column through standardized analysis and mapping it to the corresponding three-dimensional model parameters, and automatically generating a corresponding three-dimensional chart model; the dynamic generation process is: the program automatically generates a three-dimensional dynamic chart model; the parameter fields that need to be displayed in real time in the dynamic chart model are written into the data interface to obtain the corresponding multidimensional data column; the appearance attributes and VR interactive function settings of the three-dimensional dynamic chart model are performed; the three-dimensional chart file with complete functions is exported; and the three-dimensional chart file is imported into a 3D interactive application. The invention is used for multi-dimensional display of data, and has a convenient 3D interactive function, which can be used for immersive experience content, such as virtual reality, augmented reality and other technologies. However, the invention is only used to convert a two-dimensional model into a three-dimensional model, but does not involve a technical solution for how to convert a two-dimensional model and a three-dimensional model into each other, and how to configure data elements in a three-dimensional manner. Therefore, the required technology still cannot solve the processing method of how the present invention merges two-dimensional and three-dimensional forms.

[0007] In addition, on the one hand, there are differences in understanding among those skilled in the art; on the other hand, the applicant studied a large number of documents and patents when making the present invention, but due to space limitations, not all details and contents are listed in detail. However, this does not mean that the present invention does not have the characteristics of these prior arts. On the contrary, the present invention already has all the characteristics of the prior art, and the applicant reserves the right to add relevant prior art to the background technology. Summary of the invention

[0008] In view of the defects of the prior art in that data management is difficult and the workload of copying, pasting, transferring, etc. of data is huge, and in view of the difficult situation that users cannot directly and concisely view the relationship between data when managing data between different forms, nor can they directly move, copy, and perform other related management with simple actions, the present invention proposes a two- and three-dimensional fusion form processing method and system for simplifying data management and form management in a large organizational structure.

[0009] A method for processing a two-dimensional and three-dimensional fusion form, the method at least comprising: displaying at least one three-dimensional model, wherein a form recording attribute information of the three-dimensional model is set on a server; in a virtual reality environment, switching the display mode of the three-dimensional model from three-dimensional to two-dimensional by applying a driving action to the three-dimensional model, or switching the display mode of the two-dimensional model from two-dimensional to three-dimensional by applying a driving action to the two-dimensional model to form a three-dimensional model, wherein the two-dimensional model and the three-dimensional model can be linked to each other, wherein the two-dimensional model is displayed in at least one area that meets the display requirements of the two-dimensional model within the same virtual reality scene.

[0010] The present invention realizes the diversified display of the form by switching between the three-dimensional model and the two-dimensional model, thereby increasing the display dimension of the data table. At the same time, the present invention displays the two-dimensional model in an area that meets the display requirements of the two-dimensional model, so that the form displayed based on the two-dimensional model can be clearly separated from the environment, avoiding the reading barrier caused by the fusion of the form and the environment.

[0011] Preferably, the area that meets the two-dimensional model display requirements is selected from the virtual reality environment in a manner that can be distinguished from the virtual display scene at least in terms of color, brightness and / or contrast. Distinguishing the two-dimensional form from the virtual environment in terms of color, brightness and / or contrast makes it easier for the user to find the required form data.

[0012] Preferably, the area that meets the display requirements of the two-dimensional model is selected in a suspended manner and in a manner that at least partially does not overlap with any three-dimensional model in the field of view of the virtual reality user. If the two-dimensional model and the three-dimensional model overlap in the user's viewing direction, there is no doubt that the data reading barrier formed by the mutual occlusion of the models requires the user to manually adjust the suspension position again, which is time-consuming and laborious. The present invention reduces the time and effort of the user to manually adjust the two-dimensional form to the appropriate area by automatically selecting the area where the two-dimensional model is displayed to display the requirements, thereby improving the efficiency of the user in extracting and managing data information.

[0013] Preferably, the driving action includes at least: when the three-dimensional model is triggered by a specific action, the display mode of the three-dimensional model is switched from three-dimensional to two-dimensional model; when the three-dimensional model is triggered by a specific language, the display mode of the three-dimensional model is switched from three-dimensional to two-dimensional model; and / or when the three-dimensional model is triggered by a specific information instruction, the display mode of the three-dimensional model is switched from three-dimensional to two-dimensional model.

[0014] Preferably, the method also includes: the three-dimensional model at least includes a three-dimensional stereo model table, the three-dimensional stereo model table includes at least a number of data element positions arranged and / or spliced ​​along at least three dimensions and to be filled by the three-dimensional unit, the data element positions are presented in the form of slots, and the three-dimensional unit has at least data elements.

[0015] The present invention sets data elements in the form of a three-dimensional model table, so that the data element information can increase multiple display areas. The user only needs to rotate the three-dimensional model table to quickly find the required data elements. In addition, the user can fill the data elements in the form of slots to reduce the difficulty of data management, so that the data elements can be orderly associated, avoiding the management defects of messy data under the huge data organizational structure.

[0016] Preferably, the method further comprises: triggering at least one data element position in the three-dimensional model table, and displaying the selected data elements in the form of three-dimensional units in an area in the virtual environment that meets the display requirements of the three-dimensional units. Such a setting is conducive to orderly dividing the data element positions and enabling rapid search of data elements. At the same time, the display area of ​​the data element positions will not be reduced, so the efficiency of the user's data element search and management can be significantly improved, and the time of data management can be shortened.

[0017] Preferably, the method further comprises: selecting the stereo unit through a VR operating handle and dragging it to a designated data element position in a three-dimensional model table, and / or configuring visible information related to the data element on a visible surface of the stereo unit.

[0018] Preferably, the method also includes: when the three-dimensional model table is driven to rotate by a VR operating handle, the three-dimensional model table can display the filling status of the faces and data elements of each dimension in an all-round rotation manner, and based on the selection of the VR operating handle, the selected face of the three-dimensional model table is displayed in the user's field of view.

[0019] Preferably, when the VR operating handle is driven, the field of view distance, size and / or clarity of the three-dimensional model, two-dimensional model and / or stereoscopic unit can be adjusted.

[0020] The method of driving the rotation of the three-dimensional model table of the present invention can dynamically display the current data management situation while reducing the display area of ​​the data elements, thereby reducing the difficulty of data management. A filled slot indicates that it is occupied by a data element, and an empty slot indicates that the data element is not set, which makes it easy for users to understand and adjust the data elements of the data form, thereby reducing the difficulty of data adjustment and data management.

[0021] The present invention also provides a two-dimensional and three-dimensional fusion form processing system, which at least includes a server, and the server is configured to execute the two-dimensional and three-dimensional fusion form processing method of the present invention when a connection is established with a VR display device.

[0022] Preferably, in the two-dimensional and three-dimensional fusion form processing system, the server establishes a connection relationship with the VR display device, so that the user can manage the data elements by viewing and / or operating the three-dimensional model and the two-dimensional model, avoiding the disordered display of the form in the virtual display space and the display of messy associations. By managing the data elements in the form of a three-dimensional model table, the display area of ​​the data elements is saved, and the required data element location can be quickly found, forming an orderly and intuitive management and display of the data elements in the virtual display space, which can significantly improve the efficiency of data element management and reduce the possibility of errors in data element management. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 It is a schematic diagram of a scenario in which a worker in the present invention performs data configuration through a computer;

[0024] Figure 2 is another schematic diagram of a scenario in which a worker performs data configuration through a virtual reality environment in the present invention;

[0025] Figure 3 It is a simplified schematic diagram of a scene of a two-dimensional and three-dimensional fusion form provided by a preferred embodiment of the present invention;

[0026] Figure 4 It is a simplified schematic diagram of a scene of a two-dimensional and three-dimensional fusion form provided by a preferred embodiment of the present invention;

[0027] Figure 5 It is a simplified schematic diagram of a scene of three-dimensional data configuration according to a preferred embodiment of the present invention;

[0028] Figure 6 It is a simplified schematic diagram of a scenario in which a three-dimensional data form configuration is switched to a two-dimensional data configuration according to a preferred embodiment of the present invention.

[0029] Reference numerals list

[0030] 10: 3D model; 20: 2D model image; 21: first 2D model; 22: second 2D model; 40: 3D building image; 100: VR display device; 200: operating handle; 300: server. DETAILED DESCRIPTION

[0031] The following is a detailed description with reference to the accompanying drawings.

[0032] like Figure 1 The figure shows the current staff's analysis of data and configuration of data elements for large projects. Due to the limitation of the display interface of computer equipment, staff can only display several two-dimensional models at a time. The data configuration of a form needs to be related to the data elements of several two-dimensional models, which requires staff to constantly switch forms to configure and manage the data of new forms. Switching the displayed form is not only cumbersome and troublesome, reducing work efficiency, but also difficult to accurately ensure the accuracy of the configured data, and prone to errors. At the same time, the relationship between the data elements of the new form and the data configuration elements of the existing form cannot be directly seen. In order to reduce the error rate of data configuration, staff generally use colored lines to connect the data elements of different forms so that they or their colleagues can intuitively view the relationship between the data elements and check them. However, it is also limited by the limitation of the display surface of the computer equipment. Even if the display screen is large, it can only display dozens of two-dimensional models, and it is impossible to display hundreds of two-dimensional models at the same time and set the relationship between visible data elements. This makes the staff who perform such data configuration and management very headache. Therefore, the staff who perform such data configuration and management prefer to use virtual display devices to configure and manage data.

[0033] like Figure 2 As shown, one of the staff members configures data for several forms in a virtual reality environment through a virtual reality display device. However, some data forms are two-dimensional forms, and some are three-dimensional forms, and the connection between the data elements of each data form and the new form to be filled is invisible. At the same time, since the form to be filled is a two-dimensional model, several data elements are displayed in the form at the same time, which is not conducive to quickly finding the location of the data element to be filled. That is, in the prior art, even if a virtual reality display device is used, the operation is convenient, but because the form is two-dimensional, it is still impossible to achieve the problem of rapid configuration between related data elements.

[0034] In the present invention, the two-dimensional model at least includes a two-dimensional image and a two-dimensional form. The two-dimensional form is displayed in the form of a two-dimensional data table. The two-dimensional image refers to a virtual plane figure displayed in a virtual environment.

[0035] The present invention provides a two-dimensional and three-dimensional fusion form processing system, which at least includes a server 300. The server 300 is connected to a virtual reality (VR) display device 100.

[0036] The server 300 is a computer server, a dedicated integrated chip, a processor, a microprocessor, etc. that can run the program code of the two-dimensional and three-dimensional fusion form processing method of the present invention.

[0037] The two-dimensional and three-dimensional fusion form processing system also includes a memory for storing the program code of the two-dimensional and three-dimensional fusion form processing method of the present invention. The memory is, for example, a ROM memory or a RAM memory.

[0038] The two-dimensional and three-dimensional fusion form processing method of the present invention includes:

[0039] S1: Displaying at least one three-dimensional model when a connection is established with a VR display device, wherein a form recording attribute information of the three-dimensional model is set on the server 300;

[0040] S2: in a virtual reality environment, switching the display mode of the three-dimensional model from three-dimensional to two-dimensional by applying a driving action to the three-dimensional model, or switching the display mode of the two-dimensional model from two-dimensional to three-dimensional by applying a driving action to the two-dimensional model to form a three-dimensional model,

[0041] S3: wherein the two-dimensional model is displayed in at least one area that meets the display requirements of the two-dimensional model within the same virtual reality scene.

[0042] In the present invention, the two-dimensional model and the corresponding three-dimensional model are linked. For example, when the visible surface of the three-dimensional model rotates from surface A to surface B, the associated two-dimensional model is switched from the two-dimensional model corresponding to surface A to the two-dimensional model corresponding to surface B.

[0043] When the display part of the three-dimensional model changes, the corresponding two-dimensional model with a linkage relationship also changes accordingly.

[0044] The linkage relationship in the present invention refers to a preset association relationship. Preferably, each part of the three-dimensional model is provided with a corresponding two-dimensional form or two-dimensional image. For another example, when the display interface of the three-dimensional model moves left, the display interface of the two-dimensional model also moves left adaptively.

[0045] The specific description of each step of the present invention is as follows.

[0046] S1: Display at least one three-dimensional model when a connection is established with a VR display device, and a form recording attribute information of the three-dimensional model is set on the server 300.

[0047] like Figure 3 to Figure 6As shown, the user connects the VR display device 100 to the server 300 by wire or wireless and starts it. The user enters the virtual reality environment by wearing the VR display device 100 and views the three-dimensional model 10 and the two-dimensional model image 20. The three-dimensional model 10 can be as follows: Figure 3 The three-dimensional model table shown can also be Figure 4 The object image model shown is, for example, a three-dimensional building image 40, a plant model, an animal model, an insect model, a food model, an item model, and the like. Figure 3 The first part of the three-dimensional model corresponds to the first two-dimensional model 21. Figure 3 The second part of the three-dimensional model corresponds to the second dimensional model 22.

[0048] Figure 3 The three-dimensional model table in the figure is not limited to the cube structure shown in the figure, but also includes other three-dimensional models, and the structure and shape can be changed as needed. The present invention is exemplified by a three-dimensional model table of a cube imitating structure in order to better describe the concept of the present invention.

[0049] Each three-dimensional model in the present invention is provided with attribute information, which at least includes personnel attribute information, authority attribute information and time attribute information, and may also include other required attribute information.

[0050] Personnel attribute information includes, for example, who configured the three-dimensional model, modified it, and finally determined the solution, etc. As long as the personnel information is related to the three-dimensional model, the personnel attribute information can be entered.

[0051] The authority attribute information is, for example, the authority level at which the three-dimensional model can be modified. Personnel above this authority level can modify, check and / or determine the solution, and personnel above this authority level can view it.

[0052] The time attribute information includes, for example, the data configuration time, modification time, confirmation time, solution verification time, etc. of the three-dimensional model.

[0053] S2: In a virtual reality environment, a display mode of the three-dimensional model is switched from three-dimensional to two-dimensional to form a two-dimensional model by applying a driving action to the three-dimensional model. A display mode of the two-dimensional model is switched from two-dimensional to three-dimensional to form a three-dimensional model by applying a driving action to the two-dimensional model.

[0054] Preferably, the driving action at least includes:

[0055] When the three-dimensional model is triggered by a specific action, the display mode of the three-dimensional model is switched from a three-dimensional model to a two-dimensional model.

[0056] For example, the specific action may be a gesture, a hand action directed to a 3D model, etc. For example, when a user taps, pats, or touches a certain stereo unit of a 3D model, the tapped stereo unit disappears, and the 2D model corresponding to the part is displayed in a visible manner in an area that meets the 2D model display requirements.

[0057] For example, the user defines an area on the surface of the three-dimensional model, and at least one stereo unit within the defined area belongs to the selected stereo unit. The selected stereo unit disappears and the two-dimensional model corresponding to the selected stereo unit is displayed in a visibly manner in an area that meets the two-dimensional model display requirements.

[0058] The specific actions are not limited to the above examples, and can also be any specific actions customized by the user. Triggering the conversion of two-dimensional and three-dimensional forms through specific actions is not only convenient and easy, but also allows users to directly determine the location of data elements or the content of data elements when viewing the three-dimensional model, thereby reducing the flat display area required for the data elements. At the same time, the setting of the three-dimensional model of the data element allows the user to configure more data in a smaller display area and facilitate search by rotating the three-dimensional model 360 degrees.

[0059] Preferably, the driving action at least includes:

[0060] When the three-dimensional model is triggered by a specific language, the display mode of the three-dimensional model is switched from a three-dimensional model to a two-dimensional model.

[0061] The specific language is, for example, a preset value or a language customized by a user that can determine the mode switching of the three-dimensional model.

[0062] Preferably, the specific language may also be a language corresponding to the displayed name of the stereoscopic unit. For example, if the displayed name of the stereoscopic unit is a Chinese name, as long as the user inputs the Chinese language voice "Name" through the VR display device 100, the stereoscopic unit will switch to the corresponding two-dimensional model. Similarly, if the displayed name of the stereoscopic unit is English Name, as long as the user inputs the English language voice "Name" through the VR display device 100, the stereoscopic unit will switch to the corresponding two-dimensional model.

[0063] This setting reduces the tedious settings of user-defined languages. Users only need to select the language to flexibly trigger the language voice according to the needs of the data configuration of the 3D model, which simplifies the user's work instructions.

[0064] Preferably, the language in the present invention even includes Braille. The three-dimensional model of the present invention can be a combination of a visible three-dimensional model and its voice. When a blind person enters a virtual display environment and performs data configuration, an operating handle 200 suitable for use by the blind person explains the relevant names of the stereoscopic units of the three-dimensional model in a voice manner, so that the blind person can select the stereoscopic unit by voice, and the data elements of the two-dimensional model formed by switching the stereoscopic unit are displayed in the form of Braille, so that the blind person can feel the data elements displayed in Braille in the two-dimensional model through the operating handle 200 in the virtual reality environment, thereby completing the work of data configuration by combining touch actions with voice.

[0065] Preferably, the driving action at least includes:

[0066] When the three-dimensional model is triggered by a specific information instruction, the display mode of the three-dimensional model is switched from a three-dimensional model to a two-dimensional model.

[0067] Specific information instructions include designated programming information, deaf-mute gesture language, biometric information, user-encrypted information instructions, information instructions formed by encrypted languages ​​such as Morse code, etc. Biometric information includes fingerprints, lip prints, pupils, facial information, palm prints, voice characteristics and other information related to biology.

[0068] Since the virtual display environment is more suitable for use by a diverse group of people, it can meet the needs of more people in society for data configuration and management, allowing more people with disabilities to obtain corresponding jobs, further benefiting social development and progress and promoting social harmony.

[0069] The diversification of the driving actions of the three-dimensional model of the present invention simplifies the working steps of data configuration and the required display plane, and more three-dimensional models can be placed on the same plane area. The user can perform more types of data configuration by rotating the three-dimensional model.

[0070] S3: wherein the two-dimensional model is displayed in at least one area that meets the display requirements of the two-dimensional model within the same virtual reality scene.

[0071] In the prior art, the virtual reality scene is not completely separated from the real environment, but integrated with the real environment. The colors of various devices in the real environment are complex, which means that if the location of the 2D model displayed is similar to the color of the device in the real scene, the user will not be able to find or find it difficult to find the required 2D model. Simply setting the color of the 2D model obviously cannot solve the problem of complex and changeable colors of real devices.

[0072] Therefore, the present invention makes unconventional setting changes to the display area of ​​the two-dimensional model, so that the server can automatically select an area that meets the display requirements of the two-dimensional model.

[0073] Preferably, the area meeting the two-dimensional model display requirement is selected from the virtual reality environment in a manner that is distinguishable from the virtual display scene at least in terms of color, brightness and / or contrast.

[0074] When the two-dimensional model is displayed, the server selects an area suitable for displaying the two-dimensional model according to the scene color of the real environment. For example, if there are walls with a single color and patterned sheets, the server will give priority to the wall by calculating the color type, and adjust the color, brightness and / or contrast of the two-dimensional model based on the color of the wall, so that the two-dimensional model can be distinguished from the environment. For example, if there are walls with multi-color wallpaper and sheets with a single color, the server will give priority to the sheets by calculating the color type, and adjust the color, brightness and / or contrast of the two-dimensional model based on the color of the sheets, so that the two-dimensional model can be distinguished from the environment.

[0075] Preferably, the area that meets the two-dimensional model display requirements is selected in a suspended manner and in a manner that does not at least partially overlap with any three-dimensional model within the field of view of the virtual reality user.

[0076] When dozens or even hundreds of 2D models are displayed in a space in a virtual reality scene, since the 2D models can be set in a suspended manner, a large amount of display area is added, and the display area can be almost infinite. The 2D model does not overlap with any 3D model at least partially, which is conducive to rotating the 3D model and displaying the position of the data elements to be viewed, reducing the steps for users to readjust the position of the 3D model and saving users' ineffective work time.

[0077] Preferably, the method further comprises:

[0078] The three-dimensional model at least includes a three-dimensional model table. The three-dimensional model table at least includes a plurality of data element positions arranged and / or spliced ​​along at least three dimensions and to be filled in the three-dimensional unit. The data element positions are presented in the form of slots. The three-dimensional unit at least has data elements and related information thereof.

[0079] Preferably, the two-dimensional and three-dimensional fusion form processing method further includes:

[0080] At least one data element position in the three-dimensional model table is triggered, and a plurality of data elements to be selected are displayed in the form of three-dimensional units in an area of ​​the virtual environment that meets the display requirements of the three-dimensional units.

[0081] like Figures 3 to 6As shown, each data element and its related information are displayed in the form of a three-dimensional unit. A three-dimensional unit refers to a three-dimensional geometric body, including but not limited to a cube, a cuboid, a regular triangular pyramid, a hexagonal cube, a rhombus cube, etc., and even a special-shaped cube, etc.

[0082] For example, a plurality of three-dimensional units can form a display structure of a magic cube. For example, a plurality of three-dimensional units can form a display structure of a special-shaped imitation.

[0083] For another example, each face of a three-dimensional hexahedral model is composed of several hexahedral solid units. Each hexahedral solid unit is also composed of several hexahedral sub-solid units, so that users can select and view more data elements. This layered arrangement can even form a ring-shaped honeycomb structure, so that users can select and specify data element areas and perform regular data element configuration and management.

[0084] For another example, a 3D model is a hollow model formed by a plurality of stereo units, so that the user's field of vision is to view the data elements of the 3D model from the hollow area. The user only needs to rotate and move the inner display surface of the 3D model to view and configure more data elements of unknown data element positions.

[0085] That is, the display surface of the three-dimensional model of the present invention is not a single-level three-dimensional unit, but can also be constructed by three-dimensional units of several levels to enable users to regularly configure and verify data.

[0086] That is, the three-dimensional model of the present invention can be divided into three-dimensional units of different specifications, and the user can select different sub-three-dimensional units to perform data configuration and management.

[0087] Preferably, when the VR operating handle is driven, the field of view distance, size and / or clarity of the three-dimensional model, two-dimensional model and / or stereoscopic unit can be adjusted.

[0088] Preferably, the method for fusing two-dimensional and three-dimensional forms further includes:

[0089] The stereo unit is selected by a VR operating handle and dragged to a designated data element position in the three-dimensional model table. And / or, visible information related to the data element is configured on a visible surface of the stereo unit.

[0090] For example, the data elements of the two-dimensional model are selected through the VR operating handle and displayed as three-dimensional units. The three-dimensional unit is kept selected and dragged into the slot of the three-dimensional model. Each time a slot is filled, the user can know the position of the data element configuration and the degree of completion. The dragging method is intuitive and simple, which simplifies the complexity of the user implementing data configuration through the operating handle 200 and reduces the difficulty of operation. Preferably, the dragging action can also be replaced by other methods.

[0091] Preferably, the method for fusing two-dimensional and three-dimensional forms further includes:

[0092] When the three-dimensional model table is driven to rotate by the VR operating handle, the three-dimensional model table can display the filling status of the faces and data elements of each dimension in an all-round rotating manner.

[0093] When the block slots of one face of the 3D model table are filled with stereo units, the user can rotate the 3D model 360 degrees to display other faces and configure them.

[0094] Based on the selection of the VR operating handle, the selected surface of the three-dimensional model table is displayed in the user's field of view.

[0095] By rotating the three-dimensional model table, the selection method and selection time of the data configuration position are simplified, the display of invalid data element positions is reduced, and the possibility of data configuration errors is reduced, thereby saving configuration time and improving the accuracy of data configuration. It also increases the fun of data configuration, improves the user's working mental state, and enhances the user's work happiness.

[0096] Preferably, when at least two users perform collaborative work in a virtual reality environment, as described below.

[0097] The first user A and the second user B wear a VR display device and a VR handle operation device respectively to enter the VR scene. The second user B can see the data elements in the three-dimensional space and all operations of the first user A in the VR scene, and can also see the lines representing the links.

[0098] When the first user establishes a link between the first data element in the first form and the second data element in the second form, in response to the second user B's confirmation operation on the link relationship, the link relationship is locked and displayed in a manner in which the link display feature changes. The link display feature changes include color changes, arrow changes, line type changes, etc.

[0099] Preferably, when the first user establishes a link between the first data element in the first form and the second data element in the second form, the second user corrects the established link based on the set permissions.

[0100] In response to clicking and / or touching a link, properties of the link can be displayed and moved in three-dimensional space.

[0101] In response to the operation of the VR handle operating device, the form in the three-dimensional space can be moved from a long distance within the user's field of view to a close distance within the field of view. During the form movement process, the links between the data elements and the data element positions are adaptively changed based on the movement of the form in a manner that maintains the relationship unchanged.

[0102] Preferably, the first user A and the second user B respectively wear a VR display device and a VR handle operating device to enter different VR scenes to perform link operations on the same form in a collaborative manner.

[0103] When a first link set by the first user A to the first data element is the same as a second link set by the second user to the first data element, the link is displayed with the first display feature.

[0104] When the first link set by the first user A for the first data element is different from the second link set by the second user for the first data element, or when only one of them sets the link for the first data element, the link is displayed with the second display feature. The display feature includes color, arrow, line type, etc. Such a setting is conducive to multiple users working in collaboration to perform link operations and check the data elements of the form at the same time. Preferably, the first user A and the second user B working in collaboration can see each other.

[0105] It should be noted that the above-mentioned specific embodiments are exemplary, and those skilled in the art can come up with various solutions inspired by the disclosure of the present invention, and these solutions also belong to the disclosure scope of the present invention and fall within the protection scope of the present invention. Those skilled in the art should understand that the present invention specification and its drawings are illustrative and do not constitute a limitation on the claims. The scope of protection of the present invention is defined by the claims and their equivalents. The present invention specification contains multiple inventive concepts, such as "preferably", "according to a preferred embodiment" or "optionally", all of which indicate that the corresponding paragraph discloses an independent concept, and the applicant reserves the right to file a divisional application based on each inventive concept.

Claims

1. A two-dimensional and three-dimensional fusion form processing method, characterized in that: The method at least comprises: Displaying at least one three-dimensional model including a plurality of stereoscopic units when connected to a VR display device, wherein each data element of the three-dimensional model and related information thereof are displayed in the form of a stereoscopic unit; a form recording attribute information of the three-dimensional model is set on a server, and the VR display device is connected to the server by wire or wirelessly; In a virtual reality environment, a stereoscopic unit is selected by applying a hand action on the stereoscopic unit of the three-dimensional model or a driving action on a surface defined area of ​​the three-dimensional model, and the selected stereoscopic unit disappears; a two-dimensional model corresponding to the selected stereoscopic unit is displayed in a visible manner in an area that meets the display requirements of the two-dimensional model, thereby switching the display mode of the three-dimensional model from three-dimensional to two-dimensional to form a two-dimensional model linked with the corresponding three-dimensional model, or switching the display mode of the two-dimensional model from two-dimensional to three-dimensional to form a three-dimensional model by applying a driving action to the two-dimensional model, and when the display part of the three-dimensional model changes, the corresponding two-dimensional model with a linked relationship also changes accordingly. The two-dimensional model is displayed in at least one area that meets the display requirements of the two-dimensional model within the same virtual reality scene, and the area that meets the display requirements of the two-dimensional model is selected from the virtual reality environment in a way that can be distinguished from the virtual display scene at least in terms of color, brightness and / or contrast.

2. The two-dimensional and three-dimensional fusion form processing method according to claim 1 is characterized in that: The area that meets the two-dimensional model display requirements is selected in a suspended manner and in a manner that it does not at least partially overlap with any three-dimensional model within the field of view of the virtual reality user.

3. The two-dimensional and three-dimensional fusion form processing method according to claim 1 is characterized in that: The driving action at least includes: When the three-dimensional model is triggered by a specific action, the display mode of the three-dimensional model is switched from a three-dimensional model to a two-dimensional model; When the three-dimensional model is triggered by a specific language, the display mode of the three-dimensional model is switched from a three-dimensional model to a two-dimensional model; and / or When the three-dimensional model is triggered by a specific information instruction, the display mode of the three-dimensional model is switched from a three-dimensional model to a two-dimensional model.

4. The two-dimensional and three-dimensional fusion form processing method according to claim 1 is characterized in that: The method further comprises: The three-dimensional model at least includes a three-dimensional model table, The three-dimensional model table includes at least a plurality of data element positions arranged and / or spliced ​​along at least three dimensions and to be filled in the three-dimensional unit, The data element position is presented in the form of a slot, The three-dimensional unit has at least a data element.

5. The two-dimensional and three-dimensional fusion form processing method according to claim 4 is characterized in that: The method further comprises: Triggering at least one data element position in the three-dimensional model table, The data elements to be selected are displayed in the form of stereoscopic units in an area of ​​the virtual environment that meets the display requirements of the stereoscopic units.

6. The two-dimensional and three-dimensional fusion form processing method according to claim 4 is characterized in that: The method further comprises: Select the stereo unit through the VR operating handle and drag it to the specified data element position in the three-dimensional model table, and / or Visible information related to the data elements of the visible surface of the stereo unit is configured.

7. The two-dimensional and three-dimensional fusion form processing method according to claim 6 is characterized in that: The method further comprises: When the three-dimensional model table is driven to rotate by the VR operating handle, the three-dimensional model table can display the filling status of the faces and data elements of each dimension in an all-round rotating manner. Based on the selection of the VR operating handle, the selected surface of the three-dimensional model table is displayed in the user's field of view.

8. The two-dimensional and three-dimensional fusion form processing method according to claim 6 is characterized in that: When driven by a VR operating handle, the field of view distance, size and / or clarity of the three-dimensional model, two-dimensional model and / or stereo unit can be adjusted.

9. A two-dimensional and three-dimensional fusion form processing system, comprising at least a server, characterized in that: The server is configured to: When a connection is established with a VR display device, the two-dimensional and three-dimensional fusion form processing method as described in any one of claims 1 to 8 can be executed.

Images