A vr display device and server configured to configure a form

By using VR controllers to link data elements in virtual reality scenes and utilizing servers to determine the link direction, this solves the problems of VR panoramic video display devices adapting to different head shapes and cumbersome data association, enabling automatic data updates and management, and improving user experience and efficiency.

CN119781624BActive Publication Date: 2026-04-10DMS CORP
View PDF 4 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-07-26
Publication Date
2026-04-10

AI Technical Summary

Technical Problem

Existing VR panoramic video display devices cannot meet the needs of users with different head shapes, and the process of filling and associating data forms in three-dimensional virtual space is cumbersome, making it difficult to quickly update and manage data.

Method used

By using a VR controller to select a data element location in a virtual reality scene, and linking it to the target location based on preset actions, the server determines the link direction according to the direction and sequence of actions, and uses arrows to represent data relationships, thereby achieving automatic data updates and management.

Benefits of technology

It simplifies the data configuration process, reduces the workload for users, improves the speed and accuracy of data association, adapts to the needs of users with various head shapes, and realizes automatic data management and updates.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119781624B_ABST
    Figure CN119781624B_ABST
Patent Text Reader

Abstract

The application relates to a VR display device and a server for configuring a form, wherein the VR display device is connected with the server, a plurality of virtual form images are generated and displayed in a virtual space displayed by the VR display device; in the case that at least one data element in a first data element position in a first form is in a selected state, the VR display device links the data element to a second data element position in a second form for setting the data element through an identifier representing the link in response to a linking direction of the first form and the second form determined by a preset action direction and / or an action sequence of the server; and the identifier can set a unique display rule based on different links, link attributes and link directions. By setting the linking direction, whether the data element is passively updated or actively updated can be changed, the disadvantage of frequent manual data updating by a user is reduced, and automatic management and automatic updating of data are realized.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The original basis of the divisional application is a patent application with application number 2022108885402, application date 2022.07.26, and invention name "Form configuration method and system based on VR". TECHNICAL FIELD

[0002] The present application relates to the field of virtual reality technology, and in particular to a VR display device for configuring forms and a server. BACKGROUND

[0003] VR is the abbreviation of Virtual Reality, a new practical technology developed in the 20th century. Its basic implementation is to simulate a virtual environment by computer to give people a sense of environmental immersion.

[0004] However, the existing virtual display technology has at least three defects. First, the use effect of the existing part of the VR panoramic video display device is poor. The main reason is that there are many types of user head shapes, and the structure of the VR panoramic video display device is single, so that the display device cannot meet the use of users with different head shapes, thereby reducing the user's experience of using the display device, that is, reducing the use efficiency of the display device. Therefore, a new VR panoramic video display device capable of being used by users with multiple head shapes is needed.

[0005] Second, with the country's overall strategic guideline of digitalization and wisdom, as well as the rapid development of the Internet industry, combined with the need for huge manpower, material resources and financial resources in the traditional offline work mode, various industries have changed from offline mode to online mode, which has become the overall trend of the current and future. Based on the judgment of the future, various software systems have sprung up, and have gradually changed from customized system development to configurable low-code and zero-code system development. The operation of the current configuration system is directly on the computer, and there is no existing technology to present the system configuration module, such as forms, in a three-dimensional mode to realize configuration.

[0006] Third, when performing large project data management, a project data can be derived from several hundred projects, which makes the project data management need to view several hundred tables. The area of the display screen in reality is limited, and it is impossible to simultaneously present the data of several tens of tables, not to mention several hundred tables. Therefore, in the prior art, users use virtual reality technology to present data tables, graphics and / or other information of the project in a three-dimensional virtual space. The project information can be set at any position in the virtual environment, such as in the air, on the ground, on a device, etc., greatly increasing the display space and display area of the information content. However, the project chart information display in the three-dimensional virtual space still has the defect that the process of filling the data in one form into the target form is tedious, and the relationship between the data is more, and it is difficult to quickly complete the association and update of the data only by the user's common sense and manual operation, and the user's workload is not reduced.

[0007] Therefore, how to provide a VR panoramic video display device that can meet the needs of various head shapes of the public, and at the same time, use a virtual reality scene to associate the data of several hundred icons in a simple and fast way and reduce the workload of the user, is a technical problem that the existing VR panoramic video display device has not solved.

[0008] For example, CN108401182A discloses a VR panoramic video display method, the method: after the VR display terminal receives the picture display instruction, the user viewing direction and the focus point direction are determined; the viewing direction is reported to the VR server; the VR server calculates the area corresponding to the viewing direction in the corresponding rectangular picture; the picture is obtained and transmitted to the VR display terminal; the VR display terminal determines the first area corresponding to the focus point direction in the picture according to the focus point direction; the first area of the picture is enhanced, and the other areas are virtualized; the processed picture is rendered into an arc-shaped picture of the corresponding direction, the second area that the user can view in the arc-shaped picture is calculated, the first picture of the second area is obtained, and the first picture is displayed. This invention does not mention any structure improvement that is more suitable for the public's multiple head shapes, nor does it involve the fast setting of the data association relationship of several project forms, so this invention cannot solve the technical problems of the present invention.

[0009] For example, CN110599600 A discloses a method for automatically converting a multi-dimensional visualization model of data, including static generation and dynamic generation. The static generation process is as follows: importing a static table data file generated by a user, obtaining multi-dimensional data columns by standardized analysis, mapping the multi-dimensional data columns to corresponding three-dimensional model parameters, and automatically generating a corresponding three-dimensional chart model. The dynamic generation process is as follows: a program automatically generates a three-dimensional dynamic chart model; writing parameter fields that need to be displayed in real time in the dynamic chart model into a data interface to obtain corresponding multi-dimensional data columns; setting appearance attributes and VR interaction functions of the three-dimensional dynamic chart model; exporting a three-dimensional chart file with complete functions; and importing the three-dimensional chart file into a 3D interactive application. The application is used for multi-dimensional display of data and has convenient 3D interaction functions, and can be used for immersive experience content such as virtual reality, augmented reality and the like. However, the application only mentions how to map and convert two-dimensional table data and three-dimensional model parameters, and does not mention how to simply and quickly establish a visible correlation between data without causing data confusion when facing hundreds of data forms. Therefore, the application does not solve the technical problems of the present application.

[0010] CN111176442 A discloses an interactive government service system and method based on VR virtual reality technology, including a virtual reality head-mounted display device and an interactive virtual reality government service system based on cloud AI service. The virtual reality head-mounted display device integrates a display, a camera, a sound pickup device and a headset. The device communicates with the back-end cloud AI service through a 5G and WIFI communication module. The interactive virtual reality government service platform based on cloud AI service completes data interaction, and the interactive virtual reality government service system based on cloud AI service integrates an image recognition module, a voice recognition module and an interactive virtual reality government service. According to the deep learning technology, real-time images collected by the camera are analyzed to complete face recognition, character recognition, ID photo recognition and gesture recognition. The application does not mention any structure improvement that is more suitable for the public's multi-type head shape, and does not involve quick setting of the data correlation of several project forms, so the application cannot solve the technical problems of the present application.

[0011] In addition, on the one hand, there are differences in the understanding of those skilled in the art, and on the other hand, the applicant has studied a large number of literatures and patents when making the present application, but due to the limited space, all the details and contents are not listed in detail. However, this does not mean that the present application does not have these characteristics of the prior art, on the contrary, the present application has all the characteristics of the prior art, and the applicant reserves the right to add relevant prior art in the background art. SUMMARY

[0012] When performing large project data management, a project data can be derived from hundreds of projects, which makes the project data management need to view hundreds of tables. The area of the display screen in reality is limited, and it is impossible to simultaneously present the data of dozens of tables, not to mention hundreds of tables. Therefore, in the prior art, users use virtual reality technology to present data tables, graphics and / or other information of the project in a three-dimensional virtual space. The project information can be set at any position in the virtual environment, such as in the air, on the ground or on a device, which greatly increases the display space and display area of the information content. However, the project chart information display in the three-dimensional virtual space still has the defect that the process of filling the data in a form into a target form is tedious, the relationship between the data is more, and it is difficult to quickly complete the association and update of the data only by the common sense of the user and manual operation, and the workload of the user is not reduced.

[0013] Therefore, how to provide a VR panoramic video display device capable of meeting various head shapes of the public, and simultaneously associating hundreds of icon data in a simple and fast manner by using a virtual reality scene and reducing the workload of the user, is a technical problem that the existing VR panoramic video display device has not solved.

[0014] In view of the deficiencies of the prior art, the present application provides a form configuration method based on VR, which at least comprises:

[0015] Aiming at and selecting at least one data element in a first data element position in a first form by using a VR operation handle;

[0016] The selected state of the VR operation handle to the data element in the first form is maintained, and the data element is linked to a second data element position for setting a data element in a second form based on a preset action.

[0017] Preferably, in response to the performance of the preset action, the linking direction of the first form and the second form is determined by a server based on the action direction and / or action sequence of the preset action, and the linking direction can determine the dependent relationship of data update.

[0018] The present application determines the linking direction of the first form and the second form based on the preset action of the VR operation handle, especially the linking direction of the first data element position and the second data element position, to realize the update of the data element according to the linking action, thereby reducing the workload of the user in data configuration. The linking action can synchronize the update of attributes such as personnel, time and permission, thereby reducing the delay problem of the user in updating the form and avoiding the delay defect of the information.

[0019] Preferably, the method further comprises:

[0020] a link action of the link, the link action at least including referencing, filling, driving and / or maintaining;

[0021] when the link direction of the first form and the second form is determined,

[0022] when the link of the first form and the second form is a positive link, a first data element position in the first form is a driving party, and a second data element position in the second form is a driven party,

[0023] the driving party applies a link action to the driven party based on the link.

[0024] Preferably, the method further comprises:

[0025] establishing attribute information of the link,

[0026] the attribute information of the link at least including personnel, time and / or permission.

[0027] The present application determines the driving party and the driven party by setting the link direction, so that the update of the data elements in the first form and the second form is clear and confusion does not occur.

[0028] In the present application, there can be a third form, a fourth form and several forms. In a virtual reality scene, a data element of a form can simultaneously establish a positive link with data element positions of multiple forms, and a data element position of a form can also establish a reverse link with data elements of several forms. In the present application, a three-dimensional solid line with an arrow is used as an identifier, and the arrow represents the direction of data being linked and referenced, which is convenient for intuitive understanding of users.

[0029] Preferably, the method further comprises:

[0030] when the data element of the selected first data element position in the first form is positively linked to the second data element position in the second form, the second data element position in the second form is updated along with the data element of the selected first data element position in the first form. The link between the first data element and the second data element position is represented by a three-dimensional space line visible in the VR environment.

[0031] Preferably, the method further comprises:

[0032] when the first data element position of the selected data element in the first form is reversely linked to another data element in the second form, the other data element in the second form is updated along with the first data element position of the selected data element in the first form.

[0033] Preferably, the method further comprises:

[0034] When the first data element position in the first form is bidirectionally linked to the second data element position in the second form, the data elements corresponding to the first data element positions bidirectionally linked to each other in the first form and the second data element position in the second form are updated.

[0035] As described above, based on the link setting, the data element of the second form can be updated based on the change of the selected data element position in the first form, can be updated based on the selected data element, and can be updated in reverse based on the reverse link, thereby providing the user with a convenient method of updating multiple data elements, and enabling the user to conveniently perform data configuration and data management.

[0036] In the present application, the reverse link is defined with respect to the forward link. When the forward link is to reference the first data element in the first form to the second data element position in the second form, the reverse link refers to the reference of the data information from the second form or other forms to a certain data position in the first form.

[0037] For example, the first form stores personal scores. The second form stores the scores of the whole class. The personal score elements in several first forms are forward linked to the second form to obtain the score ranking data element. The ranking data element in the second form is reverse linked to the "class ranking" position in the corresponding several first forms. The first form displays the personal score data element and the corresponding class ranking data element.

[0038] Preferably, the preset action at least includes dragging, selecting and / or clicking, and the preset action is preferably dragging. The present application preferably uses the dragging action, so that the user can quickly realize the setting of the link by operating the VR operation handle, and reduce the difficulty of the action.

[0039] The present application also provides a VR-based form configuration system, which at least includes:

[0040] The VR display device is used to aim at and select at least one data element of the first data element position in the first form by using the VR operation handle; the selected state of the VR operation handle to the data element in the first form is maintained, and the data element is linked to the second data element position in the second form for setting the data element based on the preset action; the link between the first data element and the second data element position is represented by a three-dimensional space line visible in the VR environment, so that the user can see the relationship between the data elements;

[0041] a server configured to determine a linking direction between the first form and the second form based on an action direction and / or an action sequence of the preset action in response to performance of the preset action, the linking direction being capable of determining a dependency relationship of data update,

[0042] The VR display device is connected with the server.

[0043] Preferably, the server is further configured to:

[0044] when the data element in the selected first data element position in the first form is forward linked to a second data element position in the second form, the second data element position in the second form is updated along with the data element in the selected first data element position in the first form;

[0045] when the first data element position of the selected data element in the first form is reverse linked to another data element in the second form, the another data element in the second form is updated along with the first data element position of the selected data element in the first form; and / or

[0046] when the first data element position in the first form is bidirectionally linked to the second data element position in the second form, the second data element position in the second form and the data elements corresponding to the first data element positions bidirectionally linked to each other in the first form are updated with each other.

[0047] when the data element in the second data element position in the second form is forward linked to a third data element position in at least one third form, the third data element position in the third form is updated along with the data element in the selected first data element position in the first form.

[0048] The VR-based form configuration system provided by the present application enables a user to intuitively view the links between data of different forms in a virtual reality scene, directly know the relationship between data elements, and also avoid frequent data update operations after setting the links. The user can monitor the update of a small amount of data elements based on the virtual reality device. BRIEF DESCRIPTION OF DRAWINGS

[0049] Figure 1 is a schematic diagram of a three-dimensional form configuration method of a preferred embodiment provided by the present application;

[0050] Figure 2 is a simplified structural schematic diagram of a VR panoramic video display device of a preferred embodiment provided by the present application;

[0051] Figure 3This is a flowchart of a preferred embodiment of the form configuration method provided by the present invention;

[0052] Figure 4 This is a schematic diagram of a three-dimensional link in a two-dimensional form in three-dimensional space, provided by the present invention.

[0053] List of reference numerals

[0054] 1: Display device body; 2: First groove; 3: Irregular block; 4: First soft pad; 5: Bolt rod; 6: Rectangular hole; 7: Limiting block; 8: Second soft pad; 9: Elastic band; 10: Mounting hole; 14: Rectangular block; 15: Cylindrical hole. Detailed Implementation

[0055] The following is a detailed explanation with reference to the accompanying drawings.

[0056] This invention provides a VR-based form configuration method and system.

[0057] like Figure 2 As shown, the VR display device of the present invention includes a display device body 1. First grooves 2 are formed on both sides of the inner wall of the display device body 1. Irregularly shaped blocks 3 are disposed inside each of the two first grooves 2. First soft pads 4 are bonded to opposite sides of the two irregularly shaped blocks 3. Second grooves are formed on opposite sides of the two irregularly shaped blocks 4. Bolt rods 5 are threaded through both sides of the display device body 1. Two rectangular holes 6 are formed on both sides of the display device body 1. A limit block 7 is slidably connected inside each rectangular hole 6. Second soft pads 8 are bonded to the inner wall of the display device body 1. Two cylindrical holes 15 are formed on the inner wall of the second soft pads 8. Two rectangular blocks 14 are fixed to one side of the display device body 1. An elastic band 9 is disposed between the same side of the two rectangular blocks 14.

[0058] Preferably, the opposite ends of the two bolt rods 5 are rotatably connected to the inside of the two second grooves via bearings.

[0059] Preferably, the four limiting blocks 7 are divided into two groups, and the opposite sides of the two groups of limiting blocks 7 are fixed to the opposite sides of the two irregular blocks 3 respectively.

[0060] Preferably, the top of the display device body 1 has two symmetrical mounting holes 10, and the inner wall of the display device body 1 is provided with an arc-shaped dustproof plate.

[0061] Preferably, the top of the arc-shaped dustproof plate is fixed with two symmetrical connecting blocks, and the top of each connecting block is threaded with a fixing bolt.

[0062] Preferably, the bottom ends of the two fixing bolts are respectively installed inside the two mounting holes 10.

[0063] Compared with the prior art, the VR display device has the advantages and positive effects that:

[0064] Firstly, under the cooperation of the bolt rod 5, the first groove 2, the second groove, the rectangular hole 6 and the limiting block 7, the special-shaped block 3 can be finely adjusted and moved, so that the situation that the display device body 1 cannot meet different head shapes of users is effectively solved, and the use efficiency of the VR display device is effectively improved. Under the cooperation of the first soft pad 4 and the second soft pad 8, the comfort of the user during use can be improved. Under the cooperation of the limiting block 7 and the rectangular hole 6, the horizontal movement of the special-shaped block 3 can be ensured, and under the action of the elastic band 9, the user can conveniently wear the display device body 1.

[0065] Secondly, under the action of the arc-shaped dustproof plate, dust can be prevented from penetrating from the inside of the cylindrical hole 15, and the situation that dust is attached to the lens of the display device body 1 is effectively avoided. Under the cooperation of the connecting block, the mounting hole 10 and the fixing bolt, the arc-shaped dustproof plate can be prevented from moving.

[0066] The VR display device is connected with a server to form a form configuration system based on VR, and is used for realizing a form configuration method based on VR.

[0067] The server can also be replaced by an electronic device capable of running the VR form configuration method of the present application, such as a computer, a server group, a special integrated chip, etc.

[0068] The VR display device and the server are connected in a wired and / or wireless manner, and after being normally used, the communication between the VR device and the VR operation handle is maintained, so that the VR operation handle can be operated.

[0069] The server puts a plurality of form image information into the VR display device. The VR display device generates and displays a plurality of virtual form images.

[0070] As shown in Figure 1 and Figure 3 , the user can operate the VR operation handle to perform the following operations.

[0071] S1: using the VR operation handle to aim at and select at least one data element in a first data element position in a first form.

[0072] S2: maintaining the selected state of the VR operation handle on the data element in the first form and linking the data element to a second data element position in a second form for setting a data element based on a preset action.

[0073] S3: in response to the preset action, the server determines the linking direction of the first form and the second form based on the action direction and / or action sequence of the preset action, wherein the linking direction determines the dependency of data update.

[0074] For example, in the virtual space displayed by the VR display device, several form images can be presented at any position in the virtual space, such as floating in the air, being displayed in any posture on a wall, a table, a bed, the ground, a ceiling plane, or any position in a three-dimensional space.

[0075] The form can belong to several projects, and there are several data elements in the form. The position of the form can be moved to any position by the user operating the VR operation handle. The display section of the form, the size of the data element, and the like can be adjusted by the user operating the VR operation handle.

[0076] The user uses the VR operation handle to aim at and select at least one data element A at a first data element position in the first form. The user maintains the selected state of the VR operation handle on the data element in the first form, and then links the data element A to a second data element position for setting a data element in a second form based on a preset action, such as a drag action.

[0077] Preferably, the preset action at least includes dragging, selecting, and / or clicking. The preset action is preferably dragging.

[0078] When the linking of the data element is set, the server determines the linking direction of the first form and the second form based on the action direction and / or action sequence of the preset action in response to the preset action. The linking direction determines the dependency of data update. For example, the linking and the linking direction are represented by visible lines with arrow directions, so as to determine the linking action between the two forms and the change and update relationship of the data element.

[0079] By setting the linking direction, it can be determined whether the data element is passively updated or actively updated, which reduces the disadvantage of frequent manual data update by the user and realizes automatic management and automatic update of the data.

[0080] Preferably, in the virtual display space, the linking of the present application is displayed in a visible manner, or can not be displayed. Alternatively, the relationship of the linking is displayed in a visible manner in response to the request of the user. For example, the linking can be a light ray with color, the light ray can be continuous or discontinuous, or the light ray has a set display rule.

[0081] After the link setting is completed, the data element A and the second data element position can display an identifier representing the link. The identifier is preferably a visible line and / or light and a combination thereof. The identifier can also be other identifiers that are not light. Preferably, the identifier is more conducive to intuitively understanding the link relationship between the data elements of the two forms. The link of the present application is Figure 1 and Figure 4 The three-dimensional link line shown is one of the identifiers.

[0082] Preferably, the line type of the link identifier can set its unique display rules based on its link action, linked attribute information, and different link directions. The display rules at least include the continuity of the line, the type of the line, the light emission rule, the color change rule, and the like, and all combinations thereof.

[0083] Preferably, the link action of the link is set. The link action at least includes reference, filling, driving, and / or holding.

[0084] The link action of the link can be preset or changed based on the user's selection. The link action of the present application refers to the action applied by the data element A as the acting party to the data of the second data element position as the receiving party, so that the data element B of the second data element position holds an action relationship with the data element A. The acting party applies the link action to the receiving party based on the link.

[0085] For example, the link of the data element B and the data element A is set as: the data element B references the data element A, and the data element A is the acting party. When the data element A changes, the data element B implements a synchronous change or a delayed change based on the reference action to achieve the update of the data element.

[0086] When the link direction of the first form and the second form is determined, in the case of a positive link between the first form and the second form, the first data element position in the first form is the acting party, and the second data element position in the second form is the receiving party. The link of the data element B and the data element A is set as: the data element B = the data element , and the data element A is the acting party. When the data element A changes, the data element B implements a synchronous change or a delayed change based on the driving action to achieve the update of the data element B.

[0087] For another example, the link of the data element B and the data element A is set as: the data element B references the data element A and is in a holding state, and the data element A is the acting party. When the data element A changes, the data element B remains in the holding state based on the holding action and does not change the data.

[0088] For example, the second data element position D of the second form is linked with the data element A, and the data element A fills the second data element position D. When the data element A changes, the data element B in the second data element position D changes based on the filling action.

[0089] Preferably, the setting of the link further comprises establishing attribute information of the link. The attribute information of the link comprises at least personnel information, time information and / or permission information.

[0090] The personnel information comprises at least personal information, position information, work-related information, and even the information of the user who sets the link. Preferably, the visible identifier of the link can be set with different colors, brightness and / or line rules based on the different users who create it.

[0091] The time information is, for example, the time information when the link is created or modified, and the implementation time information of the link action. The implementation time information of the link action comprises at least real-time, delay and no action. The duration of the delay is set by the user.

[0092] The permission information comprises permission levels. When the permission level of the user is higher than the set permission level of the link, the link can be modified and re-set by the user. Otherwise, the user cannot modify or re-set the link.

[0093] Preferably, the method of the present application further comprises:

[0094] S4: When the data element of the selected first data element position in the first form is linked forward to the second data element position in the second form, the second data element position in the second form is updated with the data element of the selected first data element position in the first form.

[0095] Preferably, the method of the present application further comprises:

[0096] S5: When the selected data element of the first data element position in the first form is linked backward to another data element in the second form, the other data element in the second form is updated with the selected data element of the first data element position in the first form.

[0097] Preferably, the method of the present application further comprises:

[0098] S6: When the first data element position in the first form is bi-directionally linked to the second data element position in the second form, the data elements corresponding to the second data element position in the second form and the first data element position in the first form which are bi-directionally linked to each other are updated with each other. When the data element in the second data element position in the second form is forwardly linked to the third data element position in at least one third form, the third data element position in the third form is updated with the data element of the selected first data element position in the first form.

[0099] The above steps S4-S6 can realize the quick setting and management of data configuration of different forms or in the same form by the user, can realize regional data linking and data updating, can realize one-to-one linking between data elements and data updating, and can realize mutual change and updating of bi-directional linking, thereby greatly reducing the steps of data management such as moving, copying, pasting, calculating, checking and the like of the user, and reducing the error probability of data management. Furthermore, in the present application, the user can quickly understand and clearly know the relationship between data elements and the relationship between forms by simply linking the data elements between forms, thereby improving the speed and accuracy of data checking and the management ability of the user on project management.

[0100] The exemplary application scenarios of the present application are as follows.

[0101] Example 1: single user scenario

[0102] The user A wears a VR display device and a VR handle operation device to enter a VR scene. The user aims at and selects at least one data element of the first data element position in the first form through the VR operation handle; the user clicks the second data element position for setting the data element in the second form while keeping the selected state of the VR operation handle on the data element in the first form, so that the data element and the second data element position are linked through a visible three-dimensional line.

[0103] Alternatively, the user clicks the second data element in the second form while keeping the selected state of the VR operation handle on the first data element position in the first form, so that the second data element and the first data element position are linked through a visible three-dimensional line.

[0104] The three-dimensional line can be displayed in various colors, and each color can be related to the linking relationship of the data element. For example, red represents the same data relationship, green represents data correlation but not the same, and pink represents data relationship after checking, and purple represents data relationship with abnormality.

[0105] Preferably, the three-dimensional line can also display a direction, so that the user can quickly understand the relationship between the data element and the data element position and the source.

[0106] When the user makes a change to the first data element, the first data element is changed synchronously or asynchronously with the second data element position.

[0107] Example 2: Multi-user collaborative use scenario

[0108] The first user A and the second user B respectively wear a VR display device and a VR handle operation device to enter a VR scene. The second user B can see the data elements in the three-dimensional space and all operations of the first user A in the VR scene, and can also see the line representing the link.

[0109] In the case where the first user establishes a link between the first data element in the first form and the second data element position in the second form, in response to the confirmation operation of the second user B on the link relationship, the link relationship is locked and displayed in a way that the link display feature changes. The link display feature change includes color change, arrow change, line type change, etc.

[0110] Preferably, in the case where the first user establishes a link between the first data element in the first form and the second data element position in the second form, the second user corrects the established link based on the set permission.

[0111] In response to the click and / or touch on the link, the attribute of the link can be displayed in the three-dimensional space and moved.

[0112] In response to the operation of the VR handle operation device, the form of the three-dimensional space can be moved from a long distance in the user's field of view to a short distance in the field of view. In the process of moving the form, the link between the data element and the data element position is adapted to change in a way that the relationship is maintained based on the movement of the form.

[0113] Preferably, the first user A and the second user B respectively wear a VR display device and a VR handle operation device to enter different VR scenes to collaboratively operate the same form.

[0114] When the first link set by the first user A on the first data element is the same as the second link set by the second user on the first data element, the link is displayed in the first display feature.

[0115] When the first link set by the first user A to the first data element is different from the second link set by the second user to the first data element, or only one of them sets a link to the first data element, the link is displayed with a second display feature. The display feature includes color, arrow, line type, etc. In this way, it is beneficial for multiple users working together to simultaneously operate and check the link to the data element of the form. Preferably, the first user A and the second user B working together can see each other.

[0116] It should be noted that the above specific embodiments are exemplary, and those skilled in the art can come up with various solutions under the inspiration of the disclosure of the present application, and these solutions also belong to the disclosed range of the present application and fall within the protection scope of the present application. Those skilled in the art should understand that the specification and drawings of the present application are illustrative and do not constitute a limitation on the claims. The protection scope of the present application is defined by the claims and their equivalents. The specification of the present application contains multiple inventive concepts, such as "preferably", "according to a preferred embodiment", which means that the corresponding paragraph discloses an independent concept, and the applicant reserves the right to file a divisional application according to each inventive concept.

Claims

1. A VR display device for configuring forms, connected with a server, characterized in that, a plurality of virtual form images are generated and displayed in a virtual space displayed by the VR display device; in a case where a VR operation handle keeps a selected state of a data element in a first form and links the data element to a second data element position in a second form for setting a data element based on a preset action, the VR display device links the data element to the second data element position in the second form for setting a data element through an identifier representing the link in response to a linking direction of the first form and the second form determined by an action direction and / or an action sequence of the preset action of the server; wherein the identifier of the link line type can set its display rule based on the link action, the attribute information of the link, and the different linking directions; the visible identifier can set different colors, brightness, and / or line rules based on the different users creating it; the link action refers to an action applied by the data element A as the acting party to the data of the second data element position as the acted party, so that the data element B of the second data element position keeps an action relationship with the data element A; the link and the linking direction are represented by a visible line with an arrow direction, thereby determining the link action between the two forms and the change of the data elements and their update relationship; the attribute information of the link includes personnel information, time information, and / or permission information. 2.The VR display device for configuring forms according to claim 1, characterized in that, the link action at least includes reference, filling, driving, and / or keeping; when the linking direction of the first form and the second form is determined, in a case where the link between the first form and the second form is a positive link, the first data element position in the first form is the acting party, and the second data element position in the second form is the acted party, the acting party applies the link action to the acted party based on the link. 3.The VR display device for configuring forms according to claim 2, characterized in that, when the data element of the selected first data element position in the first form is positively linked to the second data element position in the second form, the second data element position in the second form is updated along with the data element of the selected first data element position in the first form; the link between the first data element and the second data element position is represented by a three-dimensional space line visible in the VR environment. 4.The VR display device for configuring forms according to any one of claims 1-3, characterized in that, when the first data element position of the selected data element in the first form is reversely linked to another data element in the second form, the other data element in the second form is updated along with the first data element position of the selected data element in the first form. 5.The VR display device for configuring forms according to any one of claims 1-3, characterized in that, When the first data element position in the first form is bidirectionally linked to the second data element position in the second form, the data elements corresponding to the first data element position and the second data element position in the first form and the second form are updated with each other. 6.A server for configuring forms, connected to a VR display device in a wired and / or wireless manner, characterized in that, the server puts a plurality of form image information into the VR display device; in a case where a VR operation handle keeps a selected state of a data element in a first form and links the data element to a second data element position in a second form for setting a data element based on a preset action, the server determines a linking direction of the first form and the second form based on an action direction and / or an action sequence of the preset action; the VR display device links the data element to the second data element position in the second form for setting a data element through an identifier representing the link; in response to a request of a user, the server displays the linked relationship in a visible manner; wherein the identifier of the linked line type can set its display rule based on a linking action, attribute information of the link, and a different linking direction; the visible identifier can set different colors, brightness, and / or line rules based on different users creating the identifier; wherein the linking action refers to an action applied by a data element A as an acting party to a data of a second data element position as a receiving party, so that a data element B of the second data element position keeps an action relationship with the data element A; the link and the linking direction are represented by a visible line with an arrow direction, so as to determine the linking action between the two forms and the change of the data elements and their update relationship; the attribute information of the link includes personnel information, time information, and / or permission information.

7. The server for configuring a form according to claim 6, wherein, the server is configured to: when the data element of the selected first data element position in the first form is forwardly linked to the second data element position in the second form, the second data element position in the second form is updated with the data element of the selected first data element position in the first form; when the data element in the second data element position in the second form is forwardly linked to a third data element position in at least one third form, the third data element position in the third form is updated with the data element of the selected first data element position in the first form.

Citation Information

Patent Citations

  • VR (Virtual Reality) panoramic video picture display method and device and VR display terminal

    CN108401182A

  • Interactive government affair service system and method based on VR virtual reality technology

    CN111176442A

  • Linking visual properties of charts to cells within tables

    CN101971170A

  • Copy and paste in virtual reality environment

    CN110442460A