VR display device for configuration form and server

By using VR operation handles to link form data elements in virtual reality scenes in VR panoramic video display devices, the problem of user usage needs and data association updates is solved, and the automatic update and management of data is realized, and user experience and work efficiency are improved.

CN119781624AActive Publication Date: 2025-04-08DMS CORP
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202411628479.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2022-07-26
Publication Date
2025-04-08
Estimated Expiration
2042-07-26

AI Technical Summary

Technical Problem

The existing VR panoramic video display device cannot meet the user needs of different head types, and when a number of table data is associated and updated in the three-dimensional virtual space, the process is cumbersome and it is difficult to quickly complete the data association and update, which increases the user's workload.

Method used

The VR operation handle is used to aim and select the data elements in the form in a virtual reality scenario, and link the data elements to the location of the data elements in another form based on preset actions. The link direction between the forms is determined through the server to automatically update the data elements.

Benefits of technology

By simplifying the data association and update process, users' workload is reduced, data management efficiency and accuracy are improved, and data automatic management and automatic update are realized.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119781624A_ABST
    Figure CN119781624A_ABST
Patent Text Reader

Abstract

The invention relates to a VR display device for configuring a form and a server, the VR display device is connected with the server, and a plurality of virtual form images are generated and displayed in a virtual space displayed by the VR display device; under the condition that at least one data element of a first data element position in the first form is kept in a selected state, responding to a link direction of the first form and a second form determined by the server based on an action direction and / or an action sequence of a preset action; the VR display device links the data element to a second data element position used for setting the data element in a second form through an identifier representing the link; wherein the unique display rule of the identifier can be set based on different link actions, link attributes and link directions. By setting the link direction, whether the data elements are passively updated or actively updated can be changed, the defect that a user frequently and manually updates the data is reduced, and automatic management and automatic updating of the data are achieved.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The original basis of this divisional application is a patent application with application number (2022108885402), application date 2022.07.26, and invention name “A VR-based form configuration method and system”. Technical Field

[0002] The present invention relates to the field of virtual reality technology, and in particular to a VR display device and a server for configuring a form. Background Art

[0003] VR is the abbreviation of virtual reality technology, which is a new practical technology developed in the 20th century. Its basic implementation method is to simulate the virtual environment with a computer to give people a sense of environmental immersion.

[0004] However, the existing virtual display technology has at least three defects. First, the use effect of some existing VR panoramic video display devices is poor. The main reason is that there are many types of user head shapes, and the structure of VR panoramic video display devices is single, so that the display device cannot meet the needs of users with different head shapes, resulting in a reduced user experience of using the display device, that is, causing the use efficiency of the display device to decrease. Therefore, it is necessary to provide a new VR panoramic video display device that can be used by users with a variety of head shapes.

[0005] Second, with the country's overall strategic policy of digitalization and intelligence, as well as the rapid development of the Internet industry, and the fact that the traditional offline working model requires huge manpower, material and financial resources, all walks of life have changed from offline to online, which has become the overall trend at present and in the future. Based on the judgment of the future, various software systems have continued to emerge like bamboo shoots after a spring rain, and have gradually changed from customized system development to configurable low-code and zero-code system development. The current configuration system operation is performed directly on the computer, and there is no existing technology that can present the system configuration module, such as the form, in a three-dimensional stereoscopic mode to achieve configuration.

[0006] Third, when managing huge project data, a certain project data may come from hundreds of projects, which means that the project data management needs to view hundreds of tables. The area of ​​the display screen in reality is limited, and it is impossible to present data from dozens of tables at the same time, let alone hundreds of tables at the same time. Therefore, in the prior art, users use virtual reality technology to present data tables, graphics and / or other information of the project in a three-dimensional virtual space. Project information can be set in any position in the air, on the ground, on the device, etc. in the virtual environment, which greatly increases the display space and display area of ​​the information content. However, the defect of displaying project chart information in a three-dimensional virtual space is that the process of filling the data in a form into the target form is cumbersome, and there are many relationships between data and data. It is difficult to quickly complete the association and update of data by relying solely on the user's common sense and manual operation, and it does not reduce the user's workload.

[0007] Therefore, how to provide a VR panoramic video display device that can meet the needs of various head shapes of the general public, while using virtual reality scenes to associate the data of hundreds of icons in a simple and quick manner and reduce the user's workload, is a technical problem that has not been solved by existing VR panoramic video display devices.

[0008] For example, CN108401182 A discloses a method for displaying a VR panoramic video screen, the method being: after receiving a screen display instruction, the VR display terminal determines the user's viewing direction and the direction of the focus point; reports the viewing direction to the VR server; the VR server calculates the area corresponding to the viewing direction in the corresponding rectangular screen; obtains the screen and transmits it to the VR display terminal; the VR display terminal determines the first area corresponding to the focus point direction in the screen according to the focus point direction; enhances the first area of ​​the screen and blurs other areas; based on rendering the processed screen into an arc-shaped screen of the corresponding orientation, calculates the second area that the user can view in the arc-shaped screen, obtains the first screen of the second area, and displays the first screen. The invention does not mention any structural improvements that are more compatible with the public's various head shapes, nor does it involve the quick setting of data association relationships in several project forms. Therefore, the invention cannot solve the technical problem of the present invention.

[0009] For example, CN110599600 A discloses a method for automatically converting a multidimensional visualization model of data, including static generation and dynamic generation. The static generation process is: importing a static table data file generated by a user, obtaining a multidimensional data column through standardized parsing and mapping it to the corresponding three-dimensional model parameters, and automatically generating a corresponding three-dimensional chart model; the dynamic generation process is: the program automatically generates a three-dimensional dynamic chart model; the parameter fields that need to be displayed in real time in the dynamic chart model are written into the data interface to obtain the corresponding multidimensional data column; the appearance attributes and VR interactive functions of the three-dimensional dynamic chart model are set; the three-dimensional chart file with complete functions is exported; and the three-dimensional chart file is imported into a 3D interactive application. The invention is used for multi-dimensional display of data, and has a convenient 3D interactive function, which can be used for immersive experience content, such as virtual reality, augmented reality and other technologies. However, the invention only mentions how to map and transform two-dimensional table data and three-dimensional model parameters, and does not mention how to easily and quickly establish a visible association relationship between data without causing data confusion when facing hundreds of data forms. Therefore, the invention does not solve the technical problem of the present invention.

[0010] CN111176442 A discloses an interactive government service system and method based on VR virtual reality technology, including a virtual reality head-mounted display device and an interactive virtual reality government service system based on cloud AI services. The virtual reality head-mounted display device integrates a display, a camera, a microphone, and a headset. Communication is performed with the back-end cloud AI service through 5G and WIFI communication modules. The interactive virtual reality government service platform based on cloud AI services completes data interaction, and the interactive virtual reality government service system based on cloud AI services integrates an image recognition module, a voice recognition module, and an interactive virtual reality government service. The real-time image collected by the camera is analyzed according to deep learning technology to complete face recognition, text recognition, ID card face recognition, and gesture recognition. The invention also does not mention any structural improvements that are more compatible with the public's various head shapes, and does not involve the quick setting of data association relationships of several project forms. Therefore, the invention cannot solve the technical problems of the present invention.

[0011] In addition, on the one hand, there are differences in understanding among those skilled in the art; on the other hand, the applicant studied a large number of documents and patents when making the present invention, but due to space limitations, not all details and contents are listed in detail. However, this does not mean that the present invention does not have the characteristics of these prior arts. On the contrary, the present invention already has all the characteristics of the prior art, and the applicant reserves the right to add relevant prior art to the background technology. Summary of the invention

[0012] When managing huge project data, a certain project data may come from hundreds of projects, which means that the project data management needs to view hundreds of tables. The area of ​​the display screen in reality is limited, and it is impossible to present data from dozens of tables at the same time, let alone hundreds of tables at the same time. Therefore, in the prior art, users use virtual reality technology to present data tables, graphics and / or other information of the project in a three-dimensional virtual space. Project information can be set in any position in the air, on the ground, on the device, etc. in the virtual environment, which greatly increases the display space and display area of ​​the information content. However, the defect of displaying project chart information in a three-dimensional virtual space is that the process of filling the data in a form into the target form is cumbersome, and there are many relationships between data. It is difficult to quickly complete the association and update of data by relying solely on the user's common sense and manual operation, and it does not reduce the user's workload.

[0013] Therefore, how to provide a VR panoramic video display device that can meet the needs of various head shapes of the general public, while using virtual reality scenes to associate the data of hundreds of icons in a simple and quick manner and reduce the user's workload, is a technical problem that has not been solved by existing VR panoramic video display devices.

[0014] In view of the deficiencies of the prior art, the present invention provides a form configuration method based on VR, the method at least comprising:

[0015] Aim at and select at least one data element at a first data element position in a first form using a VR operating handle;

[0016] The VR operating handle maintains the selected state of the data element in the first form and links the data element to a second data element position for setting the data element in the second form based on a preset action.

[0017] Preferably, in response to the execution of the preset action, the server determines the link direction between the first form and the second form based on the action direction and / or action sequence of the preset action, and the link direction can determine the dependency relationship of data update.

[0018] The present invention determines the link direction between the first form and the second form, especially the link direction between the first data element position and the second data element position, based on the preset action of the VR operating handle, so as to update the data elements according to the link action, thereby reducing the workload of the user's data configuration. Based on the link action, the attributes such as personnel, time, and authority can be updated synchronously, reducing the delay problem of users updating the form and avoiding the delay defect of information.

[0019] Preferably, the method further comprises:

[0020] Setting a link action of the link, wherein the link action at least includes reference, fill, drive and / or maintain;

[0021] When the link direction between the first form and the second form is determined,

[0022] In the case where the link between the first form and the second form is a forward link, the first data element position in the first form is the active party, and the second data element position in the second form is the passive party.

[0023] The actor applies a link action to the actor based on the link.

[0024] Preferably, the method further comprises:

[0025] Establishing attribute information of the link,

[0026] The attribute information of the link at least includes personnel, time and / or authority.

[0027] The present invention determines the actuator and the actuator by setting the link direction, so that the update of the data elements in the first form and the second form is clear and does not cause confusion.

[0028] In the present invention, there may be several forms such as a third form and a fourth form. In a virtual reality scene, a data element of a form can establish forward links with data element positions of multiple forms at the same time, and a data element position of a form can also establish reverse links with data elements of several forms. In the present invention, a three-dimensional line with an arrow is used as an identifier, and the arrow indicates the direction in which the data is linked and referenced, which is convenient for the user's intuitive understanding.

[0029] Preferably, the method further comprises:

[0030] When the data element of the selected first data element position in the first form is forward linked to the second data element position in the second form, the second data element position in the second form is updated with the data element of the selected first data element position in the first form. The link between the first data element and the second data element position is represented by a three-dimensional spatial line visible in the VR environment.

[0031] Preferably, the method further comprises:

[0032] When the first data element position of the selected data element in the first form is backlinked to another data element in the second form, the other data element in the second form is updated with the first data element position of the selected data element in the first form.

[0033] Preferably, the method further comprises:

[0034] When a first data element position in a first form is bidirectionally linked to a second data element position in a second form, data elements corresponding to the second data element position in the second form and the bidirectionally linked first data element position in the first form are updated with each other.

[0035] As described above, based on the link setting, the data elements of the second form can be updated based on the change of the position of the selected data elements in the first form, can be updated based on the selected data elements, and can also be reversely updated based on the reverse link, providing users with a convenient method for updating multiple data elements, allowing users to easily perform data configuration and data management.

[0036] In the present invention, reverse link is defined for forward link. When forward link is to refer the first data element in the first form to the second data element position in the second form, reverse link means that data information is referred from the second form or other forms to a certain data position in the first form.

[0037] For example, the first form stores individual scores. The second form stores the scores of the entire class. Several individual score elements in the first form are forward-linked to the second form to obtain the score ranking data element. The ranking data element in the second form is reversely linked to the corresponding "class ranking" positions in the first form. The individual score data element and the corresponding class ranking data element are displayed in the first form.

[0038] Preferably, the preset action includes at least dragging, selecting and / or clicking, and the preset action is preferably dragging. The present invention is preferably a dragging action, so that the user can quickly set the link by operating the VR operating handle, reducing the difficulty of the action.

[0039] The present invention also provides a VR-based form configuration system, which at least includes:

[0040] A VR display device, used to aim at and select at least one data element at a first data element position in a first form by using a VR operating handle; keep the VR operating handle selected on the data element in the first form and link the data element to a second data element position for setting the data element in a second form based on a preset action; the link between the first data element and the second data element position is represented by a three-dimensional space line visible in a VR environment, so that a user can see the relationship between the data elements;

[0041] The server is configured to determine, in response to the preset action being performed, a link direction between the first form and the second form based on an action direction and / or an action sequence of the preset action, wherein the link direction can determine a dependency relationship of data update,

[0042] The VR display device establishes a connection with the server.

[0043] Preferably, the server is further configured to:

[0044] When the data element of the selected first data element position in the first form is forward linked to the second data element position in the second form, the second data element position in the second form is updated with the data element of the selected first data element position in the first form;

[0045] When the first data element position of the selected data element in the first form is reversely linked to another data element in the second form, the other data element in the second form is updated with the first data element position of the selected data element in the first form; and / or

[0046] When a first data element position in a first form is bidirectionally linked to a second data element position in a second form, data elements corresponding to the second data element position in the second form and the bidirectionally linked first data element position in the first form are updated with each other.

[0047] When the data element in the second data element position in the second form is forward linked to the third data element position in at least one third form, the third data element position in the third form is updated with the data element in the selected first data element position in the first form.

[0048] The VR-based form configuration system of the present invention enables users to intuitively view the links between data in different forms in a virtual reality scene, directly know the relationship between data elements, and also avoid frequent data update operations after setting the links. Users can monitor the update of a small number of data elements based on the virtual reality device. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 It is a schematic diagram of a three-dimensional form configuration method according to a preferred embodiment of the present invention;

[0050] Figure 2 It is a simplified structural schematic diagram of a VR panoramic video display device according to a preferred embodiment of the present invention;

[0051] Figure 3It is a flow chart of a form configuration method according to a preferred embodiment of the present invention;

[0052] Figure 4 It is a three-dimensional link schematic diagram of a two-dimensional form in a three-dimensional space provided by the present invention.

[0053] Reference numerals list

[0054] 1: display device body; 2: first groove; 3: special-shaped block; 4: first cushion; 5: bolt rod; 6: rectangular hole; 7: limit block; 8: second cushion; 9: elastic band; 10: mounting hole; 11: arc dustproof plate; 12: connecting block; 13: fixing bolt; 14: rectangular block; 15: cylindrical hole. DETAILED DESCRIPTION

[0055] The following is a detailed description with reference to the accompanying drawings.

[0056] The present invention provides a form configuration method and system based on VR.

[0057] like Figure 2 As shown, the VR display device of the present invention includes a display device body 1. First grooves 2 are provided on both sides of the inner wall of the display device body 1. Special-shaped blocks 3 are arranged inside the two first grooves 2. First cushions 4 are bonded to the opposite sides of the two special-shaped blocks 3. Second grooves are provided on the opposite sides of the two special-shaped blocks 4. Bolt rods 5 are threaded through both sides of the display device body 1. Two rectangular holes 6 are provided on both sides of the display device body 1. A limiting block 7 is slidably connected inside each rectangular hole 6. A second cushion 8 is bonded to the inner wall of the display device body 1. Two cylindrical holes 15 are provided on the inner wall of the second cushion 8. Two rectangular blocks 14 are fixed to one side of the display device body 1. An elastic band 9 is provided between the same side of the two rectangular blocks 14.

[0058] Preferably, opposite ends of the two bolt rods 5 are rotatably connected to the inside of the two second grooves through bearings.

[0059] Preferably, the four limiting blocks 7 are divided into two groups, and the opposite sides of the two groups of limiting blocks 7 are fixed to the opposite sides of the two special-shaped blocks 3 respectively.

[0060] Preferably, two mutually symmetrical mounting holes 10 are provided on the top of the display device body 1 , and an arc-shaped dustproof plate 11 is provided on the inner wall of the display device body 1 .

[0061] Preferably, two symmetrical connecting blocks 12 are fixed on the top of the arc-shaped dustproof plate 11 , and fixing bolts 13 are threadedly penetrated through the tops of the two connecting blocks 12 .

[0062] Preferably, the bottom ends of the two fixing bolts 13 are respectively installed inside the two mounting holes 10 .

[0063] Compared with the prior art, the advantages and positive effects of the VR display device of the present invention are:

[0064] First, with the cooperation of the bolt rod 5, the first groove 2, the second groove, the rectangular hole 6 and the limit block 7, the special-shaped block 3 can be fine-tuned and moved, which effectively solves the problem that the display device body 1 cannot meet the needs of users with different head shapes, and effectively improves the use efficiency of the VR display device. With the cooperation of the first soft pad 4 and the second soft pad 8, the user's comfort during use can be improved. With the cooperation of the limit block 7 and the rectangular hole 6, the special-shaped block 3 can be guaranteed to move horizontally, and under the action of the elastic band 9, it is convenient for the user to wear the display device body 1.

[0065] Second, the arc dustproof plate 11 can prevent dust from passing through the cylindrical hole 15, effectively preventing dust from adhering to the lens of the display device body 1. The arc dustproof plate 11 can be prevented from moving by the cooperation of the connecting block 12, the mounting hole 10 and the fixing bolt 13.

[0066] The present invention connects a VR display device with a server to form a VR-based form configuration system for implementing a VR-based form configuration method.

[0067] The server can also be replaced by a computer, a server group, a dedicated integrated chip or other electronic device capable of running the VR form configuration method of the present invention.

[0068] The VR display device establishes a connection with the server in a wired and / or wireless manner, and after being able to be used normally, the VR device and the VR operating handle are kept connected to achieve the effect of being able to be operated by the VR operating handle.

[0069] The server delivers some form image information to the VR display device. The VR display device generates and displays some virtual form images.

[0070] like Figure 1 and Figure 3 As shown, the user can perform the following operations by operating the VR operating handle.

[0071] S1: Use the VR operating handle to aim at and select at least one data element at the first data element position in the first form.

[0072] S2: Keep the VR operating handle selected on the data element in the first form and link the data element to a second data element position for setting the data element in the second form based on a preset action.

[0073] S3: In response to the preset action being performed, the server determines the link direction between the first form and the second form based on the action direction and / or action sequence of the preset action, wherein the link direction can determine the dependency relationship of data update.

[0074] For example, in the virtual space displayed by a VR display device, several form images can be presented at any position in the virtual space, such as suspended in the air, displayed in any posture on the wall, on the table, on the bed, on the ground, on the overhead plane, and other positions in the three-dimensional space.

[0075] A form can be divided into several projects, and there are several data elements in the form. The position of the form can be moved to any position by the user by operating the VR operating handle. The display section of the form, the size of the data elements, etc. can all be adjusted by the user by operating the VR operating handle.

[0076] The user uses the VR operating handle to aim at and select at least one data element A at a first data element position in the first form. The user keeps the VR operating handle selected on the data element in the first form, and then links the data element A to a second data element position for setting the data element in the second form based on a preset action, such as a drag action.

[0077] Preferably, the preset action at least includes dragging, selecting and / or clicking. The preset action is preferably dragging.

[0078] When the link setting of the data element is completed, the server determines the link direction between the first form and the second form based on the action direction and / or action sequence of the preset action in response to the preset action. The link direction can determine the dependency relationship of data update. For example, the link and the link direction are represented by a visible line with an arrow direction, so as to determine the link action between the two forms and the change of the data element and its update relationship.

[0079] By setting the link direction, it is possible to change whether the data elements are updated passively or actively, reducing the disadvantages of users frequently updating data manually and realizing automatic management and automatic updating of data.

[0080] Preferably, in the virtual display space, the link of the present invention is displayed in a visible manner or not. Alternatively, the link relationship is displayed in a visible manner only after responding to the user's request. For example, the link can be a colored light, the light can be continuous or discontinuous, or the light has a set display rule.

[0081] After the link is set, an identifier indicating the link can be displayed at the position of data element A and the second data element. The identifier is preferably a visible line and / or light and a combination thereof. The identifier can also be other identifiers other than light. It is preferably an identifier, which is more conducive to intuitively understanding the link relationship between the data elements of the two forms. Figure 1 and Figure 4 The three-dimensional link line shown is a type of identifier.

[0082] Preferably, the link line identifier can set its unique display rules based on its link action, link attribute, link direction, etc. The display rules at least include line continuity, line type, luminous rules, color change rules, etc. and the combination of all rules.

[0083] Preferably, a link action of the link is set, and the link action at least includes reference, fill, drive and / or maintain.

[0084] The link action of the link can be preset or changed based on the user's choice. The link action of the present invention refers to the action applied by data element A as the actor to the data at the second data element position as the recipient, so that data element B at the second data element position maintains an action relationship with data element A. The actor applies the link action to the recipient based on the link.

[0085] For example, the link between data element B and data element A is set as follows: data element B references data element A, and data element A is the actor. When data element A changes, data element B implements synchronous change or delayed change based on the reference action to implement the update of the data element.

[0086] When the link direction between the first form and the second form is determined, in the case where the link between the first form and the second form is a forward link, the first data element position in the first form is the actuating party, and the second data element position in the second form is the actuating party. The link between data element B and data element A is set as: data element B = data element A*C, and data element A is the actuating party. When data element A changes, data element B realizes synchronous change or delayed change based on the driving action to realize the update of data element B.

[0087] For another example, the link between data element B and data element A is set as follows: data element B references data element A and is in a hold state, and data element A is the actuating party. When data element A changes, data element B maintains the state based on the hold action and does not change the data.

[0088] For another example, the link between the second data element position D of the second form and data element A is set as follows: data element A fills the second data element position D, and data element A is the actor. When data element A changes, data element B in the second data element position D changes data based on the filling action.

[0089] Preferably, the setting of the link further includes: establishing attribute information of the link. The attribute information of the link at least includes personnel information, time information and / or authority information.

[0090] The personal information includes at least personal information, position information, work-related information, etc., and even includes the user information of setting the link. Preferably, the visible identifier of the link can be set with different colors, brightness and / or line regularity based on the different users who created it.

[0091] Time information includes, for example, the time information of link creation and modification, and the time information of link action implementation. The time information of link action implementation includes at least real-time, delayed, and no action. The delay time is set by the user.

[0092] The permission information includes the permission level. When the user's permission level is higher than the set modifiable permission level of the link, the link can be modified and reset by the user. Otherwise, the user cannot modify or reset the link.

[0093] Preferably, the method of the present invention further comprises:

[0094] S4: When the data element of the selected first data element position in the first form is forward linked to the second data element position in the second form, the second data element position in the second form is updated along with the data element of the selected first data element position in the first form.

[0095] Preferably, the method of the present invention further comprises:

[0096] S5: When the first data element position of the selected data element in the first form is reversely linked to another data element in the second form, the other data element in the second form is updated along with the first data element position of the selected data element in the first form.

[0097] Preferably, the method of the present invention further comprises:

[0098] S6: When the first data element position in the first form is bidirectionally linked to the second data element position in the second form, the data elements corresponding to the second data element position in the second form and the first data element position bidirectionally linked to each other in the first form are updated with each other. When the data element in the second data element position in the second form is forwardly linked to the third data element position in at least one third form, the third data element position in the third form is updated with the data element of the selected first data element position in the first form.

[0099] The above steps S4 to S6 can realize the user's data configuration, quick data setting and management for different forms or the same form, can realize regional data links and data updates, can also realize one-to-one links between data elements and data updates, can also realize the mutual changes and updates of two-way links, greatly reducing the user's steps of moving, copying, pasting, calculating, checking and other data management, thereby reducing the error probability of data management. In addition, in the present invention, the user can quickly understand and clarify the relationship between data elements and the relationship between forms through simple actions to realize the link between data elements between forms, thereby improving the speed and accuracy of data checking and improving the user's management ability for project management.

[0100] Exemplary application scenarios of the present invention are described as follows.

[0101] Example 1: Single-person use scenario

[0102] User A wears a VR display device and a VR handle operating device to enter a VR scene. The user uses the VR operating handle to aim at and select at least one data element at a first data element position in a first form; while keeping the VR operating handle selected for the data element in the first form, the user clicks on a second data element position in a second form for setting the data element, so that the data element and the second data element position are linked by a visible three-dimensional line.

[0103] Or, conversely, while keeping the VR operating handle selected on the first data element position in the first form, the user clicks on the second data element in the second form, so that the second data element is linked to the first data element position through a visible three-dimensional line.

[0104] The 3D lines can be displayed in various colors, and each color can be associated with the link relationship of the data elements. For example, red indicates the same data relationship, green indicates that the data is related but not the same, pink indicates that the data relationship has been verified, purple indicates that there is an abnormality in the data relationship, etc.

[0105] Preferably, the three-dimensional lines can also display directions, so that users can quickly understand the relationship and origin of data elements and data element locations.

[0106] When a user makes a change to a first data element, the change is made synchronously or asynchronously with the first data element at the position of a second data element.

[0107] Example 2: Multi-person collaborative use scenario

[0108] The first user A and the second user B wear a VR display device and a VR handle operation device respectively to enter the VR scene. The second user B can see the data elements in the three-dimensional space and all operations of the first user A in the VR scene, and can also see the lines representing the links.

[0109] When the first user establishes a link between the first data element in the first form and the second data element in the second form, in response to the second user B's confirmation operation on the link relationship, the link relationship is locked and displayed in a manner in which the link display feature changes. The link display feature changes include color changes, arrow changes, line type changes, etc.

[0110] Preferably, when the first user establishes a link between the first data element in the first form and the second data element in the second form, the second user corrects the established link based on the set permissions.

[0111] In response to clicking and / or touching a link, properties of the link can be displayed and moved in three-dimensional space.

[0112] In response to the operation of the VR handle operating device, the form in the three-dimensional space can be moved from a long distance within the user's field of view to a close distance within the field of view. During the form movement process, the links between the data elements and the data element positions are adaptively changed based on the movement of the form in a manner that maintains the relationship unchanged.

[0113] Preferably, the first user A and the second user B respectively wear a VR display device and a VR handle operating device to enter different VR scenes to perform link operations on the same form in a collaborative manner.

[0114] When a first link set by the first user A to the first data element is the same as a second link set by the second user to the first data element, the link is displayed with the first display feature.

[0115] When the first link set by the first user A for the first data element is different from the second link set by the second user for the first data element, or when only one of them sets the link for the first data element, the link is displayed with the second display feature. The display feature includes color, arrow, line type, etc. Such a setting is conducive to multiple users working in collaboration to perform link operations and check the data elements of the form at the same time. Preferably, the first user A and the second user B working in collaboration can see each other.

[0116] It should be noted that the above-mentioned specific embodiments are exemplary, and those skilled in the art can come up with various solutions inspired by the disclosure of the present invention, and these solutions also belong to the disclosure scope of the present invention and fall within the protection scope of the present invention. Those skilled in the art should understand that the present invention specification and its drawings are illustrative and do not constitute a limitation on the claims. The scope of protection of the present invention is defined by the claims and their equivalents. The present invention specification contains multiple inventive concepts, such as "preferably" and "according to a preferred embodiment", which means that the corresponding paragraph discloses an independent concept, and the applicant reserves the right to file a divisional application based on each inventive concept.

Claims

1. A VR display device configured with a form, connected to a server, characterized in that: Generate and display a plurality of virtual form images in a virtual space displayed by a VR display device; In a case where at least one data element at the first data element position in the first form remains in a selected state, in response to the link direction between the first form and the second form determined by the server based on the action direction and / or action sequence of a preset action, the VR display device links the data element to a second data element position in the second form for setting the data element through an identifier indicating the link; The identifier can set its unique display rule based on different link actions, link attributes, and link directions.

2. The VR display device of the configuration form according to claim 1, characterized in that: The attribute information of the link includes personnel information, time information and / or authority information; The visible identifier can be set with different colors, brightness and / or line patterns depending on the user who created it.

3. The VR display device of the configuration form according to claim 1 or 2, characterized in that: The linking action at least includes quoting, filling, driving and / or maintaining; When the link direction between the first form and the second form is determined, In the case where the link between the first form and the second form is a forward link, the first data element position in the first form is the active party, and the second data element position in the second form is the passive party. The actor applies a link action to the actor based on the link.

4. The VR display device for configuring a form according to any one of claims 1 to 3, characterized in that: The link direction determines the dependency of data update; The link and the link direction are represented by a visible line with an arrow direction, so as to determine the link action between the two forms and the change of data elements and their update relationship.

5. The VR display device for configuring a form according to any one of claims 1 to 3, characterized in that: When the data element of the selected first data element position in the first form is forward linked to the second data element position in the second form, the second data element position in the second form is updated with the data element of the selected first data element position in the first form; The link between the positions of the first data element and the second data element is represented by a three-dimensional space line visible in the VR environment.

6. The VR display device for configuring a form according to any one of claims 1 to 3, characterized in that: When the first data element position of the selected data element in the first form is backlinked to another data element in the second form, the other data element in the second form is updated with the first data element position of the selected data element in the first form.

7. The VR display device for configuring a form according to any one of claims 1 to 3, characterized in that: When a first data element position in a first form is bidirectionally linked to a second data element position in a second form, data elements corresponding to the second data element position in the second form and the bidirectionally linked first data element position in the first form are updated with each other.

8. A server for configuring a form, connected to a VR display device in a wired and / or wireless manner, characterized in that: The server delivers a number of form image information to the VR display device; When the VR operating handle targets and selects at least one data element at the first data element position in the first form, the server determines a link direction between the first form and the second form based on an action direction and / or an action sequence of a preset action; The VR display device links the data element to a second data element position for setting the data element in the second form through an identifier indicating the link; In response to a user's request, the server displays the relationship of the link in a visible manner; The identifier can set its unique display rule based on different link actions, link attributes, and link directions.

9. The server for configuring a form according to claim 8, characterized in that: The server sets a unique display rule for the link line identifier based on different link actions, link attributes, and link directions.

10. The server for configuring a form according to claim 8 or 9, characterized in that: The server is configured to: When the data element of the selected first data element position in the first form is forward linked to the second data element position in the second form, the second data element position in the second form is updated with the data element of the selected first data element position in the first form; When the data element in the second data element position in the second form is forward linked to the third data element position in at least one third form, the third data element position in the third form is updated with the data element in the selected first data element position in the first form.

Citation Information

Patent Citations

  • VR (Virtual Reality) panoramic video picture display method and device and VR display terminal

    CN108401182A

  • Interactive government affair service system and method based on VR virtual reality technology

    CN111176442A

  • Linking visual properties of charts to cells within tables

    CN101971170A

  • Copy and paste in virtual reality environment

    CN110442460A

  • Data processing method and device and electronic equipment

    CN113868260A