Virtual reality based remote collaborative development system and method

Abstract

This invention provides a virtual reality-based remote collaborative development system and method. The system includes: a construction module for building a virtual development environment; a detection module for detecting development problems encountered by users while editing code in the virtual development environment; and a collaboration module for remote collaboration based on these development problems. When a user encounters a development problem while editing code in the virtual development environment, the system and method of this invention uses a digital twin to obtain the virtual reality environment based on the virtual development environment configuration at the time the problem occurs. This supports multiple users simultaneously editing and debugging code in the virtual reality environment, allows the user encountering the development problem to interact with other users, provides a more immersive collaborative experience, and improves communication efficiency.

Description

Technical Field

[0001] This invention relates to the field of software development technology, and in particular to a remote collaborative development system and method based on virtual reality. Background Technology

[0002] Currently, developers typically employ a collaborative, division-of-labor model when developing projects, with each developer independently responsible for specific modules or functionalities within the project. While this approach helps clarify responsibilities and improve focus, in practice, because each developer's work is relatively independent, problem-solving often relies on their own experience and knowledge. When encountering problems beyond their capabilities, developers usually need to search for solutions by consulting relevant development documentation, technical blogs, forums, or open-source communities, or communicate with colleagues for assistance. This inefficient problem-solving method not only prolongs the development cycle and increases communication costs, but also exacerbates the problem of inefficiency in problem-solving.

[0003] In view of this, there is an urgent need for remote collaboration development systems and methods based on virtual reality to at least address the aforementioned shortcomings. Summary of the Invention

[0004] One of the objectives of this invention is to provide a remote collaborative development system and method based on virtual reality. When a user encounters a development problem while editing code in a virtual development environment, a digital twin is generated to obtain the virtual reality environment based on the virtual development environment configuration at the time the problem occurs. This supports multiple users editing and debugging code simultaneously in the virtual reality environment, allows the user who encounters the development problem to interact with other users, provides a more immersive collaborative experience, and improves communication efficiency.

[0005] The virtual reality-based remote collaborative development system provided in this embodiment of the invention includes:

[0006] Build modules are used to build virtual development environments;

[0007] The detection module is used to detect development problems that occur when users edit code in a virtual development environment;

[0008] The collaboration module is used for remote collaboration based on development issues.

[0009] Preferably, the collaboration module enables remote collaboration based on development issues, including:

[0010] Extract the problem-based characteristics of development issues;

[0011] Based on the characteristics of the problem, retrieve historical development issues;

[0012] Obtain the virtual processing path of the historical development issue from the party that successfully handled the historical development issue;

[0013] Extract the valid processing paths from the virtual processing paths;

[0014] Calculate the collaboration priority of the processing parties based on the effective processing path and the virtual processing path;

[0015] Connect with the collaboration node of the processing party with the highest collaboration priority to conduct remote collaboration.

[0016] Preferably, the collaboration module calculates the collaboration priority of the processing party based on the effective processing path and the virtual processing path, including:

[0017] Based on the processing logic mapping template, valid processing paths and virtual processing paths are mapped to the same processing logic mapping framework;

[0018] Based on the preset first extraction rule and the mapping result, the first path relationship and the second path relationship are determined. The first path relationship is the path relationship between the local effective processing path between adjacent frame nodes and the template path between adjacent frame nodes. The second path relationship is the path relationship between the local virtual processing path between adjacent frame nodes and the local effective processing path between adjacent frame nodes.

[0019] Calculate path similarity based on the first path relationship;

[0020] Based on the second path relationship, the path similarity is adjusted to obtain the adjustment value;

[0021] The adjustment values ​​are accumulated to obtain the collaboration priority.

[0022] Preferably, the collaboration module adjusts the path similarity based on the second path relationship to obtain an adjustment value, including:

[0023] Based on the second path relationship, the redundant paths corresponding to the local effective processing paths of the local virtual processing paths are determined.

[0024] Based on the preset second extraction rule and the redundant path, the second feature of the path branch point is determined. The second feature includes: the difference in the carried value of the path branch point at the first time and the second time, the value of the difference carried value, and the execution processing computing power of the path branch.

[0025] The adjustment degree value is determined based on the second feature and the preset adjustment degree determination table;

[0026] The path similarity is adjusted based on the degree of adjustment value to obtain the adjustment value.

[0027] Preferably, the collaboration module connects to the collaboration node of the processing party with the highest collaboration priority to conduct remote collaboration, including:

[0028] When collaborators at a collaboration node are working together to resolve development issues, they must obtain at least one question code snippet selected by the user and the question extraction semantics.

[0029] Based on the edited code, obtain the first code structure;

[0030] Based on the question extraction semantics, determine the second code structure associated with the question extraction semantics in the first code structure;

[0031] Obtain the standard code structure set for user development requirements, and determine the standard code structure that is most similar to the first code structure;

[0032] Based on the structural relationship between the second code structure and the first code structure, the third code structure in the index standard code structure corresponds to the second code structure;

[0033] Determine whether the structural similarity between the second code structure and the third code structure is greater than or equal to a preset structural similarity threshold;

[0034] If so, obtain the interpretation template of the third code structure and display it to the user;

[0035] If not, based on the preset third extraction rule, the third feature is extracted according to the structural relationship; the third feature includes: the data type and data flow of the code module at the connection between the first code structure and the second code structure;

[0036] Based on the third feature, construct an instance index vector index to index the required instances;

[0037] Generate a footnote filling template at the connection point between the first and second code structures, and instruct collaborators to fill in the footnotes.

[0038] Link the footnote fill template and the requirement instance based on the correspondence between them.

[0039] Preferably, based on the correspondence between the footnote fill template and the requirement instance, the footnote fill template and the requirement instance are linked, including:

[0040] Based on the relevance of the source requirements and user development requirements corresponding to the requirement instances, a first requirement instance slice sequence is generated for collaborators to view in the virtual reality space;

[0041] Based on the fourth extraction rule and according to the first viewing process, the first viewing features are extracted;

[0042] Based on the first viewing feature, determine the second requirement instance slice sequence that follows the first requirement instance slice sequence and is available for collaborators to view;

[0043] Based on the fourth extraction rule and according to the second viewing process, extract the second viewing features;

[0044] If the second viewing feature satisfies the comparison feature, predict the comparison intent based on the second requirement instance slice to be compared and the second viewing feature after the comparison feature is identified.

[0045] Based on the comparison intent, the intent value of the second requirement instances that have not yet been viewed by collaborators in the second requirement instance slice sequence is quantified, and the unviewed second requirement instances are reorganized in descending order of intent value;

[0046] While collaborators are viewing the second requirement instance, obtain the required instance and footnote fill template link selected by the collaborators.

[0047] The remote collaborative development method based on virtual reality provided in this invention includes:

[0048] Step 1: Set up a virtual development environment;

[0049] Step 2: Detect development problems that arise when users edit code in the virtual development environment;

[0050] Step 3: Conduct remote collaboration based on development issues.

[0051] Preferably, step 3: Based on development issues, conduct remote collaboration, including:

[0052] Extract the problem-based characteristics of development issues;

[0053] Based on the characteristics of the problem, retrieve historical development issues;

[0054] Obtain the virtual processing path of the historical development issue from the party that successfully handled the historical development issue;

[0055] Extract the valid processing paths from the virtual processing paths;

[0056] Calculate the collaboration priority of the processing parties based on the effective processing path and the virtual processing path;

[0057] Connect with the collaboration node of the processing party with the highest collaboration priority to conduct remote collaboration.

[0058] Preferably, the collaboration priority of the processing party is calculated based on the effective processing path and the virtual processing path, including:

[0059] Based on the processing logic mapping template, valid processing paths and virtual processing paths are mapped to the same processing logic mapping framework;

[0060] Based on the preset first extraction rule and the mapping result, the first path relationship and the second path relationship are determined. The first path relationship is the path relationship between the local effective processing path between adjacent frame nodes and the template path between adjacent frame nodes. The second path relationship is the path relationship between the local virtual processing path between adjacent frame nodes and the local effective processing path between adjacent frame nodes.

[0061] Calculate path similarity based on the first path relationship;

[0062] Based on the second path relationship, the path similarity is adjusted to obtain the adjustment value;

[0063] The adjustment values ​​are accumulated to obtain the collaboration priority.

[0064] Preferably, the path similarity is adjusted according to the second path relationship to obtain an adjusted value, including:

[0065] Based on the second path relationship, the redundant paths corresponding to the local effective processing paths of the local virtual processing paths are determined.

[0066] Based on the preset second extraction rule and the redundant path, the second feature of the path branch point is determined. The second feature includes: the difference in the carried value of the path branch point at the first time and the second time, the value of the difference carried value, and the execution processing computing power of the path branch.

[0067] The adjustment degree value is determined based on the second feature and the preset adjustment degree determination table;

[0068] The path similarity is adjusted based on the degree of adjustment value to obtain the adjustment value.

[0069] The beneficial effects of this invention are as follows:

[0070] When a user encounters a development problem while editing code in a virtual development environment, this invention uses a digital twin to obtain a virtual reality environment based on the virtual development environment configuration at the time the problem occurs. This allows multiple users to edit and debug code simultaneously in the virtual reality environment, enabling the user who encountered the development problem to interact with other users, providing a more immersive collaborative experience, and improving communication efficiency.

[0071] Other features and advantages of the invention will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the invention. The objects and other advantages of the invention may be realized and obtained by means of the structures particularly pointed out in this application.

[0072] The technical solution of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. Attached Figure Description

[0073] The accompanying drawings are provided to further illustrate the invention and form part of the specification. They are used in conjunction with embodiments of the invention to explain the invention and do not constitute a limitation thereof. In the drawings:

[0074] Figure 1 This is a schematic diagram of a virtual reality-based remote collaborative development system in an embodiment of the present invention;

[0075] Figure 2 This is a schematic diagram of a remote collaborative development method based on virtual reality in an embodiment of the present invention. Detailed Implementation

[0076] The preferred embodiments of the present invention will be described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are for illustration and explanation only and are not intended to limit the present invention.

[0077] This invention provides a remote collaborative development system based on virtual reality, such as... Figure 1 As shown, it includes:

[0078] Module 1 is used to build a virtual development environment;

[0079] Detection module 2 is used to detect development problems that occur when users edit code in the virtual development environment;

[0080] Collaboration Module 3 is used for remote collaboration based on development issues.

[0081] The working principle and beneficial effects of the above technical solution are as follows:

[0082] A virtual development environment is a software-simulated development space implemented using virtual machine technology. During construction, it is created and configured based on user development needs. Detected development issues (such as syntax errors and logic errors) can be proactively raised by the user or automatically identified by the system. Remote collaboration based on these development issues refers to enabling interaction between users using virtual reality technology, such as voice chat and gesture control. It supports multiple users simultaneously editing and debugging code in the virtual reality environment. The virtual reality environment uses a digital twin based on the virtual development environment configuration at the time of detected development issues, providing a more immersive collaborative experience and improving communication efficiency.

[0083] In one embodiment, the collaboration module enables remote collaboration based on development issues, including:

[0084] Extract the key characteristics of development issues; these characteristics serve as the basis for determining the existence of development issues, such as: error type, code location, and severity.

[0085] Based on the characteristics of the problem, retrieve historical development problems; when retrieving historical development problems, retrieve development problems that the system has historically processed that match the problem's characteristics.

[0086] Obtain the virtual processing path of the party that successfully resolved the historical development issue; the virtual processing path is the steps taken by the party to resolve the historical development issue in the virtual development environment.

[0087] Extract the effective processing paths from the virtual processing paths; the effective processing paths are the key steps in the virtual processing paths that actually successfully solve the problem. The effective processing paths are obtained by removing the virtual processing paths that are repeatedly traversed.

[0088] Based on the effective processing path and the virtual processing path, the collaboration priority of the processing party is calculated. The collaboration priority is a quantified result of the processing party's performance in handling historical development issues. The higher the collaboration priority, the more likely the party will be connected to the corresponding processing party for remote collaboration.

[0089] Connect with the collaboration node of the processing party with the highest collaboration priority to conduct remote collaboration.

[0090] The working principle and beneficial effects of the above technical solution are as follows:

[0091] This invention obtains historical development problems based on the characteristics of development problems, determines the virtual processing path of the processing party for the historical development problems, identifies the effective processing path in the virtual processing path, quantifies the processing performance of the processing party for the historical development problems based on the path relationship between the effective processing path and the virtual processing path, obtains the collaboration priority of the processing party, and connects to the corresponding collaboration node with the highest collaboration priority for remote collaboration, resulting in better collaboration effect.

[0092] In one embodiment, the collaboration module calculates the collaboration priority of the processors based on the valid processing path and the virtual processing path, including:

[0093] Based on the processing logic mapping template, valid processing paths and virtual processing paths are mapped to the same processing logic mapping framework; the processing logic mapping template is a template for constraining the mapping method of processing paths, and the mapping method refers to the path description logic.

[0094] Based on the preset first extraction rule and the mapping results, the first path relationship and the second path relationship are determined. The first path relationship is the path relationship between the locally effective processing path between adjacent frame nodes and the template path between adjacent frame nodes. The second path relationship is the path relationship between the locally virtual processing path between adjacent frame nodes and the locally effective processing path between adjacent frame nodes. The frame node is the descriptive subject, such as: the first step, the second step, etc. The template path is the standard processing path, which is set and determined by experienced development experts.

[0095] Based on the first path relationship, calculate the path similarity; the path similarity characterizes the degree of similarity between the actual processing method and the standard processing method. The higher the method similarity, the higher the priority for connecting to the corresponding processing party.

[0096] Based on the second path relationship, the path similarity is adjusted to obtain the adjustment value; the more invalid steps and the higher the step complexity between the local virtual processing path and the local effective processing path, the more the path similarity is reduced.

[0097] The adjustment values ​​are accumulated to obtain the collaboration priority.

[0098] The working principle and beneficial effects of the above technical solution are as follows:

[0099] When connecting with collaborating parties, the priority of connection varies, with parties more proficient in handling the problem being connected first; the processing logic mapping template constrains the description logic of the processing path, describing the effective processing path and the virtual processing path according to the same description logic, for subsequent path comparison.

[0100] The first extraction rule constrains the description logic of the processing path and the feature extraction of the target, such as: the relationship between frame node 1 and frame node 2 (extracting the sub-frame nodes and frame lines that pass through the sub-frame nodes from frame node 1 to frame node 2 (a frame line corresponds to a sub-step in the virtual development environment)); and extracts the first path relationship and the second path relationship using the first extraction rule.

[0101] The path similarity between the locally effective processing paths and the template paths between adjacent frame nodes, calculated based on the first path relationship, represents the degree of similarity between the actual processing method and the standard processing method. The higher the method similarity, the higher the priority for connecting to the corresponding processing party. (Second path relationship) The more steps and the higher the complexity between the local virtual processing path and the local effective processing path, the more the path similarity is reduced. The adjustment value is calculated by summing to obtain the collaboration priority.

[0102] This invention introduces a processing logic mapping template, which improves the standardization of the description of effective processing paths and virtual processing paths, facilitating subsequent comparisons. It also introduces a first extraction rule to extract the first path relationship and the second path relationship. In addition to considering the similarity between the actual processing method and the standard processing method, it also considers the influence of the path relationship between the local virtual processing paths and the local effective processing paths between adjacent frame nodes on the path similarity, further improving the calculation accuracy of collaboration priority.

[0103] In one embodiment, the collaboration module adjusts the path similarity based on the second path relationship to obtain an adjustment value, including:

[0104] Based on the second path relationship, the redundant paths corresponding to the local effective processing paths of the local virtual processing paths are determined.

[0105] Based on the preset second extraction rule and the redundant path, the second feature of the path branch point is determined. The second feature includes: the difference in the carried value of the path branch point at the first time and the second time, the value of the difference carried value, and the execution processing computing power of the path branch.

[0106] The adjustment degree value is determined based on the second feature and the preset adjustment degree determination table;

[0107] The path similarity is adjusted based on the degree of adjustment value to obtain the adjustment value.

[0108] The working principle and beneficial effects of the above technical solution are as follows:

[0109] A redundant path is a repeated path corresponding to a locally effective processing path within a local virtual processing path. The second extraction rule is used to extract relevant information about the path branches for comparison with the redundant path, such as: the difference in access data from before the branch point is generated to after the previous branch point is generated (first moment) and when the path branch point is passed again after the branch is generated (second moment), the value of the difference in access data, and the processing resources (e.g., execution processing power) for accessing the path branch. A preset adjustment degree determination table stores multiple second feature distributions and corresponding adjustment degrees. The difference carries the log difference, the difference carries the information value provided by the log difference (e.g., 89), and the execution processing power is, for example, 15.3 GFLOPS. The second feature distribution is: the feature description result of the redundant path, such as: high difference value (89), low execution processing power (15.3 GFLOPS), and an adjustment degree value of 1.1. The path similarity is adjusted according to the adjustment degree value (e.g., 1.1 * 75%) to obtain the adjustment value. Extracting the second feature of the redundant path and using it for subsequent path similarity adjustment improves the appropriateness of the adjustment value.

[0110] In one embodiment, the collaboration module connects to the collaboration node of the processing party with the highest collaboration priority to perform remote collaboration, including:

[0111] The collaborators at the collaborative nodes obtain at least one question code snippet selected by the user and the question extraction semantics when collaborating on development issues; the question code snippet is: the code snippet that the user actively annotates when the collaborator guides the user in a virtual reality scene and the user has a question;

[0112] Based on the edited code, obtain the first code structure;

[0113] Based on the question extraction semantics, determine the second code structure associated with the question extraction semantics in the first code structure; when determining the second code structure associated with the question extraction semantics, determine the description of the function, class or code module name corresponding to the code structure in the question extraction semantics, and select the part of the first code structure containing the above description as the second code structure;

[0114] Obtain a set of standard code structures that meet the user's development requirements, and determine the standard code structure that is most similar to the first code structure; the set of standard code structures contains verified code templates that meet the user's development requirements;

[0115] Based on the structural relationship between the second code structure and the first code structure, the third code structure corresponding to the second code structure in the index standard code structure is indexed. The structural relationship is: the structural connection relationship between the second code structure and the code structures in the first code structure other than the second code structure. When indexing the third code structure, the local standard code structures with connection relationships are first identified, and the parts in the standard code structure that are similar to the code structures in the first code structure other than the second code structure are removed to obtain the third code structure.

[0116] Determine whether the structural similarity between the second and third code structures is greater than or equal to a preset structural similarity threshold; structural similarity is a quantification of the similarity between the corresponding function calls, classes, and code step logic of the second and third code structures; the preset structural similarity threshold is manually set.

[0117] If so, retrieve the explanation template of the third code structure and display it to the user; the standard code structure is verified and includes code explanations. If the second and third code structures are similar, the corresponding explanations can be retrieved directly.

[0118] If not, based on the preset third extraction rule, the third feature is extracted according to the structural relationship; the third feature includes: the data type and data flow direction of the code module at the connection between the first code structure and the second code structure; the preset third extraction rule is: the rule for extracting input data, output data and code modules by referring to the code structure relationship;

[0119] Based on the third feature, construct an instance index vector to index the required instances; the instance index vector is: the code instance description vector corresponding to the structure-connected structure obtained by vectorizing the third feature;

[0120] Generate a footnote filling template for the connection between the first and second code structures, and instruct collaborators to fill in the footnotes; the footnote filling template is a template that constrains collaborators to comment on the code.

[0121] Link the footnote fill template and the requirement instance based on the correspondence between them.

[0122] The working principle and beneficial effects of the above technical solution are as follows:

[0123] When collaborators conduct remote collaborative development, users may have questions about the code written by the collaborators. In this case, users can use virtual reality technology to mark the code segments they are questioning. In addition, based on the user's multimodal output information (such as the dialogue output of the collaborative meeting room), the semantics of the questions can be extracted.

[0124] The first code structure is determined based on the edited code, and the second code structure is determined based on semantic extraction of questions. The code structure in the first structure, excluding the second code structure, is a user-familiar structure. This structure is used to index the standard code structure required by the user's development needs, obtaining the standard code structure most similar to the edited code. The structural similarity of the corresponding part of the standard code structure to the second code structure is compared with the second code structure. If similar, it indicates that the corresponding second code structure is a general and known structure, and the corresponding explanation can be directly retrieved for the user to view without additional explanation from collaborators. If dissimilar, it indicates that the corresponding second code structure differs from the conventional code structure, requiring collaborators to provide their own explanation. A footnote filling template is introduced, instructing collaborators to fill in the footnotes. Furthermore, a third extraction rule is introduced; based on structural relationships, a third feature is extracted to construct an instance index vector indexing requirement instances. Similar instances are extracted based on big data as footnote references, making the process more intuitive.

[0125] In one embodiment, linking the footnote fill template and the requirement instance according to the correspondence between the footnote fill template and the requirement instance includes:

[0126] Based on the relevance of the source requirements and user development requirements corresponding to the requirement instances, a first requirement instance slice sequence is generated for collaborators to view in the virtual reality space;

[0127] Based on the fourth extraction rule and according to the first viewing process, the first viewing features are extracted;

[0128] Based on the first viewing feature, determine the second requirement instance slice sequence that follows the first requirement instance slice sequence and is available for collaborators to view;

[0129] Based on the fourth extraction rule and according to the second viewing process, extract the second viewing features;

[0130] If the second viewing feature satisfies the comparison feature, predict the comparison intent based on the second requirement instance slice to be compared and the second viewing feature after the comparison feature is identified.

[0131] Based on the comparison intent, the intent value of the second requirement instances that have not yet been viewed by collaborators in the second requirement instance slice sequence is quantified, and the unviewed second requirement instances are reorganized in descending order of intent value;

[0132] While collaborators are viewing the second requirement instance, obtain the required instance and footnote fill template link selected by the collaborators.

[0133] The working principle and beneficial effects of the above technical solution are as follows:

[0134] The requirement relevance characterizes the degree of relevance between the development requirements corresponding to the requirement instance and the actual user development requirements. The first requirement instance slice carries the relevant content of the requirement instance. The first requirement instance slice sequence is an ordered sequence obtained by sorting the first requirement instance slices in descending order of requirement relevance. The fourth extraction rule is the rule for extracting line-of-sight features (line-of-sight points, trajectories). The first viewing process is the process of collaborators viewing the first requirement instance slice sequence. The first viewing feature is the line-of-sight feature of collaborators when viewing the first requirement instance slice sequence. When determining the second requirement instance slice sequence, if the viewing duration of the first requirement instance slice is greater than a preset threshold, or if the length of the return sequence after the first viewing of the first requirement instance slice is greater than or equal to the preset sequence length threshold (e.g., 2), then the corresponding first requirement instance slice is taken as the second requirement instance slice. The second viewing process is the process of collaborators viewing the second requirement instance slice sequence. The process; the second viewing feature is: the gaze characteristics of collaborators when viewing the second requirement instance slice sequence; the comparison feature is: when the gaze point falls on a second requirement instance slice A and then immediately falls on another second requirement instance slice B within a preset time period (e.g., within 1 minute), there exists a gaze point that falls on second requirement instance slice B and then immediately falls back on second requirement instance slice A; the predicted comparison intent is to identify the specific comparison content item of the requirement instance based on the second viewing feature identified by the comparison feature, and take the comparison content item as the comparison intent; when quantifying the intent value, the content type in the second requirement instance that the collaborator has not yet viewed is searched, and the association value between the content type and the target content type corresponding to the comparison content item is taken as the intent value. The intent value represents the degree to which the collaborator wants to compare requirement instance slices. The sorting of the second requirement instance slices that have not yet been viewed in the second requirement instance slice sequence is dynamically adjusted according to the comparison intent, which helps the collaborator to quickly identify the requirement instances to be used for subsequent footnote links, and improves the rationality of the linked requirement instances.

[0135] This invention provides a remote collaborative development method based on virtual reality, such as... Figure 2 As shown, it includes:

[0136] Step 1: Set up a virtual development environment;

[0137] Step 2: Detect development problems that arise when users edit code in the virtual development environment;

[0138] Step 3: Conduct remote collaboration based on development issues.

[0139] Obviously, those skilled in the art can make various modifications and variations to this invention without departing from its spirit and scope. Therefore, if these modifications and variations fall within the scope of the claims of this invention and their equivalents, this invention also intends to include these modifications and variations.

Claims

1. A remote collaborative development system based on virtual reality, characterized in that: include: Build modules are used to build virtual development environments; The detection module is used to detect development problems that occur when users edit code in a virtual development environment; The collaboration module is used for remote collaboration based on development issues, including: Extract the problem-based characteristics of development issues; Based on the characteristics of the problem, retrieve historical development issues; Obtain the virtual processing path of the historical development issue from the party that successfully handled the historical development issue; Extract the valid processing paths from the virtual processing paths; Calculate the collaboration priority of the processing parties based on the effective processing path and the virtual processing path; Connect with the collaboration node of the processing party with the highest collaboration priority to conduct remote collaboration; Among these, the collaboration priority of the processing parties is calculated based on the effective processing path and the virtual processing path, including: Based on the processing logic mapping template, valid processing paths and virtual processing paths are mapped to the same processing logic mapping framework; Based on the preset first extraction rule and the mapping result, the first path relationship and the second path relationship are determined. The first path relationship is the path relationship between the local effective processing path between adjacent frame nodes and the template path between adjacent frame nodes. The second path relationship is the path relationship between the local virtual processing path between adjacent frame nodes and the local effective processing path between adjacent frame nodes. Calculate path similarity based on the first path relationship; Based on the second path relationship, the path similarity is adjusted to obtain the adjustment value; Accumulate and calculate the adjustment values ​​to obtain the collaboration priority; Specifically, based on the second path relationship, the path similarity is adjusted to obtain an adjusted value, including: Based on the second path relationship, the redundant paths corresponding to the local effective processing paths of the local virtual processing paths are determined. Based on the preset second extraction rule and the redundant path, the second feature of the path branch point is determined. The second feature includes: the difference in the carried value of the path branch point at the first time and the second time, the value of the difference carried value, and the execution processing computing power of the path branch. The adjustment degree value is determined based on the second feature and the preset adjustment degree determination table; The path similarity is adjusted based on the degree of adjustment value to obtain the adjustment value.

2. The virtual reality-based remote collaborative development system as described in claim 1, characterized in that, The collaboration module connects to the collaboration node of the processing party with the highest collaboration priority to conduct remote collaboration, including: When collaborators at a collaboration node are working together to resolve development issues, they must obtain at least one question code snippet selected by the user and the question extraction semantics. Based on the edited code, obtain the first code structure; Based on the question extraction semantics, determine the second code structure associated with the question extraction semantics in the first code structure; Obtain the standard code structure set for user development requirements, and determine the standard code structure that is most similar to the first code structure; Based on the structural relationship between the second code structure and the first code structure, the third code structure in the index standard code structure corresponds to the second code structure; Determine whether the structural similarity between the second code structure and the third code structure is greater than or equal to a preset structural similarity threshold; If so, obtain the interpretation template of the third code structure and display it to the user; If not, based on the preset third extraction rule, the third feature is extracted according to the structural relationship; the third feature includes: the data type and data flow of the code module at the connection between the first code structure and the second code structure; Based on the third feature, construct an instance index vector index to index the required instances; Generate a footnote filling template at the connection point between the first and second code structures, and instruct collaborators to fill in the footnotes. Link the footnote fill template and the requirement instance based on the correspondence between them.

3. The virtual reality-based remote collaborative development system as described in claim 2, characterized in that, Based on the correspondence between footnote fill templates and requirement instances, link the footnote fill templates and requirement instances, including: Based on the relevance of the source requirements and user development requirements corresponding to the requirement instances, a first requirement instance slice sequence is generated for collaborators to view in the virtual reality space; Based on the fourth extraction rule and according to the first viewing process, the first viewing features are extracted; Based on the first viewing feature, determine the second requirement instance slice sequence that follows the first requirement instance slice sequence and is available for collaborators to view; Based on the fourth extraction rule and according to the second viewing process, extract the second viewing features; If the second viewing feature satisfies the comparison feature, predict the comparison intent based on the second requirement instance slice to be compared and the second viewing feature after the comparison feature is identified. Based on the comparison intent, the intent value of the second requirement instances that have not yet been viewed by collaborators in the second requirement instance slice sequence is quantified, and the unviewed second requirement instances are reorganized in descending order of intent value; While collaborators are viewing the second requirement instance, obtain the required instance and footnote fill template link selected by the collaborators.

4. A remote collaborative development method based on virtual reality, characterized in that: include: Step 1: Set up a virtual development environment; Step 2: Detect development problems that arise when users edit code in the virtual development environment; Step 3: Conduct remote collaboration based on development issues, including: Extract the problem-based characteristics of development issues; Based on the characteristics of the problem, retrieve historical development issues; Obtain the virtual processing path of the historical development issue from the party that successfully handled the historical development issue; Extract the valid processing paths from the virtual processing paths; Calculate the collaboration priority of the processing parties based on the effective processing path and the virtual processing path; Connect with the collaboration node of the processing party with the highest collaboration priority to conduct remote collaboration; Among these, the collaboration priority of the processing parties is calculated based on the effective processing path and the virtual processing path, including: Based on the processing logic mapping template, valid processing paths and virtual processing paths are mapped to the same processing logic mapping framework; Based on the preset first extraction rule and the mapping result, the first path relationship and the second path relationship are determined. The first path relationship is the path relationship between the local effective processing path between adjacent frame nodes and the template path between adjacent frame nodes. The second path relationship is the path relationship between the local virtual processing path between adjacent frame nodes and the local effective processing path between adjacent frame nodes. Calculate path similarity based on the first path relationship; Based on the second path relationship, the path similarity is adjusted to obtain the adjustment value; Accumulate and calculate the adjustment values ​​to obtain the collaboration priority; Specifically, based on the second path relationship, the path similarity is adjusted to obtain an adjusted value, including: Based on the second path relationship, the redundant paths corresponding to the local effective processing paths of the local virtual processing paths are determined. Based on the preset second extraction rule and the redundant path, the second feature of the path branch point is determined. The second feature includes: the difference in the carried value of the path branch point at the first time and the second time, the value of the difference carried value, and the execution processing computing power of the path branch. The adjustment degree value is determined based on the second feature and the preset adjustment degree determination table; The path similarity is adjusted based on the degree of adjustment value to obtain the adjustment value.

Images