Remote cooperation method and device, electronic equipment and storage medium
By keeping multiple operating sites in the same virtual environment during the product design process and synchronizing operation actions with interactive hardware, the problem of inefficiency under geographical and time constraints is solved, real-time and efficient remote collaborative design is achieved.
Patent Information
- Application Number
- CN202510333642.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-03-20
- Publication Date
- 2025-07-04
AI Technical Summary
During the product design process, due to geographical and time constraints, professionals from different regions have become inefficient in collaboration.
By installing the same target simulation software and hardware on the terminal devices of multiple operating sites, they are in the same virtual environment, and using interactive hardware to track operation perspectives, synchronize operation actions to other sites, real-time collaboration between multiple operating sites is achieved.
Real-time and efficient collaboration between multiple operating sites for virtual object prototypes is achieved, which improves collaboration efficiency, shortens design cycles, and improves design quality and resource utilization.
Smart Images
Figure CN120256005A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the technical field of remote collaboration, and particularly to a remote collaboration method, apparatus, electronic device, and storage medium. Background Art
[0002] With the white-hot market competition and the increasingly diverse and personalized consumer demands, enterprises have put forward unprecedented high requirements for the efficiency, quality, and innovation of product design. Most products need to converge the wisdom of professionals from all parties for efficient collaborative design.
[0003] However, in the actual product development or design process, gathering professionals from different regions, especially different countries, to work together is restricted by geography, time, etc., resulting in low collaboration efficiency for a certain product development or design. Summary of the Invention
[0004] This application provides a remote collaboration method, apparatus, electronic device, and storage medium to solve problems such as low collaboration efficiency in related technologies.
[0005] In a first aspect embodiment of this application, a remote collaboration method is provided. The remote collaboration method is applied to a remote collaboration system. The remote collaboration system includes multiple operation sites and a virtual object prototype. The multiple operation sites are located in the same virtual environment, and the method includes the following steps: identifying the current operation site of the virtual object prototype; identifying the operation actions of the current operation site; synchronizing the operation actions of the current operation site to the perspectives of other operation sites, where the other operation sites design and / or modify the virtual object prototype after the current site's operation to achieve remote collaboration of the virtual object prototype by multiple operation sites.
[0006] Optionally, in an embodiment of this application, before identifying the current operation site of the virtual object prototype, it further includes: installing the same target simulation software on the terminal devices of multiple operation sites and connecting the same target hardware to the terminal devices of multiple operation sites to make multiple operation sites in the same virtual environment, where the same target hardware includes display hardware and interaction hardware.
[0007] Optionally, in an embodiment of this application, identifying the operation actions of the current site includes: detecting the finger movement of the interaction hardware on the current operation site and / or the selection action of the current operation site on the menu bar of the target simulation software; determining the operation actions of the current operation site according to the finger movement and / or the selection action.
[0008] Optionally, in an embodiment of the present application, synchronizing the operation actions of the current operation site to the perspectives of other operation sites includes: using interactive hardware to track the current operation perspective of the current operation site; synchronizing the operation actions of the current operation site in the current operation perspective to the perspectives of other operation sites.
[0009] Optionally, in an embodiment of the present application, multiple operation sites communicate through multicast. The forms of multicast include audio multicast and video multicast, and the multicast addresses of multiple operation sites are the same as the port numbers of the corresponding terminal devices.
[0010] Optionally, in an embodiment of the present application, it further includes: obtaining the virtual test scenario of the target simulation software; identifying the target virtual test scenario and test parameters selected by the current operation site, and testing the virtual object prototype with the target virtual test scenario on the target simulation software; multicasting the test results of the current operation site to other operation sites, where the current operation site and other operation sites evaluate the test results to modify the test parameters and / or design parameters of the virtual object prototype.
[0011] Optionally, in an embodiment of the present application, it further includes: detecting the site status of multiple operation sites; if the site status of any operation site is the offline status, sending the offline status information to other operation sites.
[0012] An embodiment of the second aspect of the present application provides a remote collaboration device. The remote collaboration device is applied to a remote collaboration system. The remote collaboration system includes multiple operation sites and a virtual object prototype. The multiple operation sites are located in the same virtual environment, including: a first identification module for identifying the current operation site of the virtual object prototype; a second identification module for identifying the operation actions of the current operation site; a synchronization module for synchronizing the operation actions of the current operation site to the perspectives of other operation sites, where other operation sites design and / or modify the virtual object prototype after the current site's operation to achieve remote collaboration of the virtual object prototype by multiple operation sites.
[0013] Optionally, in an embodiment of the present application, it further includes: an installation module for installing the same target simulation software on the terminal devices of multiple operation sites and accessing the same target hardware on the terminal devices of multiple operation sites before identifying the current operation site of the virtual object prototype, so that multiple operation sites are in the same virtual environment, where the same target hardware includes display hardware and interactive hardware.
[0014] Optionally, in an embodiment of the present application, the second recognition module is further configured to: detect the finger movement of the interaction hardware at the current operation site and / or the selection action of the current operation site on the menu bar of the target simulation software; determine the operation action of the current operation site according to the finger movement and / or the selection action.
[0015] Optionally, in an embodiment of the present application, it further includes: a tracking module, configured to, when synchronizing the operation action of the current operation site to the perspectives of other operation sites, use the interaction hardware to track the current operation perspective of the current operation site; synchronize the operation action of the current operation site in the current operation perspective to the perspectives of other operation sites.
[0016] Optionally, in an embodiment of the present application, multiple operation sites communicate through multicast, and the forms of multicast include audio multicast and video multicast. The multicast addresses of multiple operation sites are the same as the port numbers of the corresponding terminal devices.
[0017] Optionally, in an embodiment of the present application, it further includes: a testing module, configured to obtain the virtual test scenario of the target simulation software; identify the target virtual test scenario and test parameters selected by the current operation site, and perform tests on the virtual object prototype in the target virtual test scenario on the target simulation software; multicast the test results of the current operation site to other operation sites, where the current operation site and other operation sites evaluate the test results to modify the test parameters and / or design parameters of the virtual object prototype.
[0018] Optionally, in an embodiment of the present application, it further includes: a detection module, configured to detect the site status of multiple operation sites; if the site status of any operation site is an offline status, send the offline status information to other operation sites.
[0019] An embodiment of the third aspect of the present application provides an electronic device, including: a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor executes the program to execute the remote collaboration method as described in the above embodiments.
[0020] An embodiment of the fourth aspect of the present application provides a computer-readable storage medium, on which a computer program or instruction is stored, and the computer program or instruction is executed by a processor to execute the remote collaboration method as described in the above embodiments.
[0021] An embodiment of the fifth aspect of the present application provides a computer program product, including a computer program or instruction, and when the computer program or instruction is executed, it implements the remote collaboration method as described in the above embodiments.
[0022] Therefore, the present application has at least the following beneficial effects:
[0023] Embodiments of the present application can enable multiple operation sites to be in the same virtual environment, and can synchronize the operation actions of the current operation site on the virtual object prototype to the perspectives of other operation sites, so that other operation sites can see the operations of the current operation site in real time, and other operation sites can design and modify the virtual object prototype after the current site's operation, so as to achieve real-time and efficient collaborative operations on the virtual object prototype among multiple operation sites and improve the collaboration efficiency. Thus, the technical problems such as low collaboration efficiency in the related art are solved.
[0024] Additional aspects and advantages of the present application will be given in part in the following description, become apparent in part from the following description, or be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] The above and / or additional aspects and advantages of the present application will become apparent and be readily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:
[0026] Figure 1 is a flowchart of a remote collaboration method according to an embodiment of the present application;
[0027] Figure 2 is an exemplary diagram of a remote collaboration device according to an embodiment of the present application;
[0028] Figure 3 is a schematic structural diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0029] The embodiments of the present application will be described in detail below. The examples of the embodiments are shown in the accompanying drawings, in which the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to explain the present application and should not be construed as limiting the present application.
[0030] The remote collaboration method, device, electronic device, and storage medium according to the embodiments of the present application will be described below with reference to the accompanying drawings. In view of the problem mentioned in the above background art that in the actual product design process, it is restricted by geography, time, etc. to gather professionals from different regions, especially different countries, to work together, resulting in low collaboration efficiency, the present application provides a remote collaboration method. In this method, multiple operation sites can be in the same virtual environment, and the operation actions of the current operation site on the virtual object prototype can be synchronized to the perspectives of other operation sites, so that other operation sites can see the operations of the current operation site in real time, and other operation sites can design and modify the virtual object prototype after the current site's operation, so as to achieve real-time and efficient collaborative operations on the virtual object prototype among multiple operation sites and improve the collaboration efficiency. Thus, the problems such as low collaboration efficiency in the related art are solved.
[0031] Specifically, Figure 1 FIG. is a schematic flowchart of a remote collaboration method provided by an embodiment of the present application.
[0032] As Figure 1 shown, this remote collaboration method is applied to a remote collaboration system. The remote collaboration system includes multiple operation sites and a virtual object prototype. The multiple operation sites are located in the same virtual environment, and the method includes the following steps:
[0033] In step S101, identify the current operation site of the virtual object prototype.
[0034] Among them, the operation site is a site that can perform operations on the virtual object prototype, that is, each working node participating in the remote collaboration, usually corresponding to engineer teams in different regions. The virtual object prototype is a digital model used for design, operation, and evaluation in the virtual environment, that is, the product of digital simulation of a real physical item or product. In the embodiments of the present application, the virtual object prototype is taken as a virtual vehicle as an example.
[0035] In the embodiments of the present application, before identifying the current operation site of the virtual object prototype, it further includes: installing the same target simulation software on the terminal devices of multiple operation sites, and connecting the same target hardware to the terminal devices of multiple operation sites, so that multiple operation sites are in the same virtual environment, where the same target hardware includes display hardware and interaction hardware.
[0036] Among them, the terminal device is the carrier for engineers at each operation site to operate on the virtual object prototype, which can be a computer, and the target simulation software can be VPS (Virtual Prototyping System) software; the target hardware includes display hardware and interaction hardware. The display hardware is VR display, including CAVE (Cave Automatic Virtual Environment) and Responsive Workbench, and the interaction hardware can include 3D mouse, head tracking, hand tracking, stylus, CyberGlove glove device, etc.
[0037] It can be understood that in the embodiments of the present application, the same target simulation software can be installed on the terminal devices at multiple operation sites and connected to the same target hardware, so as to ensure that multiple operation sites can work in the same virtual environment, providing a basic condition for remote collaboration, enabling engineers at different sites to perform collaborative design based on the same virtual environment, and avoiding collaborative problems caused by environmental differences.
[0038] In step S102, identify the operation actions of the current operation site.
[0039] It can be understood that in the embodiments of the present application, the operation actions of the current operation site can be identified so as to transmit the current operation actions of the current operation site to other operation sites subsequently to achieve information synchronization.
[0040] In the embodiments of the present application, identifying the operation actions of the current site includes: detecting the finger movement of the interaction hardware at the current operation site and / or the selection action of the current operation site on the menu bar of the target simulation software; determining the operation actions of the current operation site according to the finger movement and / or the selection action.
[0041] It can be understood that in the embodiments of the present application, the finger movement of the interaction hardware at the current operation site and the selection action on the menu bar of the target simulation software can be detected, and the operation actions of the current operation site are determined according to the finger movement and the selection action, providing accurate operation information for subsequent collaborative design.
[0042] In step S103, synchronize the operation actions of the current operation site to the perspectives of other operation sites, where other operation sites design and / or modify the virtual object prototype after the current site's operation, so as to achieve remote collaboration of the virtual object prototype by multiple operation sites.
[0043] It can be understood that the embodiments of the present application can synchronize the operation actions of the current operation site to the perspective of other operation sites, so that other operation sites can see the operations of the current operation site in real time, and other operation sites can design, modify, etc. the virtual object prototype after the current site's operation, so as to realize the remote collaboration of multiple operation sites on the virtual object prototype and achieve real-time and efficient collaborative operations on the virtual object prototype among multiple operation sites.
[0044] In the embodiments of the present application, when synchronizing the operation actions of the current operation site to the perspective of other operation sites, it includes: using interactive hardware to track the current operation perspective of the current operation site; synchronizing the operation actions of the current operation site under the current operation perspective to the perspective of other operation sites.
[0045] It can be understood that the embodiments of the present application can use interactive hardware to track the current operation perspective of the current operation site, and synchronize the operation actions of the current operation site under the current operation perspective to the perspective of other operation sites, so as to enhance the intuitiveness of collaboration, facilitate engineers at other operation sites to understand the intentions of engineers at the current operation site, avoid problems in subsequent collaboration due to perspective differences, and improve the collaboration effect.
[0046] In the embodiments of the present application, multiple operation sites communicate through multicast. The forms of multicast include audio multicast and video multicast. The multicast addresses of multiple operation sites are the same as the port numbers of the corresponding terminal devices.
[0047] Among them, multicast is a network communication method that allows a host to perform audio multicast using the audio tool vat, and video multicast can be performed using the video tools nv or vic.
[0048] It can be understood that multiple operation sites in the embodiments of the present application communicate through multicast, and the multicast addresses of multiple operation sites are the same as the port numbers of the terminal devices, ensuring stable and efficient communication among multiple operation sites, ensuring the timely synchronization of information such as operation actions, audio, and video, reducing network latency, and improving the real-time performance and stability of remote collaboration.
[0049] In the embodiments of the present application, it further includes: obtaining the virtual test scenario of the target simulation software; identifying the target virtual test scenario and test parameters selected by the current operation site, and performing tests on the virtual object prototype in the target virtual test scenario on the target simulation software; multicasting the test results of the current operation site to other operation sites, where the current operation site and other operation sites evaluate the test results to modify the test parameters and / or design parameters of the virtual object prototype.
[0050] It can be understood that in the embodiments of the present application, the target simulation software provides a virtual test scenario, which can identify the target virtual test scenario and test parameters selected by the current operation site, test the virtual object prototype on the target simulation software, multicast the test results to other operation sites, and each site jointly evaluates the test results, and then modifies the test parameters and design parameters of the virtual object prototype, so as to achieve a comprehensive test and optimization of the virtual object prototype. Through multi-site collaborative evaluation, the comprehensiveness and accuracy of the test are improved, design problems are discovered and solved in advance, and the design quality is enhanced.
[0051] In the embodiments of the present application, it further includes: detecting the site status of multiple operation sites; if the site status of any operation site is an offline state, sending the offline state information to other operation sites.
[0052] Among them, the site status includes an online state and an offline state.
[0053] It can be understood that in the embodiments of the present application, the site status of multiple operation sites can be detected. If there is an operation site in an offline state, the offline state information of the operation site is sent to other operation sites, so that other operation sites can timely understand the change of the site status, facilitate the adjustment of the collaboration strategy, avoid collaboration chaos caused by site offline, and ensure the orderliness of the collaboration process.
[0054] The remote collaboration method of the present application is described below through a specific embodiment. Taking the remote collaboration method for vehicle design as an example for description, so as to achieve real-time and efficient collaboration among remote engineers. It is described in the manner of the components of the remote collaboration system, including:
[0055] 1. Distributed virtual environment.
[0056] It supports multiple remote sites to join the shared virtual environment, and the sites communicate with each other through multicast. This enables engineers from different regions to collaborate in the same virtual space, breaking the limitation of geographical distance. The system integrates a real-time video transmission function, enabling engineers to see the perspective positions and directions of other participants in the shared virtual environment. This visual collaboration method can more intuitively display design ideas and problems, improving communication efficiency. The system supports collaborative design review and interactive redesign. Engineers can jointly evaluate and modify the design in the virtual environment, give feedback in a timely manner, and greatly shorten the design cycle.
[0057] 2. Virtual prototype (virtual vehicle) generation.
[0058] Based on the existing virtual prototype system, it provides network communication functions with remote sites. This enables engineers at different sites to share and operate virtual prototypes in real time, collaborating to complete design tasks. Creating virtual prototypes of vehicles from the same CAD design ensures design consistency and accuracy. At the same time, using concurrent design principles improves product effectiveness and the efficiency of the design process. Integrating dynamic simulation software allows engineers to drive and test vehicles in a virtual environment in real time, detecting potential problems in advance and optimizing design solutions. A virtual test site is created, with the environment modeled in Alias and textures created in Adobe Photoshop, providing a more realistic scenario for vehicle testing.
[0059] 3. VR display and interaction hardware.
[0060] It includes display devices such as CAVE (Cave Automatic Virtual Environment) and Responsive Workbench. CAVE is a 10-foot by 10-foot by 9-foot surround-screen, surround-sound cube projected onto the walls and floor, providing an immersive experience for users. It is equipped with two SGI Onyxes and four Reality Engines for scene culling and rendering, ensuring high-quality graphics display. Stereoscopic glasses (CrystalEyes) are used to provide synchronization, and head tracking provides the operator's position within the CAVE floor space, allowing for depth perception and a realistic assessment of vehicle cab visibility. The basic viewpoint can be attached to the cab of the virtual vehicle, or a 3D mouse called a wand can be used to move in the virtual world. The wand has a tracker, three buttons, and a joystick, facilitating user interaction. The graphics of Responsive Workbench are generated using an SGI Onyx with one Reality Engine and viewed in stereo using CrystalEyes shutter glasses. The input system includes head tracking, hand tracking, a CyberGlove glove device for detecting finger movement, and a stylus, providing diverse interaction methods.
[0061] 4. Communication with remote sites.
[0062] Any site with the above simulation software can join or leave the shared virtual environment at any time, offering high flexibility. Each site maintains its own viewpoint, and the simulation software and all virtual object prototypes are stored locally, reducing network latency and data transfer volume. It communicates with other sites using the same multicast address and port number, establishing a list of active sites by sending messages containing unique integer identifiers and computer names, and sending messages to notify other sites when a site leaves. A site can rejoin at any time, ensuring the stability and reliability of communication. Each site sends all information to maintain the synchronization of the virtual environment, and the position and orientation information is absolute to ensure that lost data packets do not disrupt synchronization. Each site sends its own viewpoint so that other sites can place incoming multicast video transmissions at the corresponding viewpoints. Each site also uses virtual pointers to enhance collaboration with other sites, improving collaboration efficiency.
[0063] 5. Changes to the shared virtual environment are communicated only through the network, minimizing security concerns. Any information obtained by a third party will be useless, protecting the security of design data. The communication of object files and simulation code must be handled in the same way as the current transmission of sensitive data to global factories, ensuring the security and confidentiality of data transmission.
[0064] 6. Audio and video transmission.
[0065] In this embodiment, SGI Indys can be selected to obtain microphone and camera inputs and perform multicast through the network. Wide-angle, low-light cameras and PZM microphones are used to ensure high-quality audio and video acquisition. The audio tool vat uses IP multicast for audio transmission at a frequency of 8 kHz, with a bandwidth of 64 kilobits per second per site, providing clear audio communication. Video transmission uses a modified version of the Xerox PARC tool nv. The video input is digitized on the Indy and sent through the network. At other sites, the nv version receives the multicast video, converts the video format to RGB, and applies it to the polygons located at the viewpoints of the corresponding remote sites, forming a dynamic texture that displays the incoming video transmission. The bandwidth usage is approximately 900 kilobits per second per sending site (30 frames per second, 640×480 images), ensuring the smoothness and real-time nature of video transmission. The video tool nv can be replaced by vic. According to relevant research, vic uses H.261 encoding and is two to four times more efficient in bandwidth usage than nv, providing users with more options.
[0066] 7. Network requirements.
[0067] TCP / IP and routing multicast connections are required between all machines for simulation, audio, and video, ensuring the stability and reliability of data transmission. The bandwidth requirements are as follows: location information is 40 Kbps, video communication is approximately 1800 Kbps (30 frames per second, 640×480 images, two machines), and audio communication is 64 Kbps, meeting the system's requirements for different types of data transmission. The maximum latency is initially estimated to be 0.1 seconds, subject to experimental verification. By continuously optimizing network performance, reducing latency, and improving the real-time performance of the system.
[0068] In summary, the remote collaboration method for vehicle design in this embodiment realizes efficient collaboration among remote engineers through the coordinated work of multiple aspects such as distributed virtual environment, virtual prototype generation, VR display and interaction hardware, runtime software, communication with remote sites, security assurance, and audio and video transmission. Specifically, it includes:
[0069] Through real-time collaboration and interactive design review, the design cycle is shortened, the product launch speed is accelerated, and the design efficiency is improved; engineers can conduct comprehensive testing and evaluation of the vehicle in a virtual environment, discover and solve problems in advance, and improve the product quality; the production and transportation costs of physical prototypes are reduced, while the resource utilization rate is improved and the cost is reduced; functions such as real-time video transmission and virtual pointers enable engineers to communicate and collaborate more intuitively, improving the collaboration effect; more remote sites and functional modules can be added according to actual needs to meet the requirements of design projects of different scales and complexities, and it has good scalability.
[0070] According to the remote collaboration method proposed in the embodiment of the present application, multiple operating sites can be in the same virtual environment, and the operation actions of the current operating site on the virtual object prototype can be synchronized to the perspectives of other operating sites, so that other operating sites can see the operations of the current operating site in real time, and other operating sites can design and modify the virtual object prototype after the current site's operation, so as to realize real-time and efficient collaborative operations on the virtual object prototype among multiple operating sites and improve the collaboration efficiency.
[0071] Secondly, a remote collaboration device proposed in the embodiment of the present application is described with reference to the accompanying drawings.
[0072] Figure 2 It is a block diagram of the remote collaboration device according to the embodiment of the present application.
[0073] As Figure 2 shown, the remote collaboration device 10 is applied to a remote collaboration system. The remote collaboration system includes multiple operating sites and a virtual object prototype. The multiple operating sites are located in the same virtual environment and include: a first identification module 100, a second identification module 200, and a synchronization module 300.
[0074] Among them, the first recognition module 100 is used to recognize the current operation site of the virtual object prototype; the second recognition module is used to recognize the operation actions at the current operation site; the synchronization module 200 is used to synchronize the operation actions at the current operation site to the perspectives of other operation sites, where the other operation sites design and / or modify the virtual object prototype after the operation on the current site, so as to realize the remote collaboration of multiple operation sites on the virtual object prototype.
[0075] In the embodiment of the present application, the device 10 of the present application further includes: an installation module.
[0076] Among them, the installation module is used to install the same target simulation software on the terminal devices of multiple operation sites and connect the same target hardware to the terminal devices of multiple operation sites before recognizing the current operation site of the virtual object prototype, so that multiple operation sites are in the same virtual environment, where the same target hardware includes display hardware and interaction hardware.
[0077] In the embodiment of the present application, the second recognition module 200 is further used to: detect the finger movement of the interaction hardware at the current operation site and / or the selection action of the current operation site on the menu bar of the target simulation software; determine the operation action of the current operation site according to the finger movement and / or the selection action.
[0078] In the embodiment of the present application, the device 10 of the present application further includes: a tracking module.
[0079] Among them, the tracking module is used to track the current operation perspective of the current operation site with the interaction hardware when synchronizing the operation action of the current operation site to the perspectives of other operation sites; synchronize the operation action of the current operation site in the current operation perspective to the perspectives of other operation sites.
[0080] In the embodiment of the present application, multiple operation sites communicate through multicast, and the forms of multicast include audio multicast and video multicast. The multicast addresses of multiple operation sites are the same as the port numbers of the corresponding terminal devices.
[0081] In the embodiment of the present application, the device 10 of the present application further includes: a testing module.
[0082] Among them, the testing module is used to obtain the virtual test scenario of the target simulation software; recognize the target virtual test scenario and test parameters selected by the current operation site, and test the virtual object prototype with the target virtual test scenario on the target simulation software; multicast the test results of the current operation site to other operation sites, where the current operation site and other operation sites evaluate the test results to modify the test parameters and / or design parameters of the virtual object prototype.
[0083] In an embodiment of the present application, the apparatus 10 of the present application further includes: a detection module.
[0084] The detection module is configured to detect the site status of multiple operation sites; if the site status of any operation site is an offline status, the offline status information is sent to other operation sites.
[0085] It should be noted that the foregoing explanation of the remote collaboration method embodiment is also applicable to the remote collaboration apparatus of this embodiment, and will not be elaborated here.
[0086] The remote collaboration apparatus proposed according to the embodiment of the present application can enable multiple operation sites to be in the same virtual environment, and can synchronize the operation actions of the current operation site on the virtual object prototype to the perspectives of other operation sites, so that other operation sites can see the operations of the current operation site in real time, and other operation sites can design and modify the virtual object prototype after the current site's operation, so as to realize real-time and efficient collaborative operations on the virtual object prototype among multiple operation sites and improve the collaboration efficiency.
[0087] Figure 3 The remote collaboration is a schematic structural diagram of an electronic device provided in an embodiment of the present application. The electronic device may include:
[0088] A memory 301, a processor 302, and a computer program stored on the memory 301 and executable on the processor 302.
[0089] When the processor 302 executes the program, it implements the remote collaboration method provided in the foregoing embodiment.
[0090] Further, the electronic device further includes:
[0091] A communication interface 303 for communication between the memory 301 and the processor 302.
[0092] The memory 301 is used to store a computer program executable on the processor 302.
[0093] The memory 301 may include a high-speed RAM memory, and may also include non-volatile memory, such as at least one disk memory.
[0094] If the memory 301, the processor 302, and the communication interface 303 are implemented independently, the communication interface 303, the memory 301, and the processor 302 can be interconnected through a bus and communicate with each other. The bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 3 only a thick line is used to represent it in Figure 3 , but it does not mean that there is only one bus or one type of bus.
[0095] Optionally, in a specific implementation, if the memory 301, the processor 302, and the communication interface 303 are integrated on a single chip, the memory 301, the processor 302, and the communication interface 303 can communicate with each other through an internal interface.
[0096] The processor 302 may be a Central Processing Unit (CPU), or an Application Specific Integrated Circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application.
[0097] The embodiments of the present application further provide a computer-readable storage medium, on which a computer program or instruction is stored. When the computer program or instruction is executed by a processor, the above remote collaboration method is implemented.
[0098] The embodiments of the present application further provide a computer program product, including a computer program or instruction. When the computer program or instruction is executed, the above remote collaboration method is implemented.
[0099] In the description of this specification, the descriptions referring to terms such as "one embodiment", "some embodiments", "example", "specific example", or "some examples" mean that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of this application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described can be combined in any one or N embodiments or examples in a suitable manner. In addition, without contradiction, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of different embodiments or examples.
[0100] In addition, the terms "first" and "second" are used for descriptive purposes only and cannot be construed as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, the features defined with "first" and "second" may explicitly or implicitly include at least one of such features. In the description of this application, "N" means at least two, such as two, three, etc., unless otherwise specifically defined.
[0101] Any process or method description shown in the flowchart or described in other ways herein can be understood to represent a module, segment, or portion of code including one or N executable instructions for implementing a customized logical function or process, and the scope of the preferred embodiments of this application includes additional implementations, where the functions can be executed in a substantially simultaneous manner or in a reverse order according to the functions involved, rather than in the order shown or discussed, which should be understood by those skilled in the technical field to which the embodiments of this application belong.
[0102] It should be understood that each part of this application can be implemented by hardware, software, firmware, or a combination thereof. In the above embodiments, the N steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any combination of one or more of the following techniques known in the art: discrete logic circuits having logic gate circuits for implementing logical functions on data signals, application specific integrated circuits having appropriate combinational logic gate circuits, programmable gate arrays, field programmable gate arrays, etc.
[0103] Those of ordinary skill in the technical field of this application can understand that all or part of the steps carried by the methods of the above embodiments can be completed by instructing relevant hardware through a program, and the program can be stored in a computer-readable storage medium. When the program is executed, it includes one or a combination of the steps of the method embodiments.
Claims
1. A remote collaboration method, characterized in that, The remote collaboration method is applied to a remote collaboration system, which includes multiple operation sites and a virtual object prototype. The multiple operation sites are located in the same virtual environment and the method includes the following steps: Identify the current operation site of the virtual object prototype; Identify the operation actions of the current operation site; Synchronize the operation actions of the current operation site to the perspectives of other operation sites. Among them, the other operation sites design and / or modify the virtual object prototype after the current site's operation to achieve remote collaboration on the virtual object prototype by the multiple operation sites.
2. The remote collaboration method according to claim 1, wherein Before identifying the current operation site of the virtual object prototype, it further includes: Install the same target simulation software on the terminal devices of the multiple operation sites and connect the same target hardware to the terminal devices of the multiple operation sites, so that the multiple operation sites are in the same virtual environment. Among them, the same target hardware includes display hardware and interaction hardware.
3. The remote collaboration method according to claim 2, wherein The identification of the operation actions of the current site includes: Detect the finger movement of the interaction hardware on the current operation site and / or the selection actions of the current operation site on the menu bar of the target simulation software; Determine the operation actions of the current operation site according to the finger movement and / or the selection actions.
4. The remote collaboration method according to claim 2, characterized in that, When synchronizing the operation actions of the current operation site to the perspectives of other operation sites, it includes: Use the interaction hardware to track the current operation perspective of the current operation site; Synchronize the operation actions of the current operation site in the current operation perspective to the perspectives of other operation sites.
5. The remote collaboration method according to claim 1, wherein The multiple operation sites communicate through multicast. The forms of multicast include audio multicast and video multicast. The multicast addresses of the multiple operation sites and the port numbers of the corresponding terminal devices are the same.
6. The remote collaboration method according to claim 2, wherein It further includes: Obtain the virtual test scenario of the target simulation software; Identify the target virtual test scenario and test parameters selected by the current operation site, and test the virtual object prototype with the target virtual test scenario on the target simulation software; Multicast the test results of the current operation site to other operation sites. Among them, the current operation site and the other operation sites evaluate the test results to modify the test parameters and / or design parameters of the virtual object prototype.
7. The remote collaboration method according to claim 1, wherein It further includes: Detect the site status of the multiple operation sites; If the site status of any operation site is in an offline state, send the offline status information to the other operation sites.
8. A remote collaboration device, characterized in that, The remote collaboration device is applied to a remote collaboration system, which includes multiple operation sites and a virtual object prototype. The multiple operation sites are located in the same virtual environment and includes: The first identification module is used to identify the current operation site of the virtual object prototype; The second identification module is used to identify the operation actions of the current operation site; A synchronization module, configured to synchronize the operation actions of the current operation site to the perspectives of other operation sites, wherein the other operation sites design and / or modify the virtual object prototype after the current site's operation, so as to implement remote collaboration of the multiple operation sites on the virtual object prototype.
9. An electronic device, characterized in that, It includes: A memory, a processor, and a computer program stored on the memory and executable on the processor, and the processor executes the program to implement the remote collaboration method according to any one of claims 1-7.
10. A computer-readable storage medium having a computer program or instructions stored thereon, characterized in that, The computer program or instruction is executed by the processor to implement the remote collaboration method according to any one of claims 1-7.