A cloud multi-person collaboration and AR real-time collaboration method, device, medium and equipment
Patent Information
- Application Number
- CN202211607272.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-12-14
- Publication Date
- 2026-09-15
- Estimated Expiration
- 2042-12-14
AI Technical Summary
[0003]传统的虚拟化技术无法提供AR实时预览文件的云服务,原因是文件格式的不兼容性导致无法在多平台中实时AR预览
[0040]In one embodiment of this disclosure, the aforementioned cloud-based multi-user collaboration and AR real-time collaboration method achieves the following: First, the virtual machine/physical machine receives requests from various user terminals sent by the cloud access management system, enabling each user terminal to operate on the same model file through its respective virtual machine/physical machine. The virtual machine/physical machine modifies the model file based on the corresponding user-initiated model file modification request sent by the cloud access management system and synchronizes the modified model file to the synchronization server, achieving real-time synchronization of the modified model file. Second, the synchronized model file is rendered into an AR image by an AR rendering server, resulting in a rendered AR image. This rendered AR image can be distributed to various user terminals via the cloud access management system, allowing for decoding and display on each user terminal. This method enables multiple users in different locations to simultaneously modify files and preview them in real-time cloud AR, offering advantages such as convenient user collaboration, low cost, and ease of management.
Smart Images

Figure CN115981845B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of cloud service technology, and in particular to a cloud-based multi-person collaboration and AR real-time collaboration method, apparatus, medium and device. Background Technology
[0002] Virtualization refers to using virtualization technology to transform a single computer into multiple logical computers. Multiple logical computers can run simultaneously on a single physical computer, each running a different operating system, and applications can run in independent spaces without interfering with each other, thus significantly improving computer efficiency.
[0003] Traditional virtualization technology cannot provide cloud services for real-time AR preview of files because file format incompatibility makes real-time AR preview impossible across multiple platforms.
[0004] Therefore, it is necessary to provide a new technical solution to improve one or more of the problems existing in the above solutions.
[0005] It should be noted that the information disclosed in the background section above is only used to enhance the understanding of the background of this disclosure, and therefore may include information that does not constitute prior art known to those skilled in the art. Summary of the Invention
[0006] The purpose of this disclosure is to provide a cloud-based multi-user collaboration and AR real-time collaboration method, apparatus, medium and device, thereby overcoming at least to some extent one or more problems caused by the limitations and defects of related technologies.
[0007] According to a first aspect of the present disclosure, a cloud-based multi-user collaboration and AR real-time collaboration method is provided, the method comprising:
[0008] The virtual machine / physical machine receives information from various user terminals requesting virtual machines / physical machines sent by the cloud access management system, so that each user terminal can operate on the same model file through its respective virtual machine / physical machine;
[0009] The virtual machine / physical machine modifies the model file according to the model file modification request initiated by the corresponding user terminal sent by the cloud access management system;
[0010] The modified model file will then be synchronized to the synchronization server.
[0011] The synchronized model file is distributed to the AR rendering server, so that the AR rendering server can render the synchronized model file into an AR image to obtain the rendered AR image.
[0012] The rendered AR image is distributed to each user terminal for decoding and display through the cloud access management system.
[0013] In embodiments of this disclosure, before synchronizing the modified model file to the synchronization server, the method further includes:
[0014] The virtual machine / physical machine is connected to the synchronization server.
[0015] In embodiments of this disclosure, the step of distributing the synchronized model file to an AR rendering server so that the AR rendering server can render an AR image from the synchronized model file to obtain the rendered AR image further includes:
[0016] The rendered AR image is encoded to obtain the rendered and encoded AR image.
[0017] According to a second aspect of the present disclosure, a cloud-based multi-user collaboration and AR real-time collaboration method is provided, the method comprising:
[0018] The cloud access management system receives requests for virtual machines / physical machines from various user terminals;
[0019] The cloud access management system allocates hosts based on the received request virtual machine / physical machine messages, so that each user terminal can operate on the same model file through its assigned host;
[0020] The cloud access management system sends the model file modification requests initiated by each user terminal to the respective assigned host, so that each user terminal can modify and synchronize the model file through its respective assigned host, and the respective assigned host can render AR images on the synchronized model file.
[0021] After receiving the rendered AR image, the cloud access management system sends the rendered AR image to each user terminal for decoding and display.
[0022] In embodiments of this disclosure, the step of the cloud access management system allocating hosts based on received request messages includes:
[0023] The host is assigned according to a preset assignment type, and the assigned host is started; wherein, the preset assignment type includes manual assignment and automatic assignment.
[0024] According to a second aspect of the present disclosure, a cloud-based multi-user collaboration and AR real-time collaboration device is provided, the device comprising:
[0025] The receiving module is used for the virtual machine / physical machine to receive information from the cloud access management system regarding requests from various user terminals to the virtual machine / physical machine, so that each user terminal can operate on the same model file through its respective virtual machine / physical machine;
[0026] The modification module is used by the virtual machine / physical machine to modify the model file according to the model file modification request initiated by the corresponding user terminal sent by the cloud access management system;
[0027] A synchronization module is used to synchronize the modified model file to a synchronization server.
[0028] The rendering module is used to distribute the synchronized model file to the AR rendering server, so that the AR rendering server can render the synchronized model file into an AR image to obtain the rendered AR image.
[0029] The sending module is used to distribute the rendered AR image to various user terminals for decoding and display through the cloud access management system.
[0030] In embodiments of this disclosure, the device further includes:
[0031] A connection module is used for the virtual machine / physical machine to connect to the synchronization server.
[0032] In embodiments of this disclosure, the device further includes:
[0033] The encoding module is used to encode the rendered AR image to obtain the rendered and encoded AR image.
[0034] According to a fourth aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, which, when executed by a processor, implements the steps of the cloud-based multi-user collaboration and AR real-time collaboration method described in any of the above embodiments.
[0035] According to a fifth aspect of the present disclosure, an electronic device is provided, comprising:
[0036] Processor; and
[0037] Memory for storing the executable instructions of the processor;
[0038] The processor is configured to execute the steps of the cloud-based multi-user collaboration and AR real-time collaboration method described in any of the above embodiments by executing the executable instructions.
[0039] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects:
[0040] In one embodiment of this disclosure, the aforementioned cloud-based multi-user collaboration and AR real-time collaboration method achieves the following: First, the virtual machine / physical machine receives requests from various user terminals sent by the cloud access management system, enabling each user terminal to operate on the same model file through its respective virtual machine / physical machine. The virtual machine / physical machine modifies the model file based on the corresponding user-initiated model file modification request sent by the cloud access management system and synchronizes the modified model file to the synchronization server, achieving real-time synchronization of the modified model file. Second, the synchronized model file is rendered into an AR image by an AR rendering server, resulting in a rendered AR image. This rendered AR image can be distributed to various user terminals via the cloud access management system, allowing for decoding and display on each user terminal. This method enables multiple users in different locations to simultaneously modify files and preview them in real-time cloud AR, offering advantages such as convenient user collaboration, low cost, and ease of management.
[0041] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description
[0042] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure. It is obvious that the drawings described below are merely some embodiments of this disclosure, and those skilled in the art can obtain other drawings based on these drawings without any inventive effort.
[0043] Figure 1 This schematically illustrates a flowchart of a cloud-based multi-user collaboration and AR real-time collaboration method according to an exemplary embodiment of the present disclosure;
[0044] Figure 2 This schematic diagram illustrates the interaction between computing resources, a resource management platform, and a user terminal in an exemplary embodiment of this disclosure.
[0045] Figure 3 A flowchart illustrating another cloud-based multi-user collaboration and AR real-time collaboration method in an exemplary embodiment of this disclosure is shown schematically.
[0046] Figure 4 This schematic diagram illustrates a block diagram of a cloud-based multi-user collaboration and AR real-time collaboration device according to an exemplary embodiment of the present disclosure;
[0047] Figure 5 This illustration schematically depicts a program product according to an exemplary embodiment of the present disclosure;
[0048] Figure 6The schematic diagram illustrates an electronic device according to an exemplary embodiment of the present disclosure. Detailed Implementation
[0049] Exemplary embodiments will now be described more fully with reference to the accompanying drawings. However, these exemplary embodiments can be implemented in many forms and should not be construed as limited to the examples set forth herein; rather, they are provided so that this disclosure will be more comprehensive and complete, and will fully convey the concept of the exemplary embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
[0050] Furthermore, the accompanying drawings are merely illustrative of this disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and therefore repeated descriptions of them will be omitted. Some block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different network and / or processor devices and / or microcontroller devices.
[0051] This example implementation first provides a cloud-based multi-user collaboration and AR real-time collaboration method. (Reference) Figure 1 As shown, the method may include:
[0052] Step S101: The virtual machine / physical machine receives information from the cloud access management system requesting virtual machines / physical machines from each user terminal, so that each user terminal can operate on the same model file through its respective virtual machine / physical machine.
[0053] Step S102: The virtual machine / physical machine modifies the model file according to the model file modification request initiated by the corresponding user terminal sent by the cloud access management system. Step S103: The modified model file is then synchronized to the synchronization server.
[0054] Step S103: Distribute the synchronized model file to the AR rendering server so that the AR rendering server can render the synchronized model file into an AR image to obtain the rendered AR image.
[0055] Step S104: Distribute the rendered AR image to each user terminal for decoding and display through the cloud access management system.
[0056] Through the aforementioned cloud-based multi-user collaboration and real-time AR collaboration method, on the one hand, virtual machines / physical machines receive requests from various user terminals sent by the cloud access management system, enabling each user terminal to operate on the same model file through its own virtual machine / physical machine. Based on the model file modification requests initiated by the corresponding user sent by the cloud access management system, the virtual machine / physical machine modifies the model file and synchronizes the modified model file to the synchronization server, achieving real-time synchronization of the modified model file. On the other hand, the synchronized model file is rendered into an AR image by the AR rendering server, resulting in a rendered AR image. This rendered AR image can be distributed to various user terminals via the cloud access management system, where it is decoded and displayed. This method enables multiple users in different locations to simultaneously modify files and preview them in real-time cloud AR, offering advantages such as convenient user collaboration, low cost, and ease of management.
[0057] Below, we will refer to Figures 1 to 2 The steps of the method described above in this example embodiment will be explained in more detail.
[0058] In step S101, the virtual machine / physical machine receives information from the cloud access management system regarding requests for virtual machines / physical machines from various user terminals, enabling each user terminal to operate on the same model file through its respective virtual machine / physical machine. Specifically, this disclosure primarily targets R image design scenarios, such as VR game development scenarios. Each user requests a virtual machine / physical machine through their respective user terminal and sends the request message to the cloud access management system. The cloud access management system then forwards the virtual machine / physical machine request information from each user terminal to the virtual machine / physical machine, enabling each user to operate on the same model file through their respective virtual machine / physical machine. That is, each user can access the same account of the same design software through their respective virtual machine / physical machine, thereby operating on the same model file. Here, the full English name for virtual machine is VM, and the full English name for physical machine is PM.
[0059] It should be noted that this disclosure can provide computing resources through virtual machines / physical machines. In this disclosure, when a user requests a virtual machine / physical machine, they are actually requesting computing resources, which are provided through the virtual machine / physical machine.
[0060] In step S102, the virtual machine / physical machine modifies the model file according to the model file modification request initiated by the corresponding user terminal sent by the cloud access management system. Specifically, each user logs in to their account and sends a message to modify the model file to the cloud access management system through their respective user terminal. The cloud access management system then sends the message to modify the model file to their respective virtual machine / physical machine, so that the corresponding virtual machine / physical machine can modify the model file.
[0061] In one embodiment, the user modifies the model file using design software installed on a virtual machine / physical machine with the Omniverse plugin.
[0062] In step S103, the modified model file is synchronized to the synchronization server. Specifically, after each user logs into their respective user terminal, the modified model file from their respective virtual machine / physical machine is synchronized to the Omniverse synchronization server for subsequent rendering.
[0063] It should be noted that when users modify model files using design software installed on a virtual machine / physical machine with the Omniverse plugin, the modified content of the files will be uploaded to the Omniverse Nucleus server by the Omniverse plugin.
[0064] In step S103, the synchronized model file is distributed to the AR rendering server, so that the AR rendering server can render the synchronized model file into an AR image to obtain the rendered AR image. Specifically, after synchronizing the model file, the synchronization server distributes it to the AR rendering server. It should be noted that the Omniverse Nucleus server synchronizes the modified model file to the already connected Omniverse Cloud XR server via the network for AR rendering to obtain the rendered AR image.
[0065] In step S104, the rendered AR image is distributed to each user terminal for decoding and display via the cloud access management system. Specifically, after obtaining the modified model file, the Omniverse Cloud XR server begins rendering the AR image and sends it to the cloud access management system for relaying. This allows the cloud access management system to send the rendered AR image to each user terminal via public network mapping. Here, public network mapping refers to a gateway, also known as an internetwork connector or protocol converter. Its purpose is to remap an internal network IP address to a port of a public network IP address, enabling external network users to access resources. Here, IP refers to the Internet Protocol, a network layer protocol in the TCP / IP architecture.
[0066] It should be noted that user terminals may include computers (Personal Compute, PC), streaming zero-terminals, or mobile devices. Virtual machines / physical machines include physical machine resources, virtual machine resources created in the virtual machine platform, and bare metal platforms. The bare metal platform includes bare metal nodes and bare metal management chassis. The resource management platform includes a cloud access management system and an external network egress device that performs public network mapping. User terminals include PCs, zero-terminal devices capable of receiving streaming information, and mobile devices.
[0067] Optionally, in some embodiments, before synchronizing the modified model file to the synchronization server, the method further includes:
[0068] The virtual machine / physical machine connects to the synchronization server. Specifically, the virtual machine / physical machine uses a preset account and password to connect to the synchronization server. For example, the design software on the virtual machine / physical machine has the Omniverse plugin installed, logs in to the plugin with a preset account and password, connects to the Omniverse Nucleus server, and is ready to synchronize at any time.
[0069] Optionally, in some embodiments, the step of distributing the synchronized model file to an AR rendering server so that the AR rendering server can render the synchronized model file into an AR image to obtain the rendered AR image further includes:
[0070] The rendered AR image is then encoded to obtain a rendered and encoded AR image. Specifically, the synchronized model file is rendered by the Omniverse Cloud XR server to obtain the rendered AR image, which is then encoded and sent to the cloud access management system. Furthermore, the rendered AR image is encoded using H.265 or AV1 format.
[0071] This example implementation also provides a cloud-based multi-user collaboration and AR real-time collaboration method. (See reference) Figure 2 As shown, the method may include:
[0072] Step S201: The cloud access management system receives messages from various user terminals requesting virtual machines / physical machines.
[0073] Step S202: The cloud access management system allocates a host according to the received message requesting a virtual machine / physical machine.
[0074] Step S203: Send the message requesting a virtual machine / physical machine to the assigned host so that each user terminal can operate on the same model file through its assigned host.
[0075] Step S204: The cloud access management system sends the model file modification requests initiated by each user terminal to their respective assigned hosts, so that each user terminal can modify and synchronize the model file through their respective assigned hosts, and the respective assigned hosts can render AR images on the synchronized model file.
[0076] Step S205: After receiving the rendered AR image, the cloud access management system sends the rendered AR image to each user terminal for decoding and display.
[0077] Below, we will refer to Figures 2 to 3 The steps of the method described above in this example embodiment will be explained in more detail.
[0078] In step S201, the cloud access management system receives messages requesting virtual machines / physical machines from various user terminals. Specifically, users log in to their accounts and send messages requesting virtual machines / physical machines through their user terminals. The user login account is a valid account distributed by the cloud access management system. After logging in on the user terminal software and clicking the connect button, the user terminal sends a message requesting a virtual machine / physical machine to the cloud access management system.
[0079] In step S202, the cloud access management system allocates hosts based on the received request for virtual machines / physical machines, enabling each user terminal to operate on the same model file through its assigned host. Specifically, the cloud access management system allocates hosts, starts the hosts, and notifies the streaming software to begin operation based on the received request for virtual machines / physical machines. The streaming software may include Moonlight, Steamlink, AMD, and domestic providers such as ShuttleX, Wegame, and Sunflower Games. The hosts can be physical machines, virtual machines, bare metal nodes, OmniverseNucleus servers, or Omniverse Cloud XR servers.
[0080] In one embodiment, the step of the cloud access management system allocating a host based on the received request message includes:
[0081] The host is allocated according to a preset allocation type, and the allocated host is started. The preset allocation type includes manual allocation and automatic allocation. Specifically, the host is allocated according to the preset allocation type, and then started. The preset allocation types include manual allocation and automatic allocation. Manual allocation involves pre-assigning hosts to the user in the cloud access management system, so that the allocated host is used directly when the user makes a request. Automatic allocation checks if there are any available hosts in the resource pool to which the user belongs. If so, an available host is selected and delivered to the user according to preset rules. The preset rules match the resource pool's level with the host level required by the user. For example, if a resource pool has available high-performance hosts, and the user requires a high-performance host, the resource pool will allocate any available high-performance hosts to that user.
[0082] It's important to note that a resource pool is a collection of resources. A resource pool (or pool) is a configuration mechanism used to partition host resources. Each host has a default resource pool, and all processes are initially bound to this resource pool.
[0083] In step S203, the cloud access management system sends the model file modification requests initiated by each user terminal to their respective assigned hosts, enabling each user terminal to modify and synchronize the model file through its assigned host, and then the assigned host to render the synchronized model file as an AR image. Specifically, each user logs into their respective user terminal and initiates a model file modification request to the cloud access management system. After receiving the model file modification request, the cloud access management system sends it to its assigned host, allowing each user to modify the model file through their assigned host and synchronize the modified model file to the synchronization server. Then, the AR rendering server on each host renders the synchronized model file as an AR image, thus obtaining the rendered AR image.
[0084] In step S204, after receiving the rendered AR image, the cloud access management system sends the rendered AR image to each user terminal for decoding and display. Specifically, the cloud access management system distributes the received rendered AR image to each user terminal after mapping it via the public network.
[0085] It should be noted that although the steps of the method in this disclosure are described in a specific order in the accompanying drawings, this does not require or imply that these steps must be performed in that specific order, or that all the steps shown must be performed to achieve the desired result. Additional or alternative steps may be omitted, multiple steps may be combined into one step, and / or a step may be broken down into multiple steps. Furthermore, it is readily understood that these steps may be executed synchronously or asynchronously, for example, in multiple modules / processes / threads.
[0086] Furthermore, this example embodiment also provides a cloud-based multi-user collaboration and AR real-time collaboration device. (See reference) Figure 4 As shown, the device 300 may include: a receiving module, a modifying model, a synchronization module, a rendering module, and a sending module.
[0087] The receiving module is used to receive information from various user terminals requesting virtual machines / physical machines sent by the cloud access management system, so that each user terminal can operate on the same model file through its respective virtual machine / physical machine.
[0088] The modification module is used by the virtual machine / physical machine to modify the model file according to the model file modification request initiated by the corresponding user terminal sent by the cloud access management system.
[0089] The synchronization module is used to synchronize the modified model file to the synchronization server.
[0090] The rendering module is used to distribute the synchronized model file to the AR rendering server, so that the AR rendering server can render the synchronized model file into an AR image to obtain the rendered AR image.
[0091] The sending module is used to distribute the rendered AR image to the user terminal for decoding and display through the cloud access management system.
[0092] Optionally, in some embodiments, the device further includes:
[0093] A connection module is used for the virtual machine / physical machine to connect to the synchronization server.
[0094] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.
[0095] Optionally, in some embodiments, the device further includes:
[0096] The encoding module is used to encode the rendered AR image to obtain the rendered and encoded AR image.
[0097] It should be noted that although several modules or units for the device used to perform actions have been mentioned in the detailed description above, this division is not mandatory. In fact, according to embodiments of this disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units. Components shown as modules or units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of the disclosed solution according to actual needs. Those skilled in the art can understand and implement this without any inventive effort.
[0098] In exemplary embodiments of this disclosure, a computer-readable storage medium is also provided, having stored thereon a computer program that, when executed by, for example, a processor, can implement the steps of the cloud-based multi-user collaboration and AR real-time collaboration method described in any of the above embodiments. In some possible implementations, various aspects of the invention can also be implemented as a program product comprising program code that, when run on a terminal device, causes the terminal device to perform the steps of the various exemplary embodiments of the invention described in the above-described cloud-based multi-user collaboration and AR real-time collaboration method section of this specification.
[0099] refer to Figure 5 As shown, a program product 400 for implementing the above-described method according to an embodiment of the present invention is described. This product may employ a portable compact disc read-only memory (CD-ROM) and include program code, and may run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto. In this document, the readable storage medium may be any tangible medium containing or storing a program that may be used by or in conjunction with an instruction execution system, apparatus, or device.
[0100] The program product may employ any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.
[0101] The computer-readable storage medium may include data signals propagated in baseband or as part of a carrier wave, carrying readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The readable storage medium may also be any readable medium other than a readable storage medium, capable of transmitting, propagating, or transmitting programs for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical fiber, RF, etc., or any suitable combination thereof.
[0102] Program code for performing the operations of this invention can be written in any combination of one or more programming languages, including object-oriented programming languages such as Java and C++, and conventional procedural programming languages such as C or similar languages. The program code can execute entirely on the user's computing device, partially on the user's device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving remote computing devices, the remote computing device can be connected to the user's computing device via any type of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computing device (e.g., via the Internet using an Internet service provider).
[0103] In exemplary embodiments of this disclosure, an electronic device is also provided, which may include a processor and a memory for storing executable instructions of the processor. The processor is configured to perform the steps of the cloud-based multi-user collaboration and AR real-time collaboration method described in any of the above embodiments by executing the executable instructions.
[0104] Those skilled in the art will understand that various aspects of the present invention can be implemented as systems, methods, or program products. Therefore, various aspects of the present invention can be specifically implemented in the following forms: entirely hardware implementations, entirely software implementations (including firmware, microcode, etc.), or implementations combining hardware and software aspects, collectively referred to herein as “circuits,” “modules,” or “systems.”
[0105] The following reference Figure 6 To describe an electronic device 600 according to this embodiment of the present invention. Figure 6 The electronic device 600 shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of the present invention.
[0106] like Figure 6 As shown, the electronic device 600 is presented in the form of a general-purpose computing device. The components of the electronic device 600 may include, but are not limited to: at least one processing unit 610, at least one storage unit 620, a bus 630 connecting different system components (including storage unit 620 and processing unit 610), a display unit 640, etc.
[0107] The storage unit stores program code that can be executed by the processing unit 610, causing the processing unit 610 to perform the steps described in the above-described cloud-based multi-user collaboration and AR real-time collaboration method section of this specification, according to various exemplary embodiments of the present invention. For example, the processing unit 610 can perform actions such as... Figure 1 The steps are shown in the figure.
[0108] The storage unit 620 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 6201 and / or a cache storage unit 6202, and may further include a read-only memory unit (ROM) 6203.
[0109] The storage unit 620 may also include a program / utility 6204 having a set (at least one) program module 6205, such program module 6205 including but not limited to: an operating system, one or more application programs, other program modules and program data, each or some combination of these examples may include an implementation of a network environment.
[0110] Bus 630 can represent one or more of several types of bus structures, including a memory cell bus or memory cell controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local bus using any of the various bus structures.
[0111] Electronic device 600 can also communicate with one or more external devices 700 (e.g., keyboard, pointing device, Bluetooth device, etc.), and with one or more devices that enable a user to interact with electronic device 600, and / or with any device that enables electronic device 600 to communicate with one or more other computing devices (e.g., router, modem, etc.). This communication can be performed via input / output (I / O) interface 650. Furthermore, electronic device 600 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 660. Network adapter 660 can communicate with other modules of electronic device 600 via bus 630. It should be understood that, although not shown in the figures, other hardware and / or software modules can be used in conjunction with electronic device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.
[0112] Through the above description of the embodiments, those skilled in the art will readily understand that the exemplary embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solutions according to the embodiments of this disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, external hard drive, etc.) or on a network, including several instructions to cause a computing device (such as a personal computer, server, or network device, etc.) to execute the above-described cloud-based multi-user collaboration and AR real-time collaboration method according to the embodiments of this disclosure.
[0113] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the appended claims.
Claims
1. A cloud-based multi-user collaboration and AR real-time collaboration method, characterized in that, This method enables users in multiple locations to simultaneously modify files and perform real-time cloud AR previews. The method includes: The virtual machine / physical machine receives information from various user terminals requesting virtual machines / physical machines sent by the cloud access management system, so that each user terminal can operate on the same model file through its respective virtual machine / physical machine; The virtual machine / physical machine modifies the model file according to the model file modification request initiated by the corresponding user terminal sent by the cloud access management system; The modified model file will then be synchronized to the synchronization server. The synchronized model file is distributed to the AR rendering server, so that the AR rendering server can render the synchronized model file into an AR image to obtain the rendered AR image. The rendered AR image is distributed to each user terminal for decoding and display through the cloud access management system.
2. The cloud-based multi-user collaboration and AR real-time collaboration method according to claim 1, characterized in that, Before synchronizing the modified model file to the synchronization server, the process also includes: The virtual machine / physical machine is connected to the synchronization server.
3. The cloud-based multi-user collaboration and AR real-time collaboration method according to claim 1, characterized in that, The step of distributing the synchronized model file to the AR rendering server, so that the AR rendering server can render the synchronized model file into an AR image, and obtaining the rendered AR image, further includes: The rendered AR image is encoded to obtain the rendered and encoded AR image.
4. A cloud-based multi-user collaboration and AR real-time collaboration method, characterized in that, This method enables users in multiple locations to simultaneously modify files and perform real-time cloud AR previews. The method includes: The cloud access management system receives requests for virtual machines / physical machines from various user terminals; The cloud access management system allocates hosts based on the received request virtual machine / physical machine messages, so that each user terminal can operate on the same model file through its assigned host; The cloud access management system sends the model file modification requests initiated by each user terminal to the respective assigned host, so that each user terminal can modify and synchronize the model file through its respective assigned host, and the respective assigned host can render AR images on the synchronized model file. After receiving the rendered AR image, the cloud access management system sends the rendered AR image to each user terminal for decoding and display.
5. The cloud-based multi-user collaboration and AR real-time collaboration method according to claim 4, characterized in that, The steps of the cloud access management system in allocating hosts based on the received request messages include: The host is assigned according to a preset assignment type, and the assigned host is started; wherein, the preset assignment type includes manual assignment and automatic assignment.
6. A cloud-based multi-user collaborative and AR real-time collaborative device, characterized in that, The device, employing the cloud-based multi-user collaboration and AR real-time collaboration method according to any one of claims 1 to 3, comprises: The receiving module is used for the virtual machine / physical machine to receive information from the cloud access management system regarding requests from various user terminals to the virtual machine / physical machine, so that each user terminal can operate on the same model file through its respective virtual machine / physical machine; The modification module is used by the virtual machine / physical machine to modify the model file according to the model file modification request initiated by the corresponding user terminal sent by the cloud access management system; A synchronization module is used to synchronize the modified model file to a synchronization server. The rendering module is used to distribute the synchronized model file to the AR rendering server, so that the AR rendering server can render the synchronized model file into an AR image to obtain the rendered AR image. The sending module is used to distribute the rendered AR image to various user terminals for decoding and display through the cloud access management system.
7. The cloud-based multi-user collaborative and AR real-time collaborative device according to claim 6, characterized in that, The device also includes: A connection module is used for the virtual machine / physical machine to connect to the synchronization server.
8. The cloud-based multi-user collaborative and AR real-time collaborative device according to claim 6, characterized in that, The device also includes: The encoding module is used to encode the rendered AR image to obtain the rendered and encoded AR image.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the steps of the cloud-based multi-person collaboration and AR real-time collaboration method as described in any one of claims 1 to 3.
10. An electronic device, characterized in that, include: processor; as well as Memory for storing the executable instructions of the processor; The processor is configured to execute the steps of the cloud-based multi-user collaboration and AR real-time collaboration method according to any one of claims 1 to 3 by executing the executable instructions.
Citation Information
Patent Citations
System and method for collaborative modeling and CG rendering based on cloud rendering server
CN110276821A
Cloud rendering method, device and system and user terminal
CN114666658A