Method, apparatus, device, and storage medium for spatial presentation
Patent Information
- Application Number
- CN202310493982.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-05
- Publication Date
- 2026-10-09
- Estimated Expiration
- 2043-05-05
AI Technical Summary
[0018] According to the technology disclosed herein, it is possible to enable users to immerse themselves in viewing panoramic content from third-party platforms using a terminal.
Smart Images

Figure CN116704157B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of computer technology, and in particular to the fields of artificial intelligence, extended reality, computer vision, metaverse, blockchain, cloud computing and other technologies. Background Technology
[0002] The metaverse is a virtual world constructed by humans using digital technology. It maps to or transcends the real world, allowing interaction with it and providing a digital living space with a new social system. The metaverse is a concrete manifestation of concepts based on technologies such as extended reality, blockchain, cloud computing, and digital twins. Extended Reality (XR) refers to the combination of reality and virtuality through computers to create an interactive virtual environment. It is also a collective term for various technologies such as AR (Augmented Reality), VR (Virtual Reality), and MR (Mixed Reality). By integrating the visual interaction technologies of these three technologies, it provides users with a seamless "immersive" experience between the virtual and real worlds. Summary of the Invention
[0003] This disclosure provides a method, apparatus, device, and storage medium for spatial display.
[0004] According to one aspect of this disclosure, a method for spatial display is provided, comprising:
[0005] Based on the access instructions from the first terminal, determine the platform to be accessed;
[0006] In the current virtual world displayed to the first user on the first terminal, multiple user spaces of the platform are showcased, each containing panoramic content; and
[0007] Based on the target user space selected by the first terminal from multiple user spaces, the current virtual world is switched to the target virtual world, where the target virtual world displays the panoramic content contained in the target user space.
[0008] According to another aspect of this disclosure, a spatial display apparatus is provided, comprising:
[0009] The first determining module is used to determine the platform to be accessed based on the access instruction of the first terminal;
[0010] The display module is used to showcase multiple user spaces of the platform within the current virtual world displayed from the first terminal to the first user. These user spaces contain panoramic content.
[0011] The switching module is used to switch the current virtual world to the target virtual world based on the target user space selected by the first terminal from multiple user spaces. The target virtual world displays the panoramic content contained in the target user space.
[0012] According to another aspect of this disclosure, an electronic device is provided, comprising:
[0013] At least one processor; and
[0014] The memory is communicatively connected to the at least one processor; wherein,
[0015] The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform any of the methods described in the present disclosure.
[0016] According to another aspect of this disclosure, a non-transitory computer-readable storage medium is provided storing computer instructions, wherein the computer instructions are used to cause the computer to perform any of the methods according to embodiments of this disclosure.
[0017] According to another aspect of this disclosure, a computer program product is provided, including a computer program that, when executed by a processor, implements any of the methods according to embodiments of this disclosure.
[0018] According to the technology disclosed herein, it is possible to enable users to immerse themselves in viewing panoramic content from third-party platforms using a terminal.
[0019] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description
[0020] The accompanying drawings are provided to better understand this solution and do not constitute a limitation of this disclosure. Wherein:
[0021] Figure 1 This is a schematic flowchart of a spatial display method according to an embodiment of the present disclosure;
[0022] Figure 2 This is a schematic diagram illustrating an application scenario of the spatial display method according to an embodiment of the present disclosure;
[0023] Figure 3 This is a schematic diagram illustrating an application scenario of the spatial display method according to an embodiment of the present disclosure;
[0024] Figure 4 This is a schematic diagram illustrating an application scenario of the spatial display method according to an embodiment of the present disclosure;
[0025] Figure 5 This is a schematic diagram illustrating an application scenario of the spatial display method according to an embodiment of the present disclosure;
[0026] Figure 6 This is a schematic diagram of a spatially arranged device according to an embodiment of the present disclosure;
[0027] Figure 7 This is a block diagram of an electronic device used to implement the spatial display method of the embodiments of this disclosure. Detailed Implementation
[0028] The exemplary embodiments of this disclosure are described below with reference to the accompanying drawings, including various details of the embodiments to aid understanding, and should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope of this disclosure. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description.
[0029] like Figure 1 As shown in the embodiments of this disclosure, a method for spatial display is provided, including:
[0030] Step S101: Determine the platform to be accessed based on the access instruction from the first terminal.
[0031] Step S102: In the current virtual world displayed by the first terminal to the first user, multiple user spaces of the platform are shown, wherein the multiple user spaces contain panoramic content.
[0032] Step S103: Based on the target user space selected by the first terminal from multiple user spaces, switch the current virtual world to the target virtual world, wherein the target virtual world displays the panoramic content contained in the target user space.
[0033] According to the embodiments of this disclosure, it should be noted that:
[0034] The first terminal can be understood as any extended reality device in existing technology that can display a virtual world to a user, or any extended reality device that can be applied to the metaverse. For example, the first terminal can be a VR device, an AR device, a MR device, etc.
[0035] Access commands are used to initiate access to a platform, enabling the platform's content to be displayed in the current virtual world. Different access commands can initiate access to different platforms. Access commands can be issued by the first user wearing the first terminal using the first terminal. For example, when the first user touches a button, icon, or object with platform access functionality in the current virtual world displayed by the first terminal, the first terminal issues an access command. Similarly, when the first user clicks or touches a function key on the first terminal, the first terminal issues an access command.
[0036] A platform can be understood as any external third-party platform capable of displaying panoramic content, accessible via mobile devices such as smartphones, desktops, and tablets. This platform displays panoramic content (e.g., panoramic images and / or panoramic videos) uploaded by registered users. When accessing the platform via a mobile device, the platform is presented as a page on the mobile device's screen. When the user selects a registered user's user space within the platform, the panoramic content uploaded by that user is displayed on the mobile device's screen. When the user selects a specific panoramic content to view, it is displayed in two dimensions on the mobile device's screen. The user can then view the panoramic content from multiple angles using drag-and-rotate gestures or mouse interactions.
[0037] The current virtual world can be understood as the virtual reality scene currently presented to the first user by the first terminal. For example, when the first user is strolling on Street A in the metaverse world, the current virtual world is the virtual reality scene of Street A. Similarly, when the first user is visiting Room B in the metaverse world, the current virtual world is the virtual reality scene inside Room B.
[0038] Multiple user spaces can be understood as the personal spaces of different registered users on the platform. Users can upload panoramic images and / or panoramic videos to their own user spaces for themselves or others to view the uploaded panoramic images and / or panoramic videos.
[0039] In the current virtual world displayed from the first terminal to the first user, multiple user spaces of the platform are showcased. This can be understood as follows: Platform information is obtained from the platform through open interfaces provided by the platform; based on this platform information, the first terminal renders the platform page (e.g., ...) within the current virtual world. Figure 2 As shown in the image, the platform page displays multiple user spaces. That is, the platform page accessed via a mobile device is presented within the current virtual world, allowing the first user to view and determine the specific user space they need to access.
[0040] The target user space selected by the first terminal from multiple user spaces can be understood as: the first user wearing the first terminal selecting a specific space from the multiple user spaces presented in the current virtual world using the first terminal. The specific methods for the first user to select the target user space can be: the first user touching a specific user space within the current virtual world presented by the first terminal; or the first user clicking or touching a button on the first terminal, thereby selecting a specific user space from the multiple user spaces.
[0041] The panoramic content contained in the target user space includes panoramic videos and / or panoramic images.
[0042] Switching from the current virtual world to the target virtual world can be understood as follows: A new virtual world (the target virtual world) is rendered based on the panoramic content contained in the target user's space. This target virtual world displays panoramic videos and / or panoramic images contained in the target user's space. After the target virtual world is rendered, it is presented to the first user via the first terminal, replacing the current virtual world presented to the first user via the first terminal. This allows the first user to view the panoramic content contained in the target user's space within the target virtual world. The panoramic content presented in the target virtual world can be presented to the first user in a 360° view. When the first user changes their head posture, the first terminal will present different display areas of the panoramic content in front of the first user, allowing the first user to immerse themselves in the 3D panoramic content, thus obtaining a better sense of immersion and viewing experience than viewing panoramic content in 2D via a mobile terminal.
[0043] The platform's personal space (user space) contains many VR-related works (panoramic content), such as panoramic videos and images, but they are mainly displayed in two dimensions. Interaction methods generally rely on dragging and rotating to view the panoramic content from multiple angles. This two-dimensional presentation lacks immersion and results in a poor user experience. The technology according to the embodiments of this disclosure effectively solves these problems. It allows the panoramic content, originally presented in two dimensions, to be integrated into the virtual world of a first terminal and displayed naturally in three dimensions. This enables the first user to immerse themselves in the panoramic content, achieving a high level of immersion and appreciating it as naturally as visiting a real-world exhibition, effectively enhancing the user's sensory experience. Viewing the platform's panoramic content directly on the first terminal is more convenient and faster, eliminating the need to connect the mobile terminal to the first terminal and switch to VR mode. The technical solution of the embodiments of this disclosure enables low-cost integration between external third-party platforms and the first terminal, allowing users to immerse themselves in the panoramic content of external platforms using only the first terminal.
[0044] In one example, the first terminal could be VR glasses, a VR-enabled chair, a VR-enabled walking platform, etc.
[0045] In one application example, such as Figure 3 As shown, the space display method of this embodiment can be executed by server 100. First user 200 sends an access command to server 100 through a first terminal 300. Server 100 interacts with the platform server 400 of the platform to be accessed according to the access command, thereby displaying multiple user spaces of the platform in the current virtual world displayed by the first terminal 300 to the first user 200.
[0046] In one application example, the spatial display method of this disclosure embodiment can be applied to a metaverse scenario, where a first user can move around in the metaverse virtual world presented on the first terminal. It can enable access to a user space on an external third-party platform within the metaverse virtual world, thereby allowing the first terminal to immerse itself in viewing panoramic content, such as panoramic images and / or panoramic videos, within the user space.
[0047] In one embodiment, the spatial display method includes steps S101 to S103, and further includes:
[0048] Step S104: If the platform to be accessed by the second terminal and the selected target user space match the first terminal, determine the virtual character image of the second user corresponding to the second terminal.
[0049] Step S105: Render the virtual character image of the second user in the target virtual world.
[0050] According to the embodiments of this disclosure, it should be noted that:
[0051] The second terminal can be understood as any extended reality device in existing technology that can display a virtual world to a user, or any extended reality device that can be applied to the metaverse. For example, the second terminal can be a VR device, an AR device, a MR device, etc.
[0052] The platform accessed by the second terminal and the target user space selected match those of the first terminal. This can be understood as the platform accessed and the target user space selected by both the first and second users being the same. For example, based on the access instructions from the first terminal, it is determined that multiple user spaces of platform A need to be displayed in the current virtual world of the first user corresponding to the first terminal, and the target virtual world is rendered based on user space 'a' among the multiple user spaces. Based on the access instructions from the second terminal, it is determined that multiple user spaces of platform A need to be displayed in the current virtual world of the second user corresponding to the second terminal, and the target virtual world is rendered based on user space 'a' among the multiple user spaces. Therefore, the platform accessed by both the first and second users is the same, both being platform A, and the target user space selected by both the first and second users is the same, both being user space 'a'. It should be noted that when determining the platform accessed and the target user space selected by the second terminal, the second terminal can be understood as the first terminal described in steps S101 to S103, and the second user can be understood as the first user described in steps S101 to S103.
[0053] Rendering the virtual character of the second user in the target virtual world can be understood as rendering the virtual character of the second user in the target virtual world in which the first user is located, so that the first user and the second user can see each other in the target virtual world.
[0054] According to the technology of this disclosure, multiple users can jointly browse panoramic content contained in the same target user space of the platform within the same constructed target virtual world. This allows the first user to perceive the presence of other users while browsing the panoramic content in the platform's target user space, enabling users to interact and socialize naturally, as if viewing an exhibition in the real world. This enhances the first user's interactive and social experience, giving them the feeling of being in an exhibition hall.
[0055] In one example, after the first user selects a target user space from among the multiple user spaces presented in the current virtual world via a first terminal, such as... Figure 4As shown, the current virtual world will switch to the target virtual world, which displays one or more panoramic contents contained in the target user space. The first user can browse each panoramic content in the target virtual world. When a second user selects the same target user space as the first user from the multiple user spaces presented in the second user's current virtual world through a second terminal, as shown... Figure 5 As shown, the virtual avatar of the second user will be rendered into the target virtual world, allowing the first user to see the second user within the target virtual world. Conversely, the second user can also see the first user within the target virtual world through the target virtual world presented on the second terminal.
[0056] In one embodiment, the spatial display method includes steps S101 to S105, wherein step S105: rendering the virtual character image of the second user in the target virtual world, including:
[0057] Based on the visual information from the second terminal, determine the panoramic content that the second user is currently focusing on in the target user space.
[0058] In the target virtual world, corresponding to the environmental location of the currently viewed panoramic content, render the virtual character image of the second user, wherein the face of the virtual character image of the second user is facing the currently viewed panoramic content.
[0059] According to the embodiments of this disclosure, it should be noted that:
[0060] Visual information can be used to determine which specific panoramic content the second user is currently browsing and focusing on within the target virtual world presented on the second terminal.
[0061] According to the technology of the embodiments of this disclosure, the first user can see the specific panoramic content that the second user is currently focusing on and appreciating in the same target virtual world, which can make the first user feel like they are viewing an exhibition in the real world.
[0062] In one example, when a second user browses panoramic content A in the target virtual world through a second terminal, the first user will see the second user's virtual character currently located near panoramic content A and facing panoramic content A in the target virtual world through a first terminal.
[0063] In one embodiment, the spatial display method includes steps S101 to S105, and further includes:
[0064] Upon receiving the first interaction command from the first terminal, the chat information of the first user is displayed in the target virtual world.
[0065] Upon receiving a second interactive instruction from the second terminal, the chat information of the second user is displayed in the target virtual world.
[0066] According to the embodiments of this disclosure, it should be noted that:
[0067] The specific display method for the chat messages between the first and second users is not limited here. For example, the chat messages can be presented as speech bubbles above the heads of the first and second users' virtual avatars. Alternatively, the chat messages can be presented as bullet comments or a browsing board within the target virtual world.
[0068] According to the technology of this disclosure, when a first user is browsing panoramic content in the target user space of the platform, he / she can perceive the presence of other users. Users can interact and socialize naturally as if they were viewing an exhibition in the real world, which improves the interaction and social experience of the first user and makes the first user feel like he / she is in an exhibition hall.
[0069] In one embodiment, the spatial display method includes steps S101 to S103, wherein step S101: determining the platform to be accessed according to the access instruction of the first terminal, including:
[0070] The access command generated by the first terminal is determined based on the platform identifier triggered by the first user in the current virtual world displayed on the first terminal.
[0071] Based on the access instructions, determine the platform to be accessed, where the platform is a third-party platform used to display 2D panoramic content.
[0072] According to the embodiments of this disclosure, it should be noted that:
[0073] Platform identifiers can be understood as a button, logo, or object presented in the current virtual world, without any specific limitations.
[0074] According to the technology of the present disclosure embodiments, it is possible to integrate the panoramic content originally presented by the platform in a two-dimensional manner into the virtual world of the first terminal and display it in a three-dimensional manner in front of the first user. This allows the first user to immerse themselves in the panoramic content of the platform, obtain a good sense of immersion, and appreciate it naturally as if visiting an exhibition in the real world, which can effectively enhance the user's sensory experience.
[0075] In one embodiment, the space display method includes steps S101 to S103, wherein step S102: in the current virtual world displayed by the first terminal to the first user, multiple user spaces of the platform are displayed, including:
[0076] Based on the platform information, determine the information of multiple user spaces on the platform.
[0077] Based on information from multiple user spaces, the platform displays multiple user spaces in the current virtual world shown to the first user from the first terminal.
[0078] According to the embodiments of this disclosure, it should be noted that:
[0079] Platform information may include the name and layout of the user space displayed on the platform page, the panoramic content contained in each user space, and the user account information corresponding to the user space.
[0080] According to the technology of the present disclosure embodiments, by displaying multiple user spaces of the platform in the current virtual world, a first user can quickly browse the content of the platform through a first terminal, so as to determine the target user space to be browsed from the multiple user spaces presented.
[0081] In one embodiment, the spatial display method includes steps S101 to S103, wherein step S103: switching the current virtual world to the target virtual world according to the target user space selected by the first terminal from multiple user spaces, including:
[0082] Based on the target user space selected by the first terminal from multiple user spaces, determine the spatial information associated with the target user space.
[0083] Based on spatial information, determine the panoramic content contained in the target user's space.
[0084] Construct a target virtual world based on the panoramic content contained in the target user space.
[0085] The current virtual world is switched to the target virtual world so that the first terminal can display the panoramic content contained in the target user space to the first user in the target virtual world.
[0086] According to the embodiments of this disclosure, it should be noted that:
[0087] Spatial information can include information about the panoramic content contained in a user's space. For example, based on spatial information, one can know how many panoramic content items a registered user has uploaded to that user's space, whether each panoramic content item is a panoramic image or a panoramic video, and the specific data of each panoramic content item (the data is used to visualize panoramic images or panoramic videos).
[0088] The target virtual world must at least present the panoramic content contained in the target user space. On this basis, other content can also be rendered into the target virtual world as needed.
[0089] According to the technology of the present disclosure embodiments, it is possible to integrate the panoramic content originally presented by the platform in a two-dimensional manner into the virtual world of the first terminal and display it in a three-dimensional manner in front of the first user. This allows the first user to immerse themselves in the panoramic content of the platform, obtain a good sense of immersion, and appreciate it naturally as if visiting an exhibition in the real world, which can effectively enhance the user's sensory experience.
[0090] In one embodiment, the spatial display method includes steps S101 to S103, and further includes:
[0091] Based on the viewing instructions of the first terminal, determine the target panoramic content that the first user needs to view within the panoramic content contained in the target user space.
[0092] Render the target virtual world as a panoramic view of the target.
[0093] According to the embodiments of this disclosure, it should be noted that:
[0094] Rendering the target virtual world as target panoramic content can be understood as: the image that the first user sees through the first terminal is a specific image of the target panoramic content surrounding them in 360°.
[0095] According to the technology of the present disclosure embodiments, it is possible to integrate the panoramic content originally presented by the platform in a two-dimensional manner into the virtual world of the first terminal and display it in a three-dimensional manner in front of the first user. This allows the first user to immerse themselves in the panoramic content of the platform, obtain a good sense of immersion, and appreciate it naturally as if visiting an exhibition in the real world, which can effectively enhance the user's sensory experience.
[0096] In one embodiment, the spatial display method includes steps S101 to S103, and further includes:
[0097] Determine the first user's first account information on the first terminal.
[0098] Determine the second account information of the first user on the platform.
[0099] Generate associated information based on the first account information and the second account information.
[0100] In the current virtual world, when multiple user spaces are displayed, the associated information is identified on the user space corresponding to the second account information in the multiple user spaces.
[0101] According to the embodiments of this disclosure, it should be noted that:
[0102] The first account information can be understood as the ID (Identity Document) of the first user on the first terminal platform.
[0103] The second account information can be understood as the first user's ID (Identity document) on a third-party platform.
[0104] According to the technology of this disclosure, it is possible to identify which user space belongs to the first user. This allows the first user to easily enter their own user space for immersive browsing of panoramic content.
[0105] In one example, the spatial display method of this disclosure embodiment can be applied to the Xirang Metaverse to achieve low-cost fusion of the personal space (user space) of a third-party platform with the Xirang Metaverse, solving the problems of VR works (panoramic content) display in personal space lacking immersion, poor user experience, inability to interact or socialize, and being unfriendly to users.
[0106] The spatial display method described in this disclosure can achieve the following:
[0107] (1) Connect the personal space account system of the third-party platform with the Xirang Yuan Universe account system. For example, add an entry point for binding accounts of both parties on the third-party platform.
[0108] (2) The third-party platform provides an open interface to retrieve personal space information (platform information, space information) from the Xirang Metaverse. At the same time, due to the binding between the personal space of the third-party platform and the Xirang Metaverse account, it can identify which personal space belongs to the current user (the first user). Users can easily access their own personal space.
[0109] (3) In the metaverse, various VR works in personal space can be naturally displayed, such as panoramic videos and panoramic pictures, and users can get a great sense of immersion.
[0110] (4) When multiple users enter the same personal space, the Xirang Metaverse will generate the same target virtual world for these users. Users in the same target virtual world can see each other. The user's virtual character image can reflect the work currently being viewed and its focus in real time. Users can interact and socialize naturally, just like viewing an exhibition in the real world.
[0111] like Figure 6 As shown, this disclosure provides a spatial display device, including:
[0112] The first determining module 601 is used to determine the platform to be accessed based on the access instruction of the first terminal.
[0113] Display module 602 is used to display multiple user spaces of the platform within the current virtual world displayed by the first terminal to the first user, wherein the multiple user spaces contain panoramic content.
[0114] The switching module 603 is used to switch the current virtual world to the target virtual world according to the target user space selected by the first terminal from multiple user spaces, wherein the target virtual world displays the panoramic content contained in the target user space.
[0115] In one embodiment, the spatial display device further includes:
[0116] The second determining module is used to determine the virtual character image of the second user corresponding to the second terminal when the platform to be accessed by the second terminal and the selected target user space match the first terminal.
[0117] The first rendering module is used to render the virtual character image of the second user in the target virtual world.
[0118] In one implementation, the first rendering module is used for:
[0119] Based on the visual information from the second terminal, determine the panoramic content that the second user is currently focusing on in the target user space.
[0120] In the target virtual world, corresponding to the environmental location of the currently viewed panoramic content, render the virtual character image of the second user, wherein the face of the virtual character image of the second user is facing the currently viewed panoramic content.
[0121] In one embodiment, the spatial display device further includes:
[0122] The first interaction module is used to display the first user's chat information in the target virtual world upon receiving the first interaction command from the first terminal.
[0123] The second interaction module is used to display the second user's chat information in the target virtual world upon receiving a second interaction command from the second terminal.
[0124] In one implementation, the panoramic content contained in the target user space includes panoramic video and / or panoramic images.
[0125] In one implementation, the first determining module 601 is used to:
[0126] The access command generated by the first terminal is determined based on the platform identifier triggered by the first user in the current virtual world displayed on the first terminal.
[0127] Based on the access instructions, determine the platform to be accessed, where the platform is a third-party platform used to display 2D panoramic content.
[0128] In one implementation, the display module 602 is used for:
[0129] Based on the platform information, determine the information of multiple user spaces on the platform.
[0130] Based on information from multiple user spaces, the platform displays multiple user spaces in the current virtual world shown to the first user from the first terminal.
[0131] In one implementation, the switching module 603 is used to:
[0132] Based on the target user space selected by the first terminal from multiple user spaces, determine the spatial information associated with the target user space.
[0133] Based on spatial information, determine the panoramic content contained in the target user's space.
[0134] Construct a target virtual world based on the panoramic content contained in the target user space.
[0135] The current virtual world is switched to the target virtual world so that the first terminal can display the panoramic content contained in the target user space to the first user in the target virtual world.
[0136] In one embodiment, the spatial display device further includes:
[0137] The third determining module is used to determine the target panoramic content that the first user needs to view in the panoramic content contained in the target user space, based on the viewing instructions of the first terminal.
[0138] The second rendering module is used to render the target virtual world as the target panoramic content.
[0139] In one embodiment, the spatial display device further includes:
[0140] The fourth determination module is used to determine the first user's first account information on the first terminal.
[0141] The fifth determination module is used to determine the second account information of the first user on the platform.
[0142] The generation module is used to generate associated information based on the first account information and the second account information.
[0143] The identification module is used to identify the associated information in the user space corresponding to the second account information when multiple user spaces are displayed in the current virtual world.
[0144] The specific functions and examples of each module and submodule of the apparatus in this disclosure can be found in the relevant descriptions of the corresponding steps in the above method embodiments, and will not be repeated here.
[0145] The acquisition, storage, and application of user personal information involved in the technical solution disclosed herein comply with the provisions of relevant laws and regulations and do not violate public order and good morals.
[0146] According to embodiments of this disclosure, this disclosure also provides an electronic device, a readable storage medium, and a computer program product.
[0147] Figure 7 A schematic block diagram of an example electronic device 700 that can be used to implement embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present disclosure described and / or claimed herein.
[0148] like Figure 7 As shown, device 700 includes a computing unit 701, which can perform various appropriate actions and processes based on a computer program stored in read-only memory (ROM) 702 or a computer program loaded from storage unit 708 into random access memory (RAM) 703. RAM 703 may also store various programs and data required for the operation of device 700. The computing unit 701, ROM 702, and RAM 703 are interconnected via bus 704. Input / output (I / O) interface 705 is also connected to bus 704.
[0149] Multiple components in device 700 are connected to I / O interface 705, including: input unit 706, such as keyboard, mouse, etc.; output unit 707, such as various types of monitors, speakers, etc.; storage unit 708, such as disk, optical disk, etc.; and communication unit 709, such as network card, modem, wireless transceiver, etc. Communication unit 709 allows device 700 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.
[0150] The computing unit 701 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 701 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 701 performs the various methods and processes described above, such as the spatial representation method. For example, in some embodiments, the spatial representation method can be implemented as a computer software program tangibly contained in a machine-readable medium, such as storage unit 708. In some embodiments, part or all of the computer program can be loaded and / or installed on device 700 via ROM 702 and / or communication unit 709. When the computer program is loaded into RAM 703 and executed by the computing unit 701, one or more steps of the spatial representation method described above can be performed. Alternatively, in other embodiments, the computing unit 701 can be configured to perform the spatial representation method by any other suitable means (e.g., by means of firmware).
[0151] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), payload-programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.
[0152] The program code used to implement the methods of this disclosure may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus, such that when executed by the processor or controller, the program code causes the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.
[0153] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
[0154] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).
[0155] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as a data server), or computing systems that include middleware components (e.g., an application server), or computing systems that include frontend components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with embodiments of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), and the Internet.
[0156] Computer systems can include clients and servers. Clients and servers are generally located far apart and typically interact via communication networks. Client-server relationships are created by computer programs running on the respective computers and having a client-server relationship with each other. Servers can be cloud servers, servers in distributed systems, or servers incorporating blockchain technology.
[0157] It should be understood that various forms of processes shown above can be used, and the order of reordering, adding, or executing rows can also be different, as long as the desired result of the technical solution disclosed in this disclosure can be achieved, and this document does not impose any restrictions.
[0158] The specific embodiments described above do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the principles of this disclosure should be included within the scope of protection of this disclosure.
Claims
1. A method for spatial display, comprising: Based on the platform identifier triggered by the first user in the current virtual world displayed on the first terminal, the access instruction generated by the first terminal is determined; According to the access instruction, the platform to be accessed is determined, wherein the platform is a third-party platform used to display two-dimensional panoramic content; In the current virtual world displayed by the first terminal to the first user, multiple user spaces of the platform are shown, wherein the multiple user spaces include panoramic content; and Based on the target user space selected by the first terminal from the plurality of user spaces, the current virtual world is switched to the target virtual world, wherein the target virtual world displays the panoramic content contained in the target user space; If the platform accessed by the second terminal and the selected target user space match the first terminal, determine the virtual character image of the second user corresponding to the second terminal. Render the virtual character image of the second user in the target virtual world.
2. The method according to claim 1, wherein, Rendering the virtual character of the second user in the target virtual world includes: Based on the visual information of the second terminal, determine the panoramic content that the second user is currently focusing on in the target user space; In the target virtual world, corresponding to the environmental location of the currently viewed panoramic content, the virtual character image of the second user is rendered, wherein the face of the virtual character image of the second user is facing the currently viewed panoramic content.
3. The method according to claim 1, further comprising: Upon receiving a first interactive instruction from the first terminal, the chat information of the first user is displayed in the target virtual world; Upon receiving a second interactive instruction from the second terminal, the chat information of the second user is displayed in the target virtual world.
4. The method according to claim 1, wherein, The panoramic content contained in the target user space includes panoramic videos and / or panoramic images.
5. The method according to any one of claims 1 to 4, wherein, In the current virtual world displayed by the first terminal to the first user, multiple user spaces of the platform are displayed, including: Based on the platform information of the platform, determine multiple user space information of the platform; Based on the multiple user space information, multiple user spaces of the platform are displayed in the current virtual world shown to the first user by the first terminal.
6. The method according to any one of claims 1 to 4, wherein, Based on the target user space selected by the first terminal from the plurality of user spaces, the current virtual world is switched to the target virtual world, including: Based on the target user space selected by the first terminal from the plurality of user spaces, determine the spatial information associated with the target user space; Based on the spatial information, determine the panoramic content contained in the target user space; Based on the panoramic content contained in the target user space, a target virtual world is constructed; The current virtual world is switched to the target virtual world so that the first terminal can display the panoramic content contained in the target user space to the first user in the target virtual world.
7. The method according to any one of claims 1 to 4, further comprising: Based on the viewing instructions of the first terminal, determine the target panoramic content that the first user needs to view in the panoramic content contained in the target user space. The target virtual world is rendered as the target panoramic content.
8. The method according to any one of claims 1 to 4, further comprising: Determine the first account information of the first user on the first terminal; Determine the second account information of the first user on the platform; Generate associated information based on the first account information and the second account information; When the multiple user spaces are displayed in the current virtual world, the associated information is identified on the user space corresponding to the second account information in the multiple user spaces.
9. A spatial display device, comprising: The first determining module is used to determine the access instruction generated by the first terminal based on the platform identifier triggered by the first user in the current virtual world displayed on the first terminal; According to the access instruction, the platform to be accessed is determined, wherein the platform is a third-party platform used to display two-dimensional panoramic content; A display module is used to display multiple user spaces of the platform within the current virtual world displayed by the first terminal to the first user, wherein the multiple user spaces include panoramic content; and The switching module is used to switch the current virtual world to the target virtual world according to the target user space selected by the first terminal from the plurality of user spaces, wherein the target virtual world displays the panoramic content contained in the target user space; The second determining module is used to determine the virtual character image of the second user corresponding to the second terminal when the platform to be accessed by the second terminal and the selected target user space match the first terminal. The first rendering module is used to render the virtual character image of the second user in the target virtual world.
10. An electronic device, comprising: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the method of any one of claims 1 to 8.
11. A non-transitory computer-readable storage medium storing computer instructions, wherein, The computer instructions are used to cause the computer to perform the method according to any one of claims 1 to 8.
12. A computer program product comprising a computer program that, when executed by a processor, implements the method according to any one of claims 1 to 8.
Citation Information
Patent Citations
System and method for augmented and virtual reality
CN105188516A
Synchronizing multiple head-mounted displays to a unified space and correlating movement of objects in the unified space
CN106716306A