Message transmission method, device and readable storage medium applied to metaverse

Abstract

The present invention discloses a message transmission method, device and readable storage medium applied to the metaverse. The method applied to a terminal device includes: establishing a digital space overlapping with the real space and presenting the digital space through the display component of the terminal device; obtaining the spatial position information of the terminal device, subscribing to the current spatial channel and theme from the server, wherein the spatial range of the current spatial channel is not less than the visible spatial range presented by the digital space; in response to receiving digital content that meets the subscribed theme in the subscribed spatial channel pushed by the server, superimposing the digital content into the digital space; monitoring whether the spatial position of the terminal device has changed, and in response to the change in the spatial position of the terminal device, canceling the original subscribed spatial channel to the server and subscribing to the current spatial channel. The embodiment of the present invention can adapt to the characteristics of the metaverse space, achieving the purpose of pushing theme messages to the client, and reducing the amount of pushed data.

Description

Technical Field

[0001] The present invention relates to the field of metaverse technology and also to the field of message transmission technology, and in particular to a message transmission method, device and readable storage medium applied to the metaverse. Background Art

[0002] The Metaverse is an open and shared online platform that integrates information technology, communications technology, and virtual technologies such as AR and VR. It is a vast and evolving virtual universe. Although currently limited by the state of technology, its application scenarios primarily include gaming, social networking, advertising and marketing, and virtual office work. However, with time and technological advancements, the application scenarios will expand, and more and more people will enter the Metaverse. The system that implements the Metaverse typically includes a client device and a server device. Users use the camera on the client device to capture images of their current spatial environment and use the device's positioning device to locate their spatial position, including altitude, orientation, and geographic coordinates, and then send this information to the server device. The server device stores a digital space that is a 1:1 ratio with the client device's space. Based on the client device's image of the environment and its spatial position, the server device locates the client device in the digital space. It then pushes digital content superimposed in the current digital space within the user's field of view (the visual range of the camera on the user's client device) to the user's client, where it is displayed on the user's client device, allowing the user to see content that is not in the real world through the client device screen.

[0003] When multiple users exist in the same metaverse, they form a user group. Based on specific application scenarios, users in the user group should be able to promptly experience new digital content and corresponding changes within the metaverse. This application scenario is similar to some existing group communication scenarios. However, due to the unique characteristics of the metaverse, existing group communication mechanisms cannot achieve this goal. For example, in an IoT system, devices, clients, and servers synchronize messages using IoT messaging mechanisms. Specific IoT protocols include MQTT, CoAP, and Lora. However, in IoT messaging mechanisms, each device has a unique ID. When a device connects to the network with an already-used ID, other devices with the same ID are disconnected. In a metaverse group scenario, digital content for the same service has the same service ID, and different users should be allowed to send digital content with the same service ID. This means that different users should be able to access the network with the same service ID. Clearly, existing IoT messaging mechanisms cannot achieve message synchronization in metaverse group scenarios. Another existing technology for group communication is backend messaging middleware, which uses backend messaging middleware to transmit messages and notifications within the same local area network. Protocols such as Kafka and RabbitMQ are used. However, backend messaging middleware is suited for synchronizing and distributing large amounts of data across a small number of clients. It cannot support a large number of clients, whereas Metaverse group scenarios should support massive numbers of clients. Therefore, backend messaging middleware is also unsuitable for group scenarios within the Metaverse. Other customized messaging mechanisms, such as those tailored for Counter-Strike games, are typically only suitable for specific scenarios and cannot serve as a universal mechanism for group message synchronization within the Metaverse. Summary of the Invention

[0004] In view of this, embodiments of the present invention provide a message transmission method, device, and readable storage medium applied to the metaverse, which are used to solve the message synchronization technical problem in the metaverse group scenario.

[0005] According to one aspect of the present invention, a message transmission method applied to a metaverse is provided, which is applied to a terminal device and includes the following steps:

[0006] establishing a digital space overlapping with the real space and presenting the digital space through a display component of a terminal device;

[0007] Obtaining spatial location information of the terminal device and subscribing to the current spatial channel and topic from the server, where the spatial range of the current spatial channel corresponds to the visible spatial range presented in the digital space; and

[0008] In response to receiving digital content that complies with the subscription theme in the subscription space channel pushed by the server, the digital content is superimposed into the digital space.

[0009] According to another aspect of the present invention, the present invention further provides a message transmission method applied to a metaverse, which is applied to a server and includes the following steps:

[0010] In response to receiving a subscription request for a spatial channel sent by a client, extracting spatial location information and subscription topic information of the terminal device from the subscription request;

[0011] Determining a subscription spatial channel of the client terminal device based on the spatial position information, wherein the spatial range of the subscription spatial channel corresponds to the visual spatial range of the current digital space presented by the client terminal device;

[0012] Pushing digital content that matches the subscription theme and is located in the subscription space channel to the client; and

[0013] In response to receiving a subscription cancellation request for an original subscription space channel sent by a client, the digital content of the original subscription space channel is stopped from being pushed to the client.

[0014] According to another aspect of the present invention, the present invention also provides a message transmission device applied to the metaverse, which is applied to a terminal device, including a digital space creation module, a subscription module and a content fusion module, wherein the digital space creation module is configured to establish a digital space overlapping with the real space and present the digital space through the display component of the terminal device; the subscription module is configured to obtain the spatial position information of the terminal device and subscribe to the current space channel and topic to the server; wherein the spatial range of the current space channel corresponds to the visual space range presented by the digital space; the content fusion module is configured to respond to the digital content that conforms to the subscription topic in the subscription space channel pushed by the server, and superimpose the digital content into the digital space.

[0015] According to another aspect of the present invention, the present invention also provides a message transmission device applied to the metaverse, which is on a server and includes a subscription processing module and a content push module, wherein the subscription processing module is configured to respond to a subscription request for a spatial channel sent by a client, extract the spatial location information of the terminal device from the subscription request, determine the subscription spatial channel of the client terminal device based on the spatial location information, and the spatial range of the subscription spatial channel corresponds to the visual spatial range presented by the current digital space of the client terminal device; respond to receiving a subscription cancellation request for the original subscription spatial channel sent by the client, cancel the corresponding original subscription spatial channel; the content push module is configured to push the digital content that meets the subscription theme located in the subscription spatial channel to the client; and stop pushing digital content to the client corresponding to the canceled subscription spatial channel.

[0016] According to another aspect of the present invention, the present invention also provides a terminal device, including a processor and a memory storing computer program instructions, wherein when the processor executes the computer program instructions, the aforementioned message transmission method applied to the metaverse is implemented.

[0017] According to another aspect of the present invention, the present invention also provides a server, including a processor and a memory storing computer program instructions; when the processor executes the computer program instructions, the aforementioned message transmission method applied to the metaverse is implemented.

[0018] According to another aspect of the present invention, the present invention also provides a computer-readable storage medium, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the aforementioned message transmission method applied to the metaverse is implemented.

[0019] According to another aspect of the present invention, the present invention also provides a computer program product, which includes computer program instructions, and when the computer program instructions are executed by a processor, the aforementioned message transmission method applied to the metaverse is implemented.

[0020] When subscribing to a topic, the client of the present invention also subscribes to a user-visible spatial range. The server then pushes only digital content within that visible spatial range to the client, achieving the goal of pushing topic messages to the client while also reducing the amount of data pushed. For scenarios with a large number of clients, the present invention effectively reduces the amount of transmitted data and network congestion, improves the timeliness of data push, reduces data transmission latency, and provides users with a superior experience of the metaverse space. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the implementation of the embodiment of the present invention, the following briefly introduces the drawings in the embodiment of the present invention.

[0022] Figure 1 This is a schematic diagram of a metaverse system architecture based on servers and terminal devices according to an embodiment of the present invention.

[0023] Figure 2 This is a flow chart of a message transmission method applied to the metaverse according to an embodiment of the present invention.

[0024] Figure 3 4 is a schematic diagram of spatial channels of multiple clients according to an embodiment of the present invention.

[0025] Figure 4 This is a schematic diagram of the principle of message transmission between the client and the server using the IoT protocol in the existing technology.

[0026] Figure 5The diagram is a schematic diagram showing the principle of message transmission between a client and a server according to an embodiment of the present invention.

[0027] Figure 6 This is a processing flow chart of a client subscribing to and publishing messages according to an embodiment of the present invention.

[0028] Figure 7 4 is a flowchart of a process for monitoring the spatial location of a mobile phone according to an embodiment of the present invention.

[0029] Figure 8 FIG. 4 is a flow chart of a method for monitoring digital content according to an embodiment of the present invention.

[0030] Figure 9 This is a principle block diagram of a message transmission device applied to the metaverse according to an embodiment of the present invention.

[0031] Figure 10 It is a principle block diagram of a message transmission device applied to the metaverse according to another embodiment of the present invention.

[0032] Figure 11 FIG. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

[0033] Figure 12 FIG. 4 is a schematic diagram of a software structure of an exemplary terminal device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0034] The principles and spirit of the present invention will be described below with reference to several exemplary embodiments. It should be understood that the purpose of providing these embodiments is to make the principles and spirit of the present invention clearer and more thorough, so that those skilled in the art can better understand and implement the principles and spirit of the present invention. The exemplary embodiments provided herein are only a part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments herein, all other embodiments obtained by those of ordinary skill in the art without creative work are within the scope of protection of the present invention.

[0035] Those skilled in the art will appreciate that embodiments of the present invention may be implemented as a system, apparatus, device, method, computer-readable storage medium, or computer program product. Therefore, the present invention may be implemented in at least one of the following forms: entirely in hardware, entirely in software, or a combination of hardware and software. According to specific embodiments of the present invention, the present invention claims protection for a message transmission method, apparatus, terminal device, server, computer-readable storage medium, and computer program product for use in the Metaverse.

[0036] In this document, terms such as first, second, and third are only used to distinguish one entity (or operation) from another entity (or operation), and are not intended to require or imply any order or relationship between these entities (or operations).

[0037] The embodiments of the present invention can be applied to servers and terminal devices. Figure 1 , schematically shows a schematic diagram of a metaverse system architecture based on servers and terminal devices. The metaverse system architecture includes a server 10 and several terminal devices 20. In some examples, the terminal device 20 is a client device, for example, it can be a dedicated device, such as a head-mounted display (HMD), smart gloves, clothing and other smart wearable electronic devices. In some examples, the terminal device 20 can be a general AR / VR (Augmented Reality / Virtual Reality) device, such as a mobile phone, a portable computer, a laptop computer, a tablet computer, AR glasses, a vehicle-mounted device, a navigation device, a gaming device, etc.

[0038] Taking AR helmets or AR glasses as an example, head-mounted displays, machine vision systems, mobile computers, etc. can be integrated and set in a bindable wearable device. The device has a display that looks like glasses and is worn on the user's head when working. The device can transmit augmented reality information to the display or project it into the user's eyeballs, thereby enhancing the user's visual immersion. In some examples, the AR device also has a camera, which can be a wide-angle camera, a telephoto camera, or a structured light camera (also known as a point cloud depth camera, a 3D structured light camera, or a depth camera). The structured light camera is based on 3D vision technology and can obtain the plane and depth information of the object. The structured light camera can project light with certain structural features onto the object being photographed through a near-infrared laser, and then the reflected light is collected by the infrared camera and processed by the processor chip. Its calculation principle is to calculate the object's position and depth information based on the changes in the light signal caused by the object to present a 3D image. Conventional terminal devices, such as mobile phones, present two-dimensional images and cannot display the depth of different positions on the image. Structured light cameras can be used to capture and obtain 3D image information data, that is, not only can information such as color at different positions in the image be obtained, but also depth information at different positions can be obtained, which can be used for AR ranging. Of course, ordinary terminal devices can also acquire 2D images based on optical cameras and obtain depth information of 2D images by combining deep learning algorithms, and finally present 3D images. In some examples, the terminal device 20 also includes components for positioning, such as GPS systems, gyroscopes, IMU units and other sensors, and uses SLAM (Simultaneous Localization And Mapping) and V-SLAM (Visual Simultaneous Localization And Mapping) technologies to build an environmental map based on the collected sensor information and environmental image information. While building the environmental map, the terminal device's own position is also calculated synchronously, that is, the terminal device's own position in the current environmental map is determined. It is also possible to extract visual features of the environmental space and determine the position of the terminal device itself in the current scene by matching visual features based on an existing digital spatial model of the current scene.

[0039] In some examples, the terminal device 20 is installed with a metaverse client software or APP (Application) with AR / VR functions, and is integrated with a module with networking functions, such as a Wireless Fidelity (Wifi) module, a Bluetooth module, a 2G / 3G / 4G / 5G communication module, etc., so as to connect to the server 10 through the network. The user can log in to the user account through the client software or APP installed in the terminal device 20. The server 10 provides a metaverse system, which cooperates with the user to realize various application scenarios based on the operation of the client software or APP in the terminal device 20. The server 10 can be a single server, a server cluster composed of multiple servers, a cloud server or a cloud server, etc.

[0040] The embodiments of the present invention relate to terminal devices and / or servers. The principles and spirit of the present invention will be explained in detail below through several exemplary embodiments or representative implementations.

[0041] Figure 2 This is a flow chart of a message transmission method applied to the Metaverse according to an embodiment of the present invention. Figure 2 The process flow of a message transmission method between a client terminal device and a server is shown, including the following steps:

[0042] In step S101, a digital space that overlaps with the real world is established on the client, and the digital space is presented on the display component of the terminal device. For example, based on the environmental image captured by the user's terminal device camera, a three-dimensional digital space that overlaps with the real world is established using V-SLAM technology, and the digital space is presented on the display component of the terminal device. In this case, the content viewed by the user on the display component of the terminal device overlaps with the current real world.

[0043] Step S102: Acquire the spatial location information of the terminal device. In one embodiment, the terminal device's positioning component, such as a GPS system, obtains the geographical coordinates of the terminal device's current location. Based on a set standard orientation, the angle between the terminal device and the standard orientation is determined. The geographical coordinates of the terminal device's current location and the angle between the terminal device and the standard orientation are used as the spatial location information of the terminal device.

[0044] Step S103: Subscribe to the current spatial channel and topic from the server. Based on a specific application scenario, the client sends a subscription request to the server, which includes at least the spatial location information of the terminal device and the subscription topic. Examples of subscription topics include service topics provided by the current application scenario, such as "releasing river lanterns," "releasing Kongming lanterns," and "game battles." In the present invention, the spatial range corresponding to the digital space presented by the user through the display component of the terminal device is called a spatial channel. This spatial range is the user's visible range. Subscribing to the visible spatial range of the current digital space while subscribing to the topic means subscribing to the current spatial channel.

[0045] Step S201: Correspondingly, the server extracts the spatial location information of the terminal device from the subscription request. When the server receives a subscription request for a spatial channel sent by a client, it extracts information from the subscription request, such as the client ID and the spatial location information of the client terminal device.

[0046] In step S202, the server determines the subscription spatial channel of the client terminal device based on the spatial location information. The server can determine the location of the client terminal device in the metaverse space based on the geographic coordinates in the client spatial location information. The metaverse space is a three-dimensional virtual space that is in a 1:1 ratio with the user's current real space. The server can then determine the visual range of the user's digital space in the client device based on the angle between the terminal device and the standard orientation. In one embodiment, a preset fixed viewing angle range is used as the visual range of the client terminal device, that is, the client's spatial channel. For example, Figure 3 As shown, Figure 3 This is a schematic diagram of a space channel for multiple clients according to an embodiment of the present invention. The figure shows the application scenario of "releasing river lanterns". There are multiple users in the current metaverse space scenario, among which Figure 3 The following figure shows three user clients C0, C1, and C2. In this embodiment, the spatial point where the client device is located is the vertex, and the 30-degree angle range of the client device is considered to be the user's visual range and is called the spatial channel. In order to mark the spatial channel of each client device, the compass is used as the standard direction, and turning right is the positive direction. Figure 3As shown in the figure, the angle between the left boundary of client C0's visual range and the north arrow is 0°, and the angle between the right boundary and the north arrow is 30°. Therefore, the corresponding angle of the visual range is 0° to 30°, and its subscribed spatial channel is a visual range of 0° to 30° with the spatial coordinates (x0, y0, z0) as the starting point. Similarly, the corresponding angle of the visual range of client C1 is -5° to 25°, and its subscribed spatial channel is a visual range of -5° to 25° with the spatial coordinates (x1, y1, z1) as the starting point. The corresponding angle of the visual range of client C2 is -15° to 15°, and its subscribed spatial channel is a visual range of -15° to 15° with the spatial coordinates (x2, y2, z2) as the starting point. In other embodiments, the angles corresponding to the visual ranges of different types of client terminal devices are different. For example, for client terminal devices with normal viewing angles, the visual range corresponds to an angle of 30°, while for some client devices with wide-angle cameras, the visual range corresponds to an angle of 60°. The server establishes a subscription table based on the above information to record the topics subscribed to by each client entering the metaverse space and the current subscription space channel. For example, as shown in Table 1 below:

[0047] Table 1

[0048]

[0049] The type Sub represents subscription, and Topic1 represents the subscribed topic, such as the theme activities of services in the metaverse scenario, such as "releasing river lanterns" and "game battles".

[0050] Step S203, the server pushes the digital content that matches the subscription theme in the subscription space channel to the client. After the server determines the subscription space channel of a client terminal device, it pushes the digital content that matches the subscription theme in the subscription space channel to the client. Figure 3 As shown in , the river lantern O0 released by the client C0 is digital content, which is located in the subscription space channel of the current client C1. At this time, the server pushes the river lantern O0 released by the client C0 to the client C1.

[0051] In step S104, after receiving the digital content that matches the subscription theme in the subscription space channel pushed by the server, the client overlays the digital content into the digital space, so that the user can see the digital content presented in the digital space through the display component.

[0052] In step S105, the client monitors whether the spatial location of the terminal device has changed. If the spatial location of the terminal device has changed, in step S106, the client cancels the original subscription to the server and subscribes to the current spatial channel. This means that the client sends a subscription cancellation request to the server and a new subscription request that includes the new spatial location information of the terminal device.

[0053] Correspondingly, upon receiving the client's subscription cancellation request, the server stops pushing digital content to the original subscription channel in step S204 and deletes the original subscription channel from the subscription table. Upon receiving a new subscription request, the server calculates a new subscription channel in step S205 and adds the new subscription channel to the subscription table. In step S206, the server pushes the digital content matching the subscription theme in the new subscription channel to the client.

[0054] In step S107 , the client receives the digital content that matches the subscription theme in the transformed subscription space channel pushed by the server, overlays the digital content in the digital space, and deletes the original digital content overlaid in the digital space.

[0055] Since the messages in the metaverse space are usually digital content sent by the client, in order to push digital content to a large number of clients in the metaverse space, the present invention adopts a subscription / publishing mechanism. The client actively subscribes, and the server pushes digital content that matches its subscribed topic to the client based on the subscription request. Based on the characteristics of the metaverse space, when subscribing to a topic, the client also subscribes to a user-visible space range. The server only pushes digital content within its visible space range to the client, which not only achieves the purpose of pushing topic messages to the client, but also reduces the amount of data pushed. For a scenario with a large number of clients, the present invention effectively reduces the amount of transmitted data and the congestion of the network caused by large amounts of data, improves the timeliness of data push, reduces data delay, and enables users to have a good experience of the metaverse space.

[0056] According to an embodiment of the present invention, on a client terminal device, when a client joins a Metaverse space, in order to receive digital content added to the Metaverse space, such as viewing river lanterns released by other users, the client needs to subscribe to a topic and space channel from the server. In one embodiment, before subscribing to a space channel with the server, the client uses its client ID to establish a subscription link with the server. When the server receives a subscription request from the client, it creates a subscription link ID for the client based on the client ID in the subscription request, creates a first ID mapping between the client ID and the subscription link ID, and establishes a subscription link with the first client based on the first ID mapping. The server maintains an ID mapping table that includes at least a mapping between the client ID and the subscription link ID. When the client ID is a service ID (e.g., a "River Lantern Release" ID), since many different clients may access the Metaverse space using the same service ID, in one embodiment, the server adds an alias attribute field to the ID mapping table to identify different clients with the same service ID. This field is assigned the ID set by the client (e.g., user ID) to distinguish the actual client corresponding to the current subscription link ID.

[0057] In addition to being able to receive digital content added to the metaverse space, the client can also publish digital content. For example, in the aforementioned "releasing river lanterns" scenario, in addition to allowing users to see river lanterns released by other users, users can also release river lanterns themselves, and these river lanterns can be visible to any user, that is, the client can publish messages. In order for the client to publish digital content in the form of a message, the client establishes a publishing link with the server before publishing. In one embodiment, when publishing digital content, the client sends a publishing request to the server, and the publishing request includes a client ID, such as a business ID, a user ID, etc. When the server receives the publishing request sent by the client, it creates a publishing link ID for the client based on the client ID in the publishing request, and creates a second ID mapping relationship between the client ID and the publishing link ID, and establishes a publishing link with the client based on the second ID mapping relationship. After the publishing link is established, the client can publish its digital content to the metaverse space. Among them, the server-side second ID mapping relationship establishes a mapping table between the client ID and the publishing link ID. Since the client ID is usually a business ID, there are multiple different clients with the same business ID in the same metaverse scenario. In order to distinguish these clients, in one embodiment, the server also adds an alias attribute field in the ID mapping table and assigns the ID set by the client (such as the user ID) to this field to distinguish the real client corresponding to the current publishing link ID. In one embodiment, the mapping table when establishing the subscription link and the mapping table when establishing the publishing link are combined into one mapping table, as shown in Table 2:

[0058] Table 2

[0059] Business ID Aliases Subscription link ID Release Link ID 001 xxx 0011xxx 0012xxx 001 yyy 0011yyy 0012yyy 002 xxy 0021xxy 0022xxy …… …… …… ……

[0060] Among them, the business ID represents different business scenarios, such as "releasing river lanterns", "releasing Kongming lanterns", etc. The content in the alias is the ID set by the client, such as user ID, user nickname, etc. The subscription link ID and the publishing link ID are two links established for the same client. In order to adapt to the location of the client device changing at any time, it is necessary to frequently switch the subscription space channel. Therefore, in one embodiment, the subscription link established between the client and the server is a long link, that is, it remains connected after the subscription is completed, so as to facilitate the unsubscription and resubscription of the space channel at any time. The publishing link used for message publishing can be either a long link or a short link. In one embodiment, the publishing link is a short link, that is, the link is disconnected after the message is published, and the publishing link is re-established when the message needs to be published, thereby reducing the occupation of network ports and network resources.

[0061] Figure 4 This is a schematic diagram of the principle of the client and server using the IoT protocol to transmit messages in the existing technology. Figure 4 As shown in the figure, take three clients subscribing to and publishing to the same topic ( / Topic1) as an example. Each client uses a different ID to establish a Sub (subscription) TCP long link with the server, as shown in the figure. Figure 4 The three clients in the figure establish TCP long connections with the server with ID=1, ID=2, and ID=3 respectively, and subscribe to the topic Topic1, as shown by the thick solid line in the figure. When a client publishes a message, it uses another ID to temporarily establish a publish TCP short connection with the server, such as the first client establishes a TCP short connection for publishing with ID=1', as shown by the thin solid line in the figure. The client cannot use ID=1 to establish a TCP short connection for publishing. This is because, based on the IoT protocol, when ID=1 is used to establish a TCP short connection for publishing, the TCP long connection for subscription established with the same ID will be kicked offline. The other two clients establish pub TCP short connections with ID=2' and ID=3' respectively when they need to publish messages. Since these two clients have not published messages at present, the TCP short connection for publishing has not yet been established. It can be seen that when the IoT protocol is used for message transmission in the prior art, the client needs to use two different IDs to establish a subscription link and a publishing link with the server. The first client in the figure establishes a short TCP connection with the server and publishes a message about Topic 1. The server pushes the message to all clients, as shown by the dotted line in the figure.

[0062] Figure 5It is a schematic diagram of the principle of message transmission between the client and the server according to an embodiment of the present invention. In this embodiment, each client uses a client ID to establish a TCP long link for subscription and a TCP long / short link for publishing with the server. The three clients in the figure establish TCP long links for subscription with ID=1, ID=2 and ID=3 respectively. When publishing messages, they still establish TCP long / short links for publishing with the original ID=1, ID=2 and ID=3. After the first client publishes a message {"Data":"join"}, the server pushes the message to the other two clients, as shown by the dotted lines in the figure. In the present invention, the server sets a source field for each published message. The value in the source field is the client that published the message. When the server pushes the message, it filters out the source client that published the message, so Figure 5 As shown in the figure, after the first client sends a message, it will not receive the same message pushed from the server. Therefore, the server reduces the amount of pushed data, and the client also reduces the amount of processing for push messages, which is conducive to improving message transmission efficiency.

[0063] Figure 6 This is a flowchart of the client's message subscription and publishing process according to one embodiment of the present invention. The client device in this embodiment is a mobile phone, which has a client application installed. This client application provides multiple metaverse scenarios, each corresponding to a specific service scenario. The user can select a specific service scenario. Based on the user's selection, the client application enters the corresponding metaverse scenario and transmits the message. The metaverse scenario in this embodiment is the "Kongming Lantern" scenario.

[0064] Step S301: Based on the user's startup operation on the client application, a scene selection interface is provided to display multiple different metaverse space scenes to the user.

[0065] In step S302, a digital space is created that overlaps with the real world based on the metaverse scene selected by the user, and this digital space is presented on the mobile phone screen. At this point, the user sees a scene on the mobile phone screen that completely overlaps with the current real world. In this embodiment, the service corresponding to each metaverse scene is identified by a service ID.

[0066] Step S303, establish a long subscription link with the server. Specifically, obtain the spatial location information of the mobile phone, and send a subscription request to the server. The subscription request includes the spatial location information of the mobile phone, the service ID, and the ID set by the user. The server responds to the subscription request and establishes a long subscription link with the client. When establishing a long link, the server also establishes an ID mapping table, as described in the previous embodiment, which will not be repeated here. The server determines the subscription spatial channel based on the spatial location information of the mobile phone, and the spatial range of the current spatial channel is not less than the visual spatial range presented by the digital space.

[0067] Step S304: Receive a message pushed by the server and overlay the digital content in the message onto the digital space displayed on the mobile phone screen. After the server detects a new client access and determines its subscribed spatial channel, it determines whether a message should be pushed to the client. In one embodiment, the server traverses the spatial channels containing digital content matching the subscribed theme to determine digital content matching the subscribed theme within the subscribed spatial channel; or it traverses the digital resources within the client's subscribed spatial channel to determine digital content matching the subscribed theme within the subscribed spatial channel. When it is determined that digital content needs to be pushed, the server extracts the digital content data that conforms to the subscribed spatial channel's angle and positional relationship, as well as the overlay position and occlusion relationship between the digital content and the space. This data is then pushed to the client in the form of a message via a subscription long link. Upon receiving the pushed message, the client extracts the digital content data and the positional relationship between the digital content and the space from the message. Based on the positional relationship between the digital content and the space, the server determines the overlay position in the current digital space and the occlusion relationship between the digital content and the space. The server then renders the digital content at the determined overlay position according to the occlusion relationship between the digital content and the space. At this point, the user can see a Kongming lantern on their phone screen, even though it doesn't exist in the real world. The lantern's shape is consistent with its position in the scene. For example, when the lantern is above the phone's camera, the lantern appears as if it were viewed from a certain angle. The lantern's position has the necessary occlusion relationships with other objects in the scene. For example, if there are pedestrians in the scene, the lantern may be partially obscured by one of them. Because the server includes this occlusion relationship data when pushing the lantern data, the client renders the unobstructed lantern at the pedestrian's location based on this occlusion relationship data, resulting in a realistic 3D lantern experience for the user.

[0068] At this time, the user can see the digital content of the metaverse space scene by simply starting the client application and selecting the specific metaverse space scene.

[0069] When a user wants to publish a Kongming lantern, they call up a message publishing interface and generate a Kongming lantern on it. In one embodiment, the message publishing interface can include various tools, such as drawing tools, text addition tools, and special effects tools. The user uses these tools to create a satisfactory Kongming lantern, adds it to the digital space displayed on the screen, and issues a publish instruction by clicking a publish button.

[0070] In step S305, the client establishes a short link for publishing with the server based on the publishing instruction. Specifically, the client sends a publishing request to the server, which includes the service ID and the client ID set by the user. The server responds to the publishing request and establishes a short link for publishing with the client. When establishing the short link for publishing, the server also creates an ID mapping table, as described in the previous embodiment and will not be repeated here.

[0071] In step S306, the client publishes the user-generated Kongming lantern data to the Metaverse space via a short link in the form of a message. This Kongming lantern data includes the lantern data itself and its location within the digital content. When the user adds the created Kongming lantern to the digital space displayed on the screen, its spatial position is calculated to obtain location data. When the Kongming lantern is sent, its location data is published along with the Kongming lantern data.

[0072] Step S307: disconnect the short link published with the server.

[0073] As can be seen from the aforementioned client subscription and message publishing processing flow, when a large number of users access a metaverse space, in order to provide users with a large amount of digital content added to the space, the server needs to perform a lot of calculations and processing. The present invention provides a message transmission method applied to the metaverse that effectively reduces the amount of calculation and improves the efficiency of message transmission.

[0074] In the aforementioned overall process, the client also monitors the spatial location of the mobile phone. Once the spatial location of the mobile phone changes, the client needs to re-subscribe to the spatial channel. Figure 7 4 is a flowchart of a process for monitoring the spatial location of a mobile phone according to an embodiment of the present invention.

[0075] Step S401 determines whether the phone's location has changed. If so, step S402 is executed; if not, the process returns to step S401. When a user moves, the geographic location of the phone changes. When a user turns their body, the orientation of the phone changes. When a user raises or lowers the phone, the height and spatial angle of the phone change. The client obtains the phone's location information, including its planar geographic coordinates, height, and spatial angle, in real time and compares it with the previously recorded location information. If any of this location information changes, step S402 is executed.

[0076] Step S402: Send a request to cancel subscription of the original spatial channel to the server. When the server receives the request, step S501 releases the resources of the original spatial channel, such as deleting the angle and spatial coordinates corresponding to the spatial channel identifier in Table 1.

[0077] Step S403: Calculate the spatial location information of the mobile phone.

[0078] In step S404, it is determined whether the mobile phone's location has stopped changing. If so, in step S405, a spatial channel subscription request is sent to the server. The spatial channel subscription request includes the calculated new spatial location information of the mobile phone. Accordingly, in step S502, the server responds to the request, determines a new spatial channel subscription based on the spatial location information, and updates Table 1. In step S503, the digital content located in the new spatial channel subscription is re-determined and pushed to the client. When pushing messages to the client, the server filters out the source client of the message, thereby preventing repeated push of messages published by the same client to the client.

[0079] Step S406: Receive digital content and overlay it into the digital space, and then return to step S401.

[0080] The client monitors the spatial position of the client device in real time and switches the spatial channel at any time by cooperating with the server, ensuring that no matter how the client's position changes, it can receive digital content within its visual range.

[0081] In some application scenarios, the digital content published by the client to the metaverse is movable. For example, a river lantern placed in a river will drift with the flow of the water, and a sky lantern released into the air will flutter in the wind. First, this positional change of the digital content should be presented to the client in real time. Second, even if the spatial position of the client device does not change, the digital content's spatial position may move it outside the client's visual range. Therefore, the server also includes a method and process for monitoring the position of digital content and processing it. Since the metaverse contains multiple digital contents, each one is processed identically, so the processing of a single digital content is used as an example for explanation. Figure 8 FIG is a flow chart of a method for monitoring digital content according to an embodiment of the present invention. Figure 8 , the method process includes:

[0082] Step S601 monitors whether the location of the digital content has changed. If so, proceed to step S602; if not, return to step S601. The server records specific information about each piece of digital content, such as the source client that published the digital content, the location of the digital content, and the spatial channels subscribed to by N other clients.

[0083] Step S602: Calculate the real-time location of the digital content.

[0084] Step S603 determines a calculation range and traverses and calculates the positional relationship between the current real-time position of the digital content and all subscription spatial channels within the calculation range, such as calculating the angle between the digital content and the starting points of all subscription spatial channels. The calculation range may be the subscription spatial channels determined in the previous calculation of the digital content.

[0085] Step S604: taking a subscribed spatial channel as a target spatial channel.

[0086] Step S605 determines whether the digital content has moved out of the target spatial channel. If so, in step S606, the digital content is stopped from being pushed to the client corresponding to the target spatial channel, and step S607 is executed. If not, in step S609, the digital content is pushed to the client corresponding to the target spatial channel, and step S610 is executed. If the digital content has not moved out of the target spatial channel, the digital content data that is adapted to the angle and position relationship of the subscribed spatial channel, as well as the overlay position and occlusion relationship between the digital content and the space, is extracted and pushed to the client.

[0087] Step S607: Determine whether the digital content has entered a new subscription space channel. If the current real-time location of the digital content has entered a new subscription space channel, then in step S608, the new subscription space channel is added to the next calculation range. If not, then proceed to step S609.

[0088] Step S610 determines whether there are any unprocessed subscription space channels in the calculation range. If so, the process returns to step S604. If all subscription space channels in the calculation range have been processed, the monitoring calculation is completed. This process continues in the application scenario until the application scenario ends.

[0089] by Figure 3 As an example, the client subscribes to the space channel and digital content shown in the figure. The server is based on Figure 8 The processing flow shown calculates and maintains the contents of Table 3 below:

[0090] Table 3

[0091] Channel Identification O0(t0) O0(t1) O0(t2) …… / C0 / + 15° 5° -5° …… / C1 / + 20° 10° -3° …… / C2 / + 22° 10° -10° ……

[0092] In this embodiment, the server uses the north pointer as a reference to periodically calculate the position of digital content O0 and the angle between it and the spatial coordinates of each client device that forms a subscription channel. The first column in Table 3 indicates the subscription channel identifier, while the second, third, and fourth columns represent the angles between digital content O0 and the subscription channel, calculated at times t0, t1, and t2, respectively. After calculating the angle between digital content O0 and the subscription channel at each time point, the calculated angle is compared with the angle of the subscription channel. Based on Table 1, at time t0, digital content O0 is located within the subscription channels of clients C0 and C1, but outside the subscription channel of client C2. At this point, the server pushes digital content O0 to client C1. At time t1, digital content O0 is located within the subscription channels of clients C0, C1, and C2. At this point, the server pushes digital content O0 to clients C1 and C2. At time t1, the digital content O0 is located in the subscription space channel of clients C1 and C2, and outside the subscription space channel of client C0. At this time, the server pushes the digital content O0 to clients C1 and C2.

[0093] Because the server of the present invention sets a source field for each published message, and the value in the source field is the client that published the message, the server filters out the source client that published the message when pushing the message. Based on this setting, the present invention can implement group message filtering. Taking a game battle scenario as an example, multiple users team up in the same metaverse space to engage in a shooting battle. The server sets the source field of messages sent by users on the same team to the same ID, such as the team ID of the user. When a user in one group targets a user in another group, the user operates the client to fire a bullet at the target user within the current visual range captured by the camera. The bullet is digital content in the digital space. When the server pushes the bullet sent by the user to the client of the user in the metaverse space, it filters out clients with the same ID in the bullet source field. Therefore, users on the same team as the bullet will not receive the bullet. Effectively, the bullet fired by the user will not hit teammates on the same team, further expanding the application scenarios and improving the user experience of the metaverse space.

[0094] For group application scenarios of the metaverse, when the number of users is large and massive digital content needs to be transmitted, the method provided by the present invention does not perform full calculations, but only transmits digital content within the client's visible range to the client, thereby effectively reducing the amount of calculation and the amount of data transmitted by the message. Even client devices and server devices with ordinary performance can maintain smooth and timely message transmission, effectively avoiding data delays and the feeling of jamming caused by large amounts of calculation, thereby improving the user experience in the metaverse space.

[0095] It should be noted that for the sake of clarity, each embodiment of the present invention is described as a series of actions or processes. Those skilled in the art should be aware that the implementation process is not limited by the order of the actions or processes described, and some steps in the embodiments of the present invention can be processed in other orders or simultaneously.

[0096] On the other hand, the present invention also provides a message transmission device applied to the metaverse, such as Figure 9 As shown, Figure 9This is a block diagram of a message transmission device for use in a metaverse according to an embodiment of the present invention, which includes a first message transmission device 100 for use in a metaverse, applied to a user terminal device 300, and a second message transmission device 200 for use in a metaverse, applied to a server. The first message transmission device 100 includes a digital space creation module 110, a subscription module 120, and a content fusion module 130. The user terminal device 300 includes a device-side communication module 310, such as a Wi-Fi module, a Bluetooth module, a 2G / 3G / 4G / 5G communication module, etc., for communicating with the server 400. The user terminal device 300 also includes a location information module 320, such as a sensor such as a GPS system, a gyroscope, or an IMU unit, for obtaining real-time spatial location information of the user terminal device 300, such as planar geographic coordinates, altitude, spatial angle, etc. The user terminal device 300 also includes a display screen 330. The user terminal device 300 also includes other modules, such as a camera, etc.

[0097] The digital space creation module 110 is connected to the location information module 320 and the camera, respectively, to establish a digital space that overlaps with the real space based on the spatial position of the user terminal device 300 and the environmental image, and present this digital space on the display screen 330. The subscription module 120 is connected to the location information module 320 and the device-side communication module 310, respectively, to obtain the spatial location information of the terminal device, subscribe to the current spatial channel and topic from the server, and monitor whether the spatial location of the terminal device has changed. In response to a change in the spatial location of the terminal device, the subscription module 120 cancels the subscription to the original spatial channel and subscribes to the current spatial channel. The spatial range of the current spatial channel corresponds to the visible spatial range of the digital space, or the spatial range of the current spatial channel is not less than the visible spatial range of the digital space. The content fusion module 130 receives digital content that matches the subscribed topic within the subscribed spatial channel pushed by the server through the device-side communication module 310 and overlays this digital content into the digital space. The second message transmission device 200 for the metaverse, applied to the server, includes a subscription processing module 210 and a content push module 220. The server includes a server-side communication module 410 and other necessary modules, such as a database, etc. Among them, the subscription processing module 210 receives and processes the subscription request and cancellation request of the spatial channel sent by the client. When a subscription request is received, the spatial location information of the terminal device is extracted from the subscription request, and the subscription spatial channel of the client terminal device is determined based on the spatial location information. When a cancellation request for a subscription spatial channel is received, the subscription spatial channel resources for the client are released, that is, the spatial channel to which the client has subscribed is canceled, and a stop push notification is sent to the content push module 220. The content push module 220 pushes the digital content that meets the subscription theme and is located in the subscription spatial channel to the client; when a stop push notification is received, the digital content of the subscription spatial channel that has been canceled is stopped from being pushed to the client.

[0098] The subscription module 120 uses the client ID to establish a subscription link with the server before subscribing to the current spatial channel. In one embodiment, the subscription link is a long link.

[0099] When superimposing the digital content into the digital space, the content fusion module 130 extracts digital content data and positional relationship data between the digital content and the space from the digital content in the subscription space channel pushed by the server; determines the superimposed position in the current digital space and the occlusion relationship between the digital content and the digital space based on the positional relationship between the digital content and the space; and renders the digital content at the determined superimposed position according to the occlusion relationship between the digital content and the digital space.

[0100] When the subscription processing module 210 receives a subscription request for a spatial channel sent by a client, it creates a subscription link ID for the client based on the client ID in the subscription request, creates a first ID mapping between the client ID and the subscription link ID, and establishes a subscription link with the first client based on the first ID mapping.

[0101] The content push module 220 traverses the spatial channels where the digital content that meets the subscription theme is located to determine the digital content that meets the subscription theme and is located in the subscription spatial channel; or traverses the digital resources located in the subscription spatial channel to determine the digital content that meets the subscription theme and is located in the subscription spatial channel from the digital resources; after determining the digital content to be pushed, the digital content data that adapts to the subscription spatial channel angle and position relationship and the superposition position and occlusion relationship between the digital content and the space are extracted; the digital content data that adapts to the subscription spatial channel angle and position relationship and the position relationship data including the superposition position and occlusion relationship between the digital content and the space are pushed to the client in the form of a message. In addition, when pushing digital content to multiple clients, the content push module 220 filters out the source client that published the digital content. The content push module 220 also monitors whether the position of the digital content changes. When the position of the digital content changes, it calculates in real time the positional relationship between the real-time position of the digital content and the client's subscription space channel; when the real-time position of the digital content moves out of the client's subscription space channel, it stops pushing the digital content data to the client; when the real-time position of the digital content is within the client's subscription space channel, it extracts the digital content data that is adapted to the subscription space channel angle and positional relationship, as well as the superimposed position and occlusion relationship between the digital content and the space, and pushes them to the client.

[0102] Figure 10 1 is a block diagram of a message transmission device applied to the Metaverse according to another embodiment of the present invention. It includes a first message transmission device 100 applied to the Metaverse applied to a user terminal device 300 and a second message transmission device 200 applied to the Metaverse applied to a server 400. Figure 9Compared to the device shown in FIG. 1 , the first message transmission device 100 in this embodiment further includes a publishing module 140. When a user publishes digital content, a publishing link, such as a long link or a short link, is established with the server via the publishing module 140 and the device-side communication module 310, and the digital content is published in the metaverse space in the form of a message. The published message includes the location information of the digital content in its current space. Correspondingly, the second message transmission device 200 further includes a publishing processing module 230, which establishes a publishing link with the client based on the publishing request sent by the client, adds the digital content to the metaverse space according to the location information of the digital content in the client message, and sends a new message notification to the content push module 220. The content push module 220 determines the subscription space channel where the digital content is located based on its location, and pushes the digital content to the corresponding client.

[0103] Those skilled in the art should understand that the embodiments described herein are preferred embodiments, and the actions, steps, or modules involved are not necessarily required for the embodiments of the present invention. In the above embodiments, the embodiments of the present invention have different focuses on the description of each embodiment. For parts not described in detail in one embodiment, please refer to the relevant description of other embodiments.

[0104] Figure 11 : is a structural diagram of an electronic device according to an embodiment of the present invention, the electronic device 60 includes a processor 61, a memory 62 and a communication bus for connecting the processor 61 and the memory 62, wherein the memory 62 stores a computer program that can be run on the processor 61, and when the processor 61 runs the computer program, it can execute or implement the steps in the method of each embodiment of the present invention. The electronic device 60 also includes a communication interface for receiving and sending data. The electronic device 60 can be a server in an embodiment of the present invention, and the electronic device 60 can also be a cloud server. The electronic device 60 can also be a terminal device or an AR device in an embodiment of the present invention. Under appropriate circumstances, the electronic device can also be called a computing device.

[0105] In some embodiments, the processor 61 may be a central processing unit (CPU), a graphics processing unit (GPU), an application processor (AP), a modem processor, an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, a neural network processing unit (NPU), etc.; the processor 61 may also be another general-purpose processor, an application-specific integrated circuit (ASIC), an off-the-shelf field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor. The neural network processor (NPU), by drawing on the structure of biological neural networks, can quickly process input information and can also continuously self-learn. The NPU electronic device 60 can implement intelligent cognitive applications such as image recognition, face recognition, semantic recognition, speech recognition, and text comprehension.

[0106] In some embodiments, the memory 62 may be an internal storage unit of the electronic device 60, such as the hard drive or memory of the electronic device 60. The memory 62 may also be an external storage device of the electronic device 60, such as a plug-in hard drive, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash memory card, etc. equipped on the electronic device 60. The memory 62 may also include both the internal storage unit of the electronic device 60 and an external storage device. The memory 62 may be used to store an operating system, application programs, a boot loader, data, and other programs, such as the program code of a computer program. The memory 62 includes, but is not limited to, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or compact disc read-only memory (CD-ROM). The memory 62 is used to store program code executed by the electronic device 60 and transmitted data. The memory 62 may also be used to temporarily store data that has been output or is about to be output.

[0107] Those skilled in the art will understand that Figure 11 This is only an example of the electronic device 60 and does not constitute a limitation on the electronic device 60. The electronic device 60 may include more or fewer components than shown in the figure, or combine certain components, or include different components, for example, it may also include input and output devices, network access devices, etc.

[0108] When the electronic device 60 is the terminal device mentioned above in the present invention, the memory 62 stores computer program instructions for implementing the message transmission method applied to the metaverse in the aforementioned embodiment of the present invention. When the processor 61 executes the computer program instructions, the message transmission method applied to the metaverse by the client is implemented.

[0109] When the electronic device 60 is the server mentioned above in the present invention, the memory 62 stores computer program instructions for implementing the message transmission method applied to the metaverse in the aforementioned embodiment of the present invention. When the processor 61 executes the computer program instructions, the message transmission method applied to the metaverse by the server is implemented.

[0110] The aforementioned memory 62 constitutes a computer-readable storage medium, on which computer program instructions are stored. When the computer program instructions are executed by the processor, the client and / or server implements the message transmission method applied to the metaverse.

[0111] The computer program instructions stored in the memory 62 constitute a computer program product, which can be installed in an electronic device in the form of an application installation package, plug-in, etc., and executed by the processor of the electronic device to implement the message transmission method applied to the metaverse by the client and / or server.

[0112] Figure 12 Schematic diagram of the software structure of a terminal device according to an embodiment of the present invention. Taking the Android system as an example, in some embodiments, the Android system is divided into four layers: an application layer, an application framework layer (FWK), a system layer, and a hardware abstraction layer. The layers communicate with each other via software interfaces.

[0113] First, the application layer can include multiple application packages. The application packages can be various application apps such as calls, cameras, videos, navigation, weather, instant messaging, education, etc., or application apps based on AR technology.

[0114] Second, the application framework layer FWK provides an application programming interface (API) and programming framework for the applications in the application layer. The application framework layer may include some predefined functions, such as a function for receiving events sent by the application framework layer.

[0115] The application framework layer may include a window manager, a resource manager, and a notification manager, etc.

[0116] The window manager manages windowed applications. It can obtain the display size, determine whether a status bar is present, lock the screen, and take screenshots. The content provider stores and retrieves data and makes it accessible to applications. This data can include video, images, audio, incoming and outgoing calls, browsing history and bookmarks, and the phone book.

[0117] Among them, the resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc.

[0118] The Notification Manager allows applications to display notifications in the status bar. These messages can be displayed briefly and then disappear automatically without user interaction. For example, the Notification Manager is used to notify users of completed downloads, message reminders, and more. The Notification Manager can also display notifications in the form of icons or scrolling text in the system's top status bar, such as notifications from background applications, or in the form of dialog windows on the screen. Examples include displaying text messages in the status bar, sounding notifications, vibrating electronic devices, and flashing indicator lights.

[0119] The application framework layer also includes a view system, which includes visual controls, such as controls for displaying text and images. The view system can be used to build applications. A display interface can consist of one or more views. For example, the display interface of a text notification icon can include a view for displaying text and a view for displaying images.

[0120] Third, the system layer may include multiple functional modules, such as a sensor service module, a physical state recognition module, a three-dimensional graphics processing library (eg, OpenGL ES), and the like.

[0121] Among them, the sensor service module is used to monitor the sensor data uploaded by various sensors at the hardware layer and determine the physical state of the mobile phone; the physical state recognition module is used to analyze and recognize user gestures, faces, etc.; the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing, etc.

[0122] In addition, the system layer can also include a surface manager and a media library. The surface manager manages the display subsystem and provides fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of various common audio and video formats, as well as static image files.

[0123] Finally, the hardware abstraction layer is the layer between hardware and software. The hardware abstraction layer can include display drivers, camera drivers, sensor drivers, etc., which are used to drive the related hardware of the hardware layer, such as displays, cameras, sensors, etc.

[0124] Those skilled in the art will appreciate that the methods, steps, or functions of the related modules / units described in the embodiments of the present invention may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product, or it may be implemented by a processor executing computer program instructions. The computer program product includes at least one computer program instruction, which may be composed of corresponding software modules, which may be stored in RAM, flash memory, ROM, EPROM, EEPROM, registers, hard disks, removable hard disks, read-only compact discs (CD-ROMs), or any other form of storage medium known in the art. The computer program instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer program instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired or wireless method. The computer-readable storage medium may be any available medium accessible by a computer or a data storage device such as a server or data center that includes one or more available media integrated therein. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium, or a semiconductor medium (e.g., an SSD).

[0125] Regarding the various devices / products described in the above embodiments, the modules / units contained therein may be software modules / units, hardware modules / units, or may be partially software modules / units and partially hardware modules / units. For example, for a device / product applied to or integrated into a chip, the various modules / units contained therein may all be implemented in the form of hardware such as circuits, or at least some of the modules / units may be implemented in the form of software programs, running on a processor integrated within the chip, while the remaining modules / units may be implemented in the form of hardware such as circuits. For another example, for a device / product applied to or integrated into a terminal, the various modules / units contained therein may all be implemented in the form of hardware such as circuits, or at least some of the modules / units may be implemented in the form of software programs, running on a processor integrated within the terminal, while the remaining modules / units may be implemented in the form of hardware such as circuits.

[0126] The above description is only a specific embodiment of the present invention. Those skilled in the art will clearly understand that for the convenience and brevity of description, the specific working processes of the systems, modules and units described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. It should be understood that the protection scope of the present invention is not limited to this. Any person skilled in the art can easily think of various equivalent modifications or replacements within the technical scope disclosed by the present invention, and these modifications or replacements should be included in the protection scope of the present invention.

Claims

1. A message transmission method applied to the metaverse, characterized in that: Applied to terminal equipment, including: establishing a digital space overlapping with the real space and presenting the digital space through a display component of a terminal device; Obtaining spatial location information of the terminal device and subscribing to the current spatial channel and topic from the server, wherein the spatial range of the current spatial channel corresponds to the visible spatial range of the digital space presented, wherein, based on a set standard orientation, determining the angle between the terminal device and the standard orientation, and using the geographical coordinates of the current location of the terminal device and the angle between the terminal device and the standard orientation as the spatial location information of the terminal device; the spatial channel is the spatial range corresponding to the digital space presented to the user through the display component of the terminal device; and In response to receiving digital content that complies with the subscription theme in the subscription space channel pushed by the server, the digital content is superimposed into the digital space.

2. The message transmission method applied to the metaverse according to claim 1, characterized in that: The step of superimposing the digital content into the digital space includes: Extracting digital content data and location relationship data between the digital content and the space from the digital content pushed by the server; Determining an overlay position in the current digital space and an occlusion relationship between the digital content and the digital space based on a positional relationship between the digital content and the space; and The digital content is rendered at a determined overlay position according to the occlusion relationship between the digital content and the digital space.

3. The message transmission method applied to the metaverse according to claim 1, characterized in that: Further including: Before subscribing to the current spatial channel on the server, a subscription link is established with the server using the client ID.

4. The message transmission method applied to the metaverse according to claim 3 is characterized in that: Further including: Use the client ID to establish a publishing link with the server; as well as The digital content is published to the server via the publishing link.

5. The message transmission method applied to the metaverse according to claim 4 is characterized in that: The subscription link is a long link, and the publishing link is a long link or a short link.

6. The message transmission method applied to the metaverse according to claim 4, characterized in that: The client ID includes a service ID, and the service IDs of users in the same group are the same.

7. The message transmission method applied to the metaverse according to claim 1, characterized in that: When the spatial position of the terminal device is detected to have changed, the following steps are further included: Send a cancellation request to the server to cancel the original subscription space channel; and When the spatial position transformation of the terminal device is completed, a subscription request for subscribing to the current spatial channel is sent to the server.

8. A message transmission method applied to the metaverse, characterized in that: Applicable to servers, including: In response to receiving a subscription request for a spatial channel sent by a client, extracting spatial location information of the terminal device and subscription topic information from the subscription request; wherein, based on a set standard orientation, determining an angle between the terminal device and the standard orientation, and using the geographical coordinates of the terminal device's current location and the angle between the terminal device and the standard orientation as the spatial location information of the terminal device; the spatial channel is a spatial range corresponding to a digital space presented to the user via a display component of the terminal device; Determining a subscription spatial channel of the client terminal device based on the spatial position information, wherein the spatial range of the subscription spatial channel corresponds to the visual spatial range of the current digital space presented by the client terminal device; Pushing digital content that matches the subscription theme and is located in the subscription space channel to the client; and In response to receiving a subscription cancellation request for an original subscription space channel sent by a client, the digital content of the original subscription space channel is stopped from being pushed to the client.

9. The message transmission method applied to the metaverse according to claim 8, characterized in that: Further including: Traversing the spatial channels where the digital content that matches the subscription theme is located to determine the digital content that matches the subscription theme that is located in the subscription spatial channel; or traverse the digital resources in the subscription space channel and determine the digital content that meets the subscription theme and is located in the subscription space channel from the digital resources; and Extracting digital content data adapted to the channel angle and position relationship of the subscription space, as well as the superimposed position and occlusion relationship between the digital content and the space; Correspondingly, when the digital content that complies with the subscription theme and is located in the subscription space channel is pushed to the client, the pushed digital content includes digital content data that is adapted to the angle and position relationship of the subscription space channel and position relationship data containing the digital content and the spatial overlay position and occlusion relationship.

10. The message transmission method applied to the metaverse according to claim 8, characterized in that: When a subscription request for a spatial channel sent by a client is received, the method further includes: creating a subscription link ID for the client based on the client ID in the subscription request, creating a first ID mapping relationship between the client ID and the subscription link ID, and establishing a subscription link with the first client based on the first ID mapping relationship.

11. The message transmission method applied to the metaverse according to claim 10, characterized in that: Further including: When receiving a publishing request sent by a client, a publishing link ID is created for the client based on the client ID in the publishing request, and a second ID mapping relationship between the client ID and the publishing link ID is created, and a publishing link is established with the first client based on the second ID mapping relationship.

12. The message transmission method applied to the metaverse according to claim 11, characterized in that: The subscription link is a long link, and the publishing link is a long link or a short link. When the publishing link is a short link, after receiving the digital content published by the client, the publishing link with the client is disconnected.

13. The message transmission method applied to the metaverse according to claim 8, characterized in that: The steps of pushing digital content that matches the subscription theme and is located in the subscription space channel to the client include: Determine one or more clients subscribing to the spatial channel as target clients; Determine one or more target digital contents that meet the subscription theme in the subscription space channel and the source client that publishes the target digital content; Filtering out the source client that publishes the digital content from the target client; and Push the target digital content to the filtered target clients.

14. The message transmission method applied to the metaverse according to claim 8, characterized in that: Further including: When newly released digital content is detected, determining the spatial channel where the digital content is located; Determine the clients that subscribe to the spatial channel, and filter out the source clients that publish the digital content; as well as The digital content is pushed to the filtered clients that subscribe to the spatial channel.

15. The message transmission method applied to the metaverse according to claim 8, characterized in that: Further including: monitoring whether the location of digital content has changed; In response to a change in the location of the digital content, calculating in real time the relationship between the real-time location of the digital content and the location of the spatial channel subscribed by the client; In response to the real-time location of the digital content moving out of the subscription space channel of the client, stopping pushing the digital content data to the client; as well as In response to the real-time position of the digital content in the subscription space channel of the client, the digital content data adapted to the subscription space channel angle and position relationship and the superimposed position and occlusion relationship between the digital content and the space are extracted and pushed to the client.

16. A message transmission device applied to the metaverse, characterized in that: Applied to terminal equipment, including: a digital space creation module configured to establish a digital space overlapping with a real space and present the digital space through a display component of a terminal device; a subscription module configured to obtain spatial location information of a terminal device and subscribe to a current spatial channel and topic from a server; wherein the spatial range of the current spatial channel corresponds to the visible spatial range of the digital space presented, wherein based on a set standard orientation, the angle between the terminal device and the standard orientation is determined, and the geographical coordinates of the current location of the terminal device and the angle between the terminal device and the standard orientation are used as the spatial location information of the terminal device; the spatial channel is the spatial range corresponding to the digital space presented to the user via the display component of the terminal device; and The content fusion module is configured to respond to receiving digital content that complies with the subscription theme in the subscription space channel pushed by the server and superimpose the digital content into the digital space.

17. A message transmission device applied to the metaverse, characterized in that: Applicable to servers, including: a subscription processing module configured to, in response to receiving a subscription request for a spatial channel sent by a client, extract spatial location information of a terminal device from the subscription request, determine a subscription spatial channel for the client terminal device based on the spatial location information, wherein the spatial range of the subscription spatial channel corresponds to the visible spatial range of the current digital space presented by the client terminal device; and, in response to receiving a subscription cancellation request for an original subscription spatial channel sent by the client, cancel the corresponding original subscription spatial channel, wherein, based on a set standard orientation, the angle between the terminal device and the standard orientation is determined, and the geographical coordinates of the current location of the terminal device and the angle between the terminal device and the standard orientation are used as the spatial location information of the terminal device; the spatial channel is the spatial range corresponding to the digital space presented to the user through the display component of the terminal device; and The content push module is configured to push digital content that is in the subscription space channel and complies with the subscription theme to the client; and stop pushing digital content to the client corresponding to the cancelled subscription space channel.

18. A terminal device, characterized in that: The method comprises a processor and a memory storing computer program instructions, wherein when the processor executes the computer program instructions, the method for message transmission applied to the metaverse according to any one of claims 1 to 7 is implemented.

19. A server, characterized in that: include: a processor and a memory storing computer program instructions; When the processor executes the computer program instructions, the message transmission method applied to the metaverse according to any one of claims 8 to 15 is implemented.

20. A computer-readable storage medium, characterized in that The computer storage medium stores computer program instructions, which, when executed by a processor, implement the message transmission method applied to the metaverse according to any one of claims 1 to 15.

21. A computer program product, characterized in that It includes computer program instructions, which, when executed by a processor, implement the message transmission method applied to the metaverse as described in any one of claims 1 to 15.

Images