Mixed reality space configuration method and message information display method

Abstract

The embodiment of the invention discloses a mixed reality space configuration method and a message information display method. A specific embodiment of the method comprises the following steps: in response to detection of an information selection operation corresponding to a preset message extension plug-in information set, determining preset message extension plug-in information corresponding to the information selection operation in the preset message extension plug-in information set as target message extension plug-in information; determining a message element according to the target message extension plug-in information; and in response to the detected editing operation of the corresponding message element, performing message element configuration on the target mixed reality space, the target mixed reality space being a pre-constructed mixed reality space selected by the user and needing to add the message element. According to the embodiment, the interaction mode between the browsing user and the virtual space can be increased, and the viscidity of the browsing user is improved.

Description

Technical Field

[0001] The embodiments of the present disclosure relate to the field of mixed reality technology, and specifically to a mixed reality space configuration method and a message information display method. Background Art

[0002] Mixed reality (MR) space is a mixture of physical space (or real space) and digital space. It links digital space and physical space in some form. Users can browse the mixed reality space through mixed reality devices and observe the physical space and the digital content associated with it at the same time. Mixed reality space can be used in mixed reality guided tours (MR guided tours), for example, it can be applied to digital exhibition halls, and users can experience the combined virtual and real guided tour effect while visiting the exhibition hall.

[0003] However, in the existing MR guided tour process, browsing users can only browse the mixed reality space through mixed reality devices (such as MR glasses), and there are few ways for browsing users to interact with the virtual space, resulting in low browsing user stickiness. Currently, there is a lack of a dedicated method and tool to enable browsing users to leave messages in the mixed reality space.

[0004] The above information disclosed in this Background section is only for enhancement of understanding of the background of the inventive concept and therefore it may contain information that does not form the prior art that is already known in this country to a person of ordinary skill in the art. Summary of the invention

[0005] The content of this disclosure is used to introduce concepts in a brief form, which will be described in detail in the detailed implementation section below. The content of this disclosure is not intended to identify the key features or essential features of the technical solution claimed for protection, nor is it intended to limit the scope of the technical solution claimed for protection.

[0006] Some embodiments of the present disclosure propose a mixed reality space configuration method and a message information display method based on the mixed reality space to solve the technical problems mentioned in the above background technology part.

[0007] In a first aspect, some embodiments of the present disclosure provide a method for configuring a mixed reality space, the method comprising: in response to detecting an information selection operation corresponding to a preset message extension plug-in information set, determining the preset message extension plug-in information corresponding to the above information selection operation in the above preset message extension plug-in information set as the target message extension plug-in information; determining the message element according to the above target message extension plug-in information; in response to detecting an editing operation corresponding to the above message element, configuring the message element for the target mixed reality space, wherein the above target mixed reality space is a pre-built mixed reality space selected by the user to which the message element needs to be added.

[0008] Optionally, the preset message extension plug-in information in the preset message extension plug-in information set corresponds to a preset message board element; and determining the message element based on the target message extension plug-in information includes: determining the preset message board element corresponding to the target message extension plug-in information as the message element.

[0009] Optionally, the preset message extension plug-in information in the preset message extension plug-in information set corresponds to a preset message wall element; and determining the message element according to the target message extension plug-in information includes: determining the preset message wall element corresponding to the target message extension plug-in information as the message element.

[0010] Optionally, the method further includes: in response to detecting a publishing operation corresponding to the target mixed reality space, determining the publishing status of the target mixed reality space as published, wherein the published target mixed reality space is used for the mixed reality terminal to display a mixed reality scene.

[0011] Optionally, the method further includes: in response to detecting a jump operation corresponding to the message element, displaying a message editing interface for the user to leave a message.

[0012] Optionally, the message editing interface includes a message completion control; and the method further includes: in response to detecting a selection operation acting on the message completion control, updating the target mixed reality space according to the message information input by the user in the message editing interface, and obtaining an updated target mixed reality space as the target mixed reality space.

[0013] In a second aspect, some embodiments of the present disclosure provide a message information display method based on a mixed reality space, which is applied to a mixed reality end, wherein the mixed reality end includes a head-mounted display device, and the method includes: determining a target mixed reality scene, wherein the target mixed reality scene is a mixed reality scene browsed by a user and configured by a method as described in any implementation method of the first aspect, and the target mixed reality scene includes message elements pre-edited in the target mixed reality scene; in response to detecting target message information corresponding to the target mixed reality scene, displaying the target message information in the message element edited in the target mixed reality scene, wherein the target message information is the message information entered by the user in the message editing interface.

[0014] Optionally, the mixed reality end also includes a mobile device, which is connected to the head-mounted display device; and in response to detecting the target message information corresponding to the target mixed reality scene, before displaying the target message information in the message element edited in the target mixed reality scene, the method also includes: in response to detecting an input operation corresponding to the message editing interface included in the mobile device, determining the message information corresponding to the input operation as the target message information.

[0015] Optionally, displaying the target message information in the message element edited in the target mixed reality scene includes: determining message element style information; and displaying the target message information in the message element edited in the target mixed reality scene according to the message element style information.

[0016] Optionally, the message elements edited in the target mixed reality scene include message wall elements; and the determination of message element style information includes: determining the message wall style information of the message wall elements based on the detected target message information; and determining the message wall style information as the message element style information.

[0017] In a third aspect, some embodiments of the present disclosure provide a mixed reality terminal, comprising: a head-mounted display device for allowing a user to browse a mixed reality scene; the mixed reality terminal is configured to execute the method described in the second aspect.

[0018] In a fourth aspect, some embodiments of the present disclosure provide a computer-readable medium having a computer program stored thereon, wherein when the program is executed by a processor, the method described in any one of the implementations of the first and second aspects above is implemented.

[0019] The above-mentioned embodiments of the present disclosure have the following beneficial effects: through the mixed reality space configuration method of some embodiments of the present disclosure, the interaction mode between the browsing user and the virtual space can be increased, and the stickiness of the browsing user can be improved. Specifically, the reason why the browsing user has fewer ways to interact with the virtual space and the low stickiness of the browsing user is that in the existing MR navigation process, the browsing user can only browse the mixed reality space through the mixed reality device (for example: MR glasses), and the browsing user has fewer ways to interact with the virtual space, resulting in low stickiness of the browsing user. At present, there is still a lack of a dedicated method and tool to realize the operation of the browsing user leaving a message in the mixed reality space. Based on this, the mixed reality space configuration method of some embodiments of the present disclosure, first, in response to detecting the information selection operation corresponding to the preset message extension plug-in information set, the preset message extension plug-in information corresponding to the above information selection operation in the above preset message extension plug-in information set is determined as the target message extension plug-in information. Thus, the message extension plug-in information selected by the creating user can be obtained, so that it can be used to determine the message element. Secondly, according to the above target message extension plug-in information, the message element is determined. Thus, the message element can be determined, so that it can be used to configure to the mixed reality space. Finally, in response to detecting an editing operation corresponding to the above-mentioned message element, the target mixed reality space is configured with a message element. The above-mentioned target mixed reality space is a pre-built mixed reality space selected by the creation user to which a message element needs to be added. Thus, the message element can be added to the mixed reality space, so that the browsing user can leave a message in the mixed reality space, thereby increasing the interaction mode between the browsing user and the mixed reality space. Also, because the message element is configured in the mixed reality space when configuring the mixed reality space, the interaction mode between the browsing user and the virtual space is increased, thereby improving the stickiness of the browsing user. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that components and elements are not necessarily drawn to scale.

[0021] Figure 1 is a flow chart of some embodiments of a mixed reality space configuration method according to the present disclosure;

[0022] Figure 2 is a schematic diagram of an editing operation of a corresponding message element of a mixed reality space configuration method according to some embodiments of the present disclosure;

[0023] Figure 3 is a flowchart of some embodiments of the message information display method based on the mixed reality space according to the present disclosure;

[0024] Figure 4 It is an application scenario diagram of some embodiments of the message information display method based on mixed reality space according to the present disclosure;

[0025] Figure 5 is an application scenario diagram of other embodiments of the message information display method based on mixed reality space according to the present disclosure;

[0026] Figure 6 is a schematic diagram of the structure of some embodiments of the mixed reality terminal according to the present disclosure;

[0027] Figure 7 It is a schematic diagram of the structure of an electronic device suitable for implementing some embodiments of the present disclosure. DETAILED DESCRIPTION

[0028] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0029] It should also be noted that, for ease of description, only the parts related to the invention are shown in the drawings. In the absence of conflict, the embodiments and features in the embodiments of the present disclosure can be combined with each other.

[0030] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0031] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0032] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0033] With regard to the collection, storage, and use of user personal information (such as user information) involved in this disclosure, before performing the corresponding operations, the relevant organizations or individuals shall fulfill their obligations, including conducting personal information security impact assessments, fulfilling the obligation to inform the personal information subject, and obtaining the authorization and consent of the personal information subject in advance, as well as complying with the provisions of relevant laws and regulations.

[0034] The present disclosure will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments.

[0035] Figure 1 The process 100 of some embodiments of the mixed reality space configuration method according to the present disclosure is shown. The mixed reality space configuration method comprises the following steps:

[0036] Step 101, in response to detecting an information selection operation corresponding to a preset message extension plug-in information set, determining the preset message extension plug-in information corresponding to the information selection operation in the preset message extension plug-in information set as target message extension plug-in information.

[0037] In some embodiments, the execution subject (e.g., browser) of the mixed reality space configuration method may, in response to detecting an information selection operation corresponding to a preset message extension plug-in information set, determine the preset message extension plug-in information corresponding to the information selection operation in the preset message extension plug-in information set as the target message extension plug-in information. The preset message extension plug-in information in the preset message extension plug-in information set may be information of a preset message extension plug-in. The message extension plug-in may be an extension plug-in for realizing interaction of a browsing user's message. The browsing user may be a user browsing the mixed reality space. The preset message extension plug-in information in the preset message extension plug-in information set may include, but is not limited to, a message extension plug-in identifier. The message extension plug-in identifier may be a unique identifier of the message extension plug-in. Each preset message extension plug-in information in the preset message extension plug-in information set corresponds to a preset message board element and a preset message wall element. The preset message board element may be a preset message board element. The message board element may be a board-shaped element for a browsing user to leave a message. The preset message wall element may be a preset message wall element. The message wall element may be a wall-shaped element for a browsing user to leave a message. The message board element may be displayed in a message wall element. The message wall element may display at least one message. The information selection operation may be an operation for selecting preset message extension plug-in information for the creating user. The creating user may be a user who configures the mixed reality space. The information selection operation may include but is not limited to at least one of the following: click, hover, drag. The preset message extension plug-in information corresponding to the information selection operation may be the preset message extension plug-in information selected by the creating user.

[0038] Step 102, determining the message element according to the target message extension plug-in information.

[0039] In some embodiments, the execution subject may determine the message element according to the target message extension plug-in information. The message element may be an element for leaving a message. The message element may be used by the browsing user to leave a message in the mixed reality space. In practice, the execution subject may determine the preset message board element and the preset message wall element corresponding to the target message extension plug-in information as the message element.

[0040] Optionally, the preset message extension plug-in information in the preset message extension plug-in information set may correspond to a preset message board element.

[0041] In some optional implementations of some embodiments, the execution entity may determine a preset message board element corresponding to the target message extension plug-in information as the message element.

[0042] Optionally, the preset message extension plug-in information in the preset message extension plug-in information set may correspond to a preset message wall element.

[0043] In some other optional implementations of some embodiments, the execution entity may determine a preset message wall element corresponding to the target message extension plug-in information as the message element.

[0044] Step 103, in response to detecting an editing operation of a corresponding message element, configuring the message element in the target mixed reality space.

[0045] In some embodiments, the execution subject may configure the message element in the target mixed reality space in response to detecting the editing operation corresponding to the message element. Among them, the editing operation may be an operation of setting the style of the message element and placing the message element in the target mixed reality space. The editing operation may be, but is not limited to, at least one of the following: an element dragging operation, an element scaling operation, and an element rotation operation. The element dragging operation may be an operation of dragging the message element in the target mixed reality space to set the position of the message element in the target mixed reality space. The element scaling operation may be an operation for adjusting the size of the message element. The element rotation operation may be an operation for adjusting the angle of the message element. The target mixed reality space is a pre-built mixed reality space to which the user selects to add the message element. The mixed reality space may be a Mesh (triangular patch) map or a point cloud map constructed based on the real space. The mixed reality space may also be used to edit virtual elements. The virtual element may be a virtual element constructed by the user. In practice, the execution subject may determine the target mixed reality space after the message element is edited as a mixed reality scene. The mixed reality scene can be used as the target mixed reality space after the message element is configured, so as to be loaded into the head-mounted display device. In one or more embodiments, loading means loading the mixed reality scene into the running memory of the head-mounted display device so as to perform operations such as rendering, displaying, editing, and interacting with the mixed reality scene.

[0046] As an example, Figure 2 A schematic diagram showing the editing operation of the corresponding message element. Figure 2 The subject is a room in the target mixed reality space. The user can place the message board element 201 at a suitable position in the room and operate the message board element using operations such as moving, rotating, and scaling provided by the graphical user interface.

[0047] Optionally, the execution subject may determine the publishing status of the target mixed reality space as published in response to detecting a publishing operation corresponding to the target mixed reality space. The published target mixed reality space is used for the mixed reality terminal to display the mixed reality scene. The publishing operation may be a selection operation acting on a publishing control. Thus, the creating user may publish the target mixed reality space by himself.

[0048] Optionally, the execution subject may, in response to detecting a jump operation corresponding to the message element, display a message editing interface for creating a user message. The jump operation may be a selection operation acting on a jump control. The jump control may be a control for jumping to a message editing interface. The message editing interface may be an interface for editing a message. Thus, the creating user may jump from the configuration interface to the message interface to leave a message.

[0049] Optionally, the message editing interface may include a message completion control, wherein the message completion control may be a control for indicating that the user who created the message has completed the message.

[0050] Optionally, the above-mentioned execution subject may respond to the detection of the selection operation acting on the above-mentioned message completion control, and update the above-mentioned target mixed reality space according to the message information input by the user in the above-mentioned message editing interface, and obtain the updated target mixed reality space as the target mixed reality space. Among them, the above-mentioned message information may be the information input by the creating user in the above-mentioned message editing interface. In practice, the above-mentioned execution subject may respond to the detection of the selection operation acting on the above-mentioned message completion control, and display the message information input by the creating user in the above-mentioned message editing interface in the message element included in the above-mentioned target mixed reality space, and obtain the updated target mixed reality space as the target mixed reality space. Thus, after the creating user completes the message, the information after the message can be updated in the target mixed reality space.

[0051] The above-mentioned embodiments of the present disclosure have the following beneficial effects: through the mixed reality space configuration method of some embodiments of the present disclosure, the interaction mode between the browsing user and the virtual space can be increased, and the stickiness of the browsing user can be improved. Specifically, the reason why the browsing user has fewer ways to interact with the virtual space and the low stickiness of the browsing user is that in the existing MR navigation process, the browsing user can only browse the mixed reality space through the mixed reality device (for example: MR glasses), and the browsing user has fewer ways to interact with the virtual space, resulting in low stickiness of the browsing user. At present, there is still a lack of a dedicated method and tool to realize the operation of the browsing user leaving a message in the mixed reality space. Based on this, the mixed reality space configuration method of some embodiments of the present disclosure, first, in response to detecting the information selection operation corresponding to the preset message extension plug-in information set, the preset message extension plug-in information corresponding to the above information selection operation in the above preset message extension plug-in information set is determined as the target message extension plug-in information. Thus, the message extension plug-in information selected by the creating user can be obtained, so that it can be used to determine the message element. Secondly, according to the above target message extension plug-in information, the message element is determined. Thus, the message element can be determined, so that it can be used to configure to the mixed reality space. Finally, in response to detecting an editing operation corresponding to the above-mentioned message element, the message element is configured for the target mixed reality space. Among them, the above-mentioned target mixed reality space is a pre-built mixed reality space selected by the creation user to which the message element needs to be added. Thus, the message element can be added to the mixed reality space, so that the browsing user can leave a message in the mixed reality space, thereby increasing the interaction mode between the browsing user and the mixed reality space. Also, because the message element is configured in the mixed reality space when configuring the mixed reality space, the interaction mode between the browsing user and the mixed reality space is increased, thereby, the stickiness of the browsing user can be improved.

[0052] Further references Figure 3 , which shows a process 300 of some embodiments of a message information display method based on a mixed reality space. The process 300 of the message information display method based on a mixed reality space includes the following steps:

[0053] Step 301, determine the target mixed reality scene.

[0054] In some embodiments, the execution subject (e.g., mixed reality terminal) of the message information display method based on the mixed reality space can determine the target mixed reality scene. The target mixed reality scene can be the currently logged-in user browsing the Figure 1The steps in the corresponding embodiments are configured. The above-mentioned target mixed reality scene includes a message element pre-edited in the above-mentioned target mixed reality scene. The mixed reality end may be a device for loading mixed reality scenes. The above-mentioned mixed reality end may include a head-mounted display device. The head-mounted display device may be used to load mixed reality scenes. For example, the head-mounted display device may be MR glasses. The above-mentioned logged-in user may be a user wearing the head-mounted display device included in the above-mentioned mixed reality end. In practice, first, the above-mentioned execution subject may obtain a mixed reality scene set.

[0055] As an example, the above-mentioned execution subject can obtain various mixed reality scenes corresponding to the currently logged-in user as a mixed reality scene set. The various mixed reality scenes corresponding to the currently logged-in user can be various mixed reality scenes previously configured by the currently logged-in user. The various mixed reality scenes corresponding to the currently logged-in user can also be various mixed reality scenes that the currently logged-in user can access.

[0056] As another example, the execution subject may also obtain various mixed reality scenes corresponding to the location information of the mixed reality terminal as a mixed reality scene set. The various mixed reality scenes corresponding to the location information of the mixed reality terminal may be various mixed reality scenes edited and published by the creating user that can be matched at the location corresponding to the location information.

[0057] Then, in response to detecting a selection operation corresponding to a mixed reality scene in the mixed reality scene set, the mixed reality scene corresponding to the selection operation in the mixed reality scene set is determined as a target mixed reality scene. The selection operation may include but is not limited to at least one of the following: click, slide, voice control, gesture control, head posture control. The mixed reality scene corresponding to the selection operation may be a mixed reality scene selected by the currently logged-in user.

[0058] Optionally, the above-mentioned execution subject may also determine the mixed reality scene corresponding to the real space captured by the camera in the above-mentioned mixed reality scene set as the target mixed reality scene in response to the real space captured by the camera of the above-mentioned mixed reality terminal satisfying the preset spatial condition. Among them, the above-mentioned preset spatial condition may be: the real space captured by the camera corresponds to any mixed reality scene in the above-mentioned mixed reality scene set. Corresponding to any mixed reality scene may be: the image captured by the above-mentioned camera matches the preset image of the real space corresponding to any mixed reality scene. The above-mentioned preset image may be a preset image of the corresponding real space. The above-mentioned matching with the preset image may be: the similarity between the image captured by the camera and the preset image is greater than or equal to the preset similarity. The above-mentioned preset similarity may be a preset similarity that characterizes that the two images are the same. In practice, the above-mentioned execution subject may determine the similarity between the image captured by the camera and the preset image by a preset similarity algorithm. Among them, the above-mentioned preset similarity algorithm may be but not limited to a cosine similarity algorithm.

[0059] Step 302, in response to detecting the target message information corresponding to the target mixed reality scene, displaying the target message information in the message element edited in the target mixed reality scene.

[0060] In some embodiments, the above-mentioned execution subject may, in response to detecting the target message information corresponding to the above-mentioned target mixed reality scene, display the above-mentioned target message information in the message element edited in the above-mentioned target mixed reality scene. Among them, the above-mentioned target message information may be the message information input by the user in the message editing interface. The above-mentioned message editing interface may be an interface displayed in the virtual space of the head-mounted display device. In practice, the above-mentioned execution subject may, in response to detecting the target message information corresponding to the above-mentioned target mixed reality scene, display the above-mentioned target message information in the message element edited in the above-mentioned target mixed reality scene according to the preset style of the message element edited in the above-mentioned target mixed reality scene. Among them, the above-mentioned preset style may be a pre-set style of the message element.

[0061] Optionally, the mixed reality terminal may further include a mobile device. The mobile device is connected to the head-mounted display device. The mobile device may be, but is not limited to, a mobile phone or a tablet computer. The mobile device is connected to the head-mounted display device. The connection between the mobile device and the head-mounted display device may be a wired connection or a wireless connection.

[0062] Optionally, before step 302, the execution subject may, in response to detecting an input operation corresponding to the message editing interface included in the mobile device, determine the message information corresponding to the input operation as the target message information. The input operation may be an operation of a logged-in user inputting message information.

[0063] In some optional implementations of some embodiments, the execution subject may display the target message information in the message element edited in the target mixed reality scene through the following steps:

[0064] The first step is to determine the message element style information. Among them, the message element style information may be the information of the style of the corresponding message element. The message element style information may include but is not limited to the message element color, message element size, and message element layout. The message element color may be the color of the message element. The message element size may be the size of the message element. The message element layout may be the layout of the message element. As an example, the message elements edited in the target mixed reality scene include message board elements, and the execution entity may determine the style of the message board element preset by the creation user as the message element style information.

[0065] As another example, the message elements edited in the target mixed reality scene include message wall elements, and the execution entity may determine the style of the message wall element preset by the creating user as the message element style information.

[0066] The second step is to display the target message information in the message element edited in the target mixed reality scene according to the message element style information. In practice, the execution subject can display the target message information in the message element edited in the target mixed reality scene according to the style corresponding to the message element style information.

[0067] Optionally, the execution subject may determine the message element style information through the following steps:

[0068] Step 1: Obtain login user information. The login user information may be information of the login user. The login user information may include but is not limited to a login user identifier. The login user identifier may be a unique identifier of the login user. In practice, the execution subject may obtain the login user information from a database via a wired connection or a wireless connection.

[0069] Step 2: Determine the message element style information according to the above-mentioned logged-in user information. In practice, the above-mentioned execution subject may determine the preset message element style information corresponding to the above-mentioned logged-in user information as the message element style information. Among them, the above-mentioned preset message element style information may be a pre-set message element style information.

[0070] Therefore, different logged-in users can personalize the message element styles, thereby improving the user experience.

[0071] Optionally, the execution subject may determine the message element style information through the following steps:

[0072] Step 1, obtaining the editing user information. The editing user information may be the information of the editing user. The editing user may be a user who edits the target message information. The editing user information may include but is not limited to the editing user identifier. The editing user identifier may be a unique identifier of the editing user. In practice, the execution subject may obtain the editing user information from the database through a wired connection or a wireless connection.

[0073] Step 2: Determine the message element style information according to the editing user information. In practice, the execution subject may determine the preset message element style information corresponding to the editing user information as the message element style information.

[0074] Therefore, different editing users can personalize the message element styles, thereby improving the user experience.

[0075] Optionally, the message element edited in the above-mentioned target mixed reality scene may include a message wall element.

[0076] In some optional implementations of some embodiments, the execution subject may determine the message element style information through the following steps:

[0077] Step 1: Determine the message wall style information of the message wall element according to each target message information that has been detected. In practice, first, the execution entity may determine the number of each target message information that has been detected as the number of messages. Then, the preset message wall style information corresponding to the number of messages is determined as the message wall style information of the message wall element. Among them, the preset message wall style information may be information of a style of a preset message wall element. Each preset message wall style information corresponds to a preset message number range. The preset message number range may be a preset message number range. The preset message wall style information corresponding to the message number may be: the preset message wall style information corresponding to the preset message number range in which the message number is located.

[0078] Step 2: determine the message wall style information as the message element style information.

[0079] As an example, when the number of messages is 3, the corresponding preset message number range is [1, 6], and the corresponding preset message wall style information includes a message wall layout of flat style. The target message information 403 seen by the logged-in user in the message wall element 402 is as follows: Figure 4 The message wall element 402 may be pre-edited by the creating user in the target mixed reality scene 401. The target message information 403 may be message information edited by the editing user.

[0080] As another example, when the number of messages is 16, the preset message number range is (6, 20], and the corresponding preset message wall style information includes a message wall format of a three-dimensional ring. The target message information 403 seen by the logged-in user in the message wall element 402 is as follows: Figure 5 shown.

[0081] In this way, the message wall style can be dynamically adjusted according to the number of messages, thereby improving the user experience.

[0082] Optionally, the above execution entity may further perform the following steps:

[0083] The first step is, in response to detecting a selection operation corresponding to any target message information displayed in the above-mentioned target mixed reality scene, obtaining the target editing user information and the target login user information corresponding to the above-mentioned arbitrary target message information. Among them, the above-mentioned target editing user information can be the editing user information corresponding to the editing user who edits the arbitrary target message information. The above-mentioned target login user information can be the login user information corresponding to the login user. In practice, the above-mentioned execution subject can obtain the target editing user information and the target login user information corresponding to the above-mentioned arbitrary target message information from the database through a wired connection or a wireless connection in response to detecting a selection operation corresponding to any target message information displayed in the above-mentioned target mixed reality scene.

[0084] In the second step, in response to determining that the target editing user information matches the target login user information, the message editing interface is displayed for the user to change any of the target message information. In practice, the execution subject may display the message editing interface in the virtual space displayed by the head mounted display device for the login user to change any of the target message information in response to determining that the editing user identifier included in the target editing user information is the same as the login user identifier included in the target login user information.

[0085] In this way, the security of other users' message information can be ensured while making it easier for the logged-in user to change the message information.

[0086] The above-mentioned various embodiments of the present disclosure have the following beneficial effects: through the message information display method based on the mixed reality space of some embodiments of the present disclosure, the interaction methods between the logged-in users and the virtual space can be increased, and the stickiness of the logged-in users can be improved. Specifically, the reason why the logged-in users have fewer ways to interact with the virtual space and the low stickiness of the logged-in users is that in the existing MR navigation process, the logged-in users can only browse the mixed reality space through mixed reality devices (for example: MR glasses), and the logged-in users have fewer ways to interact with the virtual space, resulting in low stickiness of the logged-in users. At present, there is still a lack of a dedicated method and tool to implement the operation of logged-in users leaving messages in the mixed reality space. Based on this, the message information display method based on the mixed reality space of some embodiments of the present disclosure, first, determines the target mixed reality scene. Among them, the above-mentioned target mixed reality scene can be the scene browsed by the logged-in user through Figure 1 The steps in the corresponding embodiments are configured. Thus, a mixed reality scene browsed by the logged-in user can be obtained, so that it is convenient for the logged-in user to leave messages and interact in the mixed reality scene. Then, in response to detecting the target message information corresponding to the above-mentioned target mixed reality scene, the above-mentioned target message information is displayed in the message element edited by the above-mentioned target mixed reality scene. Among them, the above-mentioned target message information can be the message information entered by the logged-in user in the message editing interface. Thus, when the message information entered by the logged-in user is detected, the message information entered by the logged-in user can be displayed in the mixed reality scene, so that the operation of the logged-in user leaving messages in the mixed reality space can be realized. Also because the logged-in user can realize the operation of leaving messages in the mixed reality space through the mixed reality device, the interaction mode between the logged-in user and the virtual space is increased. Thus, the stickiness of the logged-in user can be improved.

[0087] Figure 6 A mixed reality terminal 600 suitable for implementing some embodiments of the present disclosure is shown. The mixed reality terminal includes a head mounted display device 601. The head mounted display device 601 is used for allowing a user to browse a mixed reality scene. The mixed reality terminal is configured to execute Figure 3 The steps in the corresponding embodiments.

[0088] Optionally, the mixed reality end may further include a mobile device 602. The mobile device 602 may be a mobile phone or a tablet computer. The mobile device 602 is connected to the head-mounted display device 601. Here, the connection between the mobile device 602 and the head-mounted display device 601 may be a wired connection or a wireless connection. In some embodiments, both the head-mounted display device 601 and the mobile device 602 may include a processor. In some optional implementations of some embodiments, the head-mounted display device 601 may be used as an external display device of the mobile device 602 and does not have data processing capabilities.

[0089] The above-mentioned various embodiments of the present disclosure have the following beneficial effects: through the mixed reality terminal of some embodiments of the present disclosure, the logged-in user can implement the interactive operation of leaving a message in the mixed reality space, thereby increasing the interaction mode between the logged-in user and the virtual space, thereby increasing the stickiness of the logged-in user.

[0090] Reference below Figure 7 , which shows a structural diagram of an electronic device 700 (such as a browser side or a mixed reality side) suitable for implementing some embodiments of the present disclosure. Figure 7 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0091] like Figure 7 As shown, the electronic device 700 may include a processing device 701 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage device 708 into a random access memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the electronic device 700 are also stored. The processing device 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0092] Typically, the following devices may be connected to the I / O interface 705: an input device 706 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 707 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; and a communication device 709. The communication device 709 may allow the electronic device 700 to communicate with other devices wirelessly or by wire to exchange data. Figure 7 The electronic device 700 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead. Figure 7 Each block shown in the figure may represent one device, or may represent multiple devices as required.

[0093] In particular, according to some embodiments of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, some embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In some such embodiments, the computer program can be downloaded and installed from the network through the communication device 709, or installed from the storage device 708, or installed from the ROM 702. When the computer program is executed by the processing device 701, the above-mentioned functions defined in the method of some embodiments of the present disclosure are executed.

[0094] It should be noted that the computer-readable medium recorded in some embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In some embodiments of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0095] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0096] The computer-readable medium may be included in the electronic device; or it may exist independently without being installed in the electronic device. The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device and the electronic device is a browser, the electronic device: in response to detecting an information selection operation corresponding to a preset message extension plug-in information set, determines the preset message extension plug-in information corresponding to the information selection operation in the preset message extension plug-in information set as the target message extension plug-in information; determines the message element according to the target message extension plug-in information; in response to detecting an editing operation corresponding to the message element, configures the message element for the target mixed reality space, wherein the target mixed reality space is a pre-constructed mixed reality space selected by the user to which the message element needs to be added. When the above-mentioned one or more programs are executed by the electronic device and the electronic device is a mixed reality terminal, the electronic device: determines a target mixed reality scene, wherein the above-mentioned target mixed reality scene is a mixed reality scene browsed by a user and configured by the method described in any implementation method of the above-mentioned first aspect, and the above-mentioned target mixed reality scene includes a message element pre-edited in the above-mentioned target mixed reality scene; in response to detecting the target message information corresponding to the above-mentioned target mixed reality scene, displays the above-mentioned target message information in the message element edited in the above-mentioned target mixed reality scene, wherein the above-mentioned target message information is the message information input by the user in the message editing interface.

[0097] Computer program code for performing the operations of some embodiments of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0098] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0099] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0100] The above descriptions are only some preferred embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by a specific combination of the above-mentioned technical features, but should also cover other technical solutions formed by any combination of the above-mentioned technical features or their equivalent features without departing from the above-mentioned inventive concept. For example, the above-mentioned features are replaced with the technical features with similar functions disclosed in the embodiments of the present disclosure (but not limited to) and the technical solutions formed.

Claims

1. A mixed reality space configuration method, comprising: In response to detecting an information selection operation corresponding to a preset message extension plug-in information set, determining the preset message extension plug-in information corresponding to the information selection operation in the preset message extension plug-in information set as the target message extension plug-in information; Determine the message element according to the target message extension plug-in information; In response to detecting an editing operation corresponding to the message element, the message element is configured in a target mixed reality space, wherein the target mixed reality space is a pre-built mixed reality space selected by the user to which the message element needs to be added.

2. The method according to claim 1, wherein: The preset message extension plug-in information in the preset message extension plug-in information set corresponds to a preset message board element; as well as The step of determining the message element according to the target message extension plug-in information includes: The preset message board element corresponding to the target message extension plug-in information is determined as the message element.

3. The method according to claim 1, wherein: The preset message extension plug-in information in the preset message extension plug-in information set corresponds to a preset message wall element; as well as The step of determining the message element according to the target message extension plug-in information includes: The preset message wall element corresponding to the target message extension plug-in information is determined as the message element.

4. The method according to claim 1, wherein: The method further comprises: In response to detecting a publishing operation corresponding to the target mixed reality space, determining the publishing status of the target mixed reality space as published, wherein the published target mixed reality space is used for the mixed reality terminal to display a mixed reality scene.

5. The method according to claim 1, wherein: The method further comprises: In response to detecting a jump operation corresponding to the message element, a message editing interface is displayed for the user to leave a message.

6. The method according to claim 5, wherein: The message editing interface includes a message completion control; as well as The method further comprises: In response to detecting a selection operation acting on the message completion control, the target mixed reality space is updated according to the message information input by the user in the message editing interface to obtain an updated target mixed reality space as the target mixed reality space.

7. A message information display method based on a mixed reality space, applied to a mixed reality terminal, the mixed reality terminal including a head-mounted display device, the method comprising: Determine a target mixed reality scene, wherein the target mixed reality scene is a mixed reality scene configured by the method according to any one of claims 1 to 6 and browsed by a user, and the target mixed reality scene includes a message element pre-edited in the target mixed reality scene; In response to detecting the target message information corresponding to the target mixed reality scene, the target message information is displayed in the message element edited in the target mixed reality scene, wherein the target message information is the message information input by the user in the message editing interface.

8. The method according to claim 7, wherein: The mixed reality end also includes a mobile device, and the mobile device is connected to the head mounted display device; and In response to detecting the target message information corresponding to the target mixed reality scene, before displaying the target message information in the message element edited in the target mixed reality scene, the method further includes: In response to detecting an input operation corresponding to a message editing interface included in the mobile device, the message information corresponding to the input operation is determined as target message information.

9. The method according to claim 7, wherein: The displaying the target message information in the message element edited in the target mixed reality scene includes: Determine the message element style information; According to the message element style information, the target message information is displayed in the message element edited in the target mixed reality scene.

10. The method according to claim 9, wherein: The message elements edited in the target mixed reality scene include message wall elements; as well as The step of determining the message element style information includes: Determining message wall style information of the message wall element according to each target message information that has been detected; The message wall style information is determined as message element style information.

Images