Article model display method and device, head-mounted display equipment, storage medium and program product

Abstract

The embodiment of the invention discloses an article model display method and device, head-mounted display equipment, a storage medium and a program product. The method is applied to a client, the client is deployed on a head-mounted display device, the head-mounted display device comprises a display screen, and the method comprises the following steps: displaying a scene space where a wearer of the head-mounted display device is located on the display screen; in response to the first article selection operation, displaying a first article model of the selected first article in the scene space; and in response to a second article selection operation, displaying a second article model of a selected second article in the scene space in which the first article model is displayed. According to the technical scheme provided by the embodiment of the invention, a higher degree of freedom can be provided for a user in the aspect of article model matching, and free matching is realized.

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of human-computer interaction technology, and in particular to an object model display method, device, head-mounted display device, storage medium and program product. Background Art

[0002] At present, in Mixed Reality (MR) devices, some applications (Application, app) have placed virtual object models in space to support users to view the object models, or the matching effect of the objects represented by the object models and the space.

[0003] In the process of realizing the present invention, the inventors found that the following technical problems exist in the prior art: currently, the degree of freedom given to users in matching is not high, resulting in the inability of users to freely match, which needs to be solved urgently. Summary of the invention

[0004] The embodiments of the present invention provide an object model display method, apparatus, head-mounted display device, storage medium and program product to give users a higher degree of freedom in matching and achieve free matching.

[0005] According to one aspect of the present invention, there is provided an object model display method, which is applied to a client, and the client is deployed on a head-mounted display device, and the head-mounted display device includes a display screen. The method includes:

[0006] Displaying, on a display screen, a scene space in which a wearer of the head mounted display device is located;

[0007] In response to a first object selection operation, displaying a first object model of the selected first object in the scene space;

[0008] In response to the second object selection operation, a second object model of the selected second object is displayed in the scene space where the first object model is displayed.

[0009] According to another aspect of the present invention, there is provided an object model display device, which is configured on a client, and the client is deployed on a head-mounted display device, and the head-mounted display device includes a display screen. The device includes:

[0010] A scene space display module, used to display the scene space where the wearer of the head mounted display device is located on the display screen;

[0011] A first object model display module, configured to display a first object model of the selected first object in the scene space in response to a first object selection operation;

[0012] The second object model display module is used to display a second object model of the selected second object in the scene space where the first object model is displayed in response to the second object selection operation.

[0013] According to another aspect of the present invention, a head mounted display device is provided, which may include:

[0014] Display screen;

[0015] at least one processor; and

[0016] a memory communicatively connected to at least one processor; wherein,

[0017] The memory stores a computer program that can be executed by at least one processor. The computer program is executed by at least one processor so that the at least one processor implements the object model display method provided by any embodiment of the present invention when executing the computer program.

[0018] According to another aspect of the present invention, a computer-readable storage medium is provided, on which computer instructions are stored, and the computer instructions are used to enable a processor to implement the object model display method provided by any embodiment of the present invention when executed.

[0019] According to another aspect of the present invention, a computer program product is provided, on which a computer program is stored. When the computer program is executed by a processor, the object model display method provided by any embodiment of the present invention is implemented.

[0020] The object model display method described in the embodiment of the present invention is applied to a client, which is deployed on a head-mounted display device, which includes a display screen, and the client displays the scene space where the wearer of the head-mounted display device is located on the display screen; further, when the user selects the first object, the client can respond to the first object selection operation and display the first object model of the first object in the scene space to support the user to place the first object model in the scene space; further, when the user selects the second object, the client can respond to the second object selection operation and display the first object model and the second object model of the second object in the scene space at the same time to support the user to place the first object model and / or the second object model in the scene space to achieve the matching of the two object models with the scene space. The above technical solution not only supports the user to match a single object model with the scene space, but also supports the user to match two or at least two object models with the scene space, thereby giving the user a higher degree of freedom in matching, realizing the free selection of object models, and further realizing the free matching between at least two object models and between at least two object models and the scene space.

[0021] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0023] Figure 1 is a flow chart of an item model display method provided according to an embodiment of the present invention;

[0024] Figure 2a This is a schematic diagram of an effect of an object model display method provided by an embodiment of the present invention;

[0025] Figure 2b is another schematic diagram of an effect of an object model display method provided by an embodiment of the present invention;

[0026] Figure 2c is another effect schematic diagram of an object model display method provided by an embodiment of the present invention;

[0027] Figure 3 is a flow chart of another object model display method provided according to an embodiment of the present invention;

[0028] Figure 4 is a flowchart of an example of placing multiple items in another item model display method provided according to an embodiment of the present invention;

[0029] Figure 5 is a flow chart of another object model display method provided according to an embodiment of the present invention;

[0030] Figure 6 is a flow chart of another object model display method provided according to an embodiment of the present invention;

[0031] Figure 7 is a flowchart of another object model display method provided according to an embodiment of the present invention;

[0032] Figure 8 is a structural block diagram of an object model display device provided according to an embodiment of the present invention;

[0033] Fig. 9 It is a structural schematic diagram of a head mounted display device for implementing the object model display method in an embodiment of the present invention. DETAILED DESCRIPTION

[0034] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0035] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. The situations of "target", "original", etc. are similar and will not be repeated here. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0036] It should be noted that the collection, collection, updating, analysis, processing, use, transmission, storage and other aspects of user personal information involved in the technical solution of the present invention are in compliance with the provisions of relevant laws and regulations, are used for legitimate purposes, and do not violate public order and good morals. Necessary measures are taken for user personal information to prevent illegal access to user personal information data and maintain the security of user personal information and network security.

[0037] Figure 1 It is a flow chart of an object model display method provided by an embodiment of the present invention. This embodiment can be applied to displaying object models corresponding to at least two objects selected by a user in a scene space, so as to support the user to freely match at least two object models in the scene space. The method can be executed by an object model display device provided by an embodiment of the present invention, and the device can be implemented by software and / or hardware. The device can be configured on a client, and the client can be deployed on a head-mounted display device, and the head-mounted display device includes a display screen. The head-mounted display device can be, for example, an MR head-mounted display device.

[0038] See also Figure 1 The method of the embodiment of the present invention specifically includes the following steps:

[0039] S110: Displaying the scene space where the wearer of the head mounted display device is located on the display screen.

[0040] Among them, the wearer can be understood as a user wearing a head-mounted display device. The scene space can represent the surrounding space environment of the scene where the user is currently located. Exemplarily, the scene space can be a real space (i.e., a real space or a physical space) or a virtual space. This is related to the actual situation and is not specifically limited here. In particular, for the virtual space, it can be automatically generated through the space parameters input by the user. For example, the house has not been delivered yet, and the user cannot be in the house, but there is a sample map of the house. Then, the virtual space corresponding to the house can be generated according to the sample map; it can also be generated by processing the real space where the user is located. For example, if the user plans to repurchase a sofa for a living room that already has a sofa, a virtual space can be generated for the living room, and the sofa has been erased in the virtual space; and so on, which are not specifically limited here.

[0041] The scene space is displayed on a display screen so that the user can browse the surrounding space environment that the user is currently in through the display screen. In combination with the application scenarios that may be involved in the embodiments of the present invention, for example, taking a client as a shopping app as an example, when the user starts the shopping app, the shopping app can open the immersive space (ImmersiveSpace) provided by the head-mounted display device, and render the spatial data (space data) representing the scene space collected by the head-mounted display device to the immersive space, so that the scene space is displayed on the display screen of the head-mounted display device.

[0042] S120 . In response to the first object selection operation, display a first object model of the selected first object in the scene space.

[0043] The first item selection operation can be understood as an operation for selecting the first item. Exemplarily, a first item collection page can be displayed in the scene space, and the first item selection operation can be an input for the first item collection page, indicating an operation for selecting the first item among one or more items represented by the first item collection page. The first item model can be understood as a model that simulates the appearance of the first item, that is, the appearance of the first item, such as type, color or shape, can be determined through the first item model.

[0044] In response to the first object selection operation, the first object model is displayed in the scene space. In combination with the application scenarios that may be involved in the embodiments of the present invention, optionally, an initial display position may be pre-set in the scene space, and then after receiving the first object selection operation, the first object model may be placed at the initial display position and displayed. On this basis, further, in response to the placement operation input for the first object model, the display position after placement in the scene space may be obtained, and then the first object model may be displayed at the display position after placement, so as to support the user to place the first object model in the scene space. In the embodiment of the present invention, the placement operation may also be referred to as an interactive operation, and the interactive operation may be at least one of a moving operation, a rotating operation, and a scaling operation.

[0045] In combination with the application scenarios that may be involved in the embodiments of the present invention, continuing with the above example, illustratively, after the user clicks on the first item in the first item collection page displayed by the shopping app, the shopping app can load the reality view (RealityView) provided by the head-mounted display device, and then use RealityView to load the model data (model data) of the first item model to render the first item model into the immersive space, so that the first item model is displayed on the display screen of the head-mounted display device.

[0046] For example, here we take the first object model as a sofa model. Figure 2a The effect diagram of displaying the sofa model 2 in the scene space 1 is shown as an example.

[0047] S130 . In response to the second object selection operation, display a second object model of the selected second object in the scene space where the first object model is displayed.

[0048] The second item selection operation is similar to the first item selection operation and will not be described in detail here.

[0049] The second item is similar to the first item, and will not be described in detail here. It should be noted that the two items can be the same or different items, which is related to the actual situation and is not specifically limited here. For example, if the user pre-purchases 2 identical dining chairs, the two items are the same items; for another example, if the user pre-purchases 1 sofa and 1 table, the two items are different items.

[0050] The second item model is similar to the first item model and will not be described in detail here.

[0051] After selecting the first item, the user can select the second item again. In response to the second item selection operation, a second item model of the second item is displayed in the scene space where the first item model is displayed, that is, the first item model and the second item model are displayed simultaneously in the scene space to support the user to independently match the two item models in the scene space.

[0052] For example, here we take the second object model as an example, Figure 2c The effect diagram showing the sofa model 2 and the side table model 3 in the scene space 1 is shown as an example.

[0053] The object model display method described in the embodiment of the present invention is applied to a client, which is deployed on a head-mounted display device, which includes a display screen, and the client displays the scene space where the wearer of the head-mounted display device is located on the display screen; further, when the user selects the first object, the client can respond to the first object selection operation and display the first object model of the first object in the scene space to support the user to place the first object model in the scene space; further, when the user selects the second object, the client can respond to the second object selection operation and display the first object model and the second object model of the second object in the scene space at the same time to support the user to place the first object model and / or the second object model in the scene space to achieve the matching of the two object models with the scene space. The above technical solution not only supports the user to match a single object model with the scene space, but also supports the user to match two or at least two object models with the scene space, thereby giving the user a higher degree of freedom in matching, realizing the free selection of object models, and further realizing the free matching between at least two object models and between at least two object models and the scene space.

[0054] On this basis, an optional technical solution is that after responding to the first item selection operation, the item model display method further includes:

[0055] In the scene space, display the item collection page to open the control;

[0056] In response to a trigger operation of inputting an open control for an item collection page, displaying a collocation item collection page in the scene space, wherein the items represented in the collocation item collection page are items that can be placed in the scene space in combination with the first item;

[0057] In response to the second object selection operation, displaying a second object model of the selected second object in the scene space where the first object model is displayed, including:

[0058] In response to a third item selection operation inputted for the collocation item collection page, for a second item selected from the collocation item collection page, a second item model of the second item is displayed in the scene space where the first item model is displayed.

[0059] Among them, the item collection page opening control can be understood as a control for opening a certain item collection page, and in particular can be understood as a control for opening the item collection page where items that can be placed in the scene space together with the most recently selected item are located. In this technical solution, the most recently selected item is the first item.

[0060] After the user selects the first item from the first item collection page, the first item model and the item collection page opening control can be displayed in the scene space. On this basis, further, in response to the trigger operation input for the item collection page opening control, the item collection page opening control is enabled to open and display the matching item collection page in the scene space. The items represented in the matching item collection page can be understood as items that can be placed in the scene space with the first item. In this way, the user is supported to select the second item that can be placed in the scene space with the first item from the matching item collection page, and the second item model of the second item is displayed in the scene space at the same time as the first item model for matching.

[0061] The above technical solution, by displaying an item collection page opening control in the scene space, can support the user to obtain a matching item collection page containing various items that can be matched with the first item by triggering the item collection page opening control, and further support the user to select a second item from the matching item collection page, and match the first item and the second item in the scene space, thereby improving the convenience of matching.

[0062] Another optional technical solution, the above-mentioned object model display method further includes:

[0063] In response to a third movement operation input for the first object model, a compatible item model that can be matched with the first object model in the scene space is identified, so that during the movement of the first object model, if the distance between the compatible item model and the compatible item model is within a preset second distance threshold, second prompt information representing that the compatible item model can be matched is displayed.

[0064] Among them, the collocation item model can be understood as the item model that can be collocated with the first item model among all the item models in the scene space, that is, the item model that has a collocation relationship with the first item model. Exemplarily, when the first item model is a water cup model, the collocation item model can be a table model; when the first item model is a blanket model, the collocation item model can be a sofa model and / or a bed model; when the first item model is a hat model, the collocation item model can be a coat rack model; etc. This is related to the actual situation and is not specifically limited here.

[0065] The above technical solution can determine the distance between the first object model and each compatible object model during the process of the user moving the first object model, and when a certain distance is within a preset second distance threshold, generate second prompt information based on the compatible object model corresponding to the distance to prompt the user that the first object model currently being moved (i.e. placed) can be matched with the compatible object model, thereby realizing automatic matching between object models with a matching relationship and improving the convenience of matching.

[0066] On this basis, optionally, the above-mentioned item model display method further includes:

[0067] When the third moving operation stops being received, the first object model is controlled to be placed on the portion of the collocation object model where the first object model can be placed, and the placed first object model is displayed.

[0068] In the process of the user moving the first object model, the client can continue to receive the third moving operation. After browsing the second prompt information, if the user agrees with the matching suggestion prompted by the second prompt information, the user can stop moving the first object model, and the client stops receiving the third moving operation.

[0069] On this basis, the client further determines the part of the matchable item model on which the first item model can be placed. Taking the above examples as examples, for the example of the water cup model and the table model, the part can be the table top part of the table model; for the example of the blanket model and the sofa model, the part can be the sofa surface part of the sofa model; for the example of the hat model and the coat rack model, the part can be the hook part of the coat rack model; and so on. This is related to the actual situation and is not limited here.

[0070] Furthermore, the client controls the first object model to be placed on the part, and displays the placed first object model, thereby eliminating the need for the user to place the first object model on the matchable object model through operation, thereby achieving automatic placement of the first object model and improving the convenience of the matching operation.

[0071] Figure 3 It is a flowchart of another method for displaying an item model provided in an embodiment of the present invention. This embodiment is optimized based on the above-mentioned technical solutions. In this embodiment, optionally, before responding to the second item selection operation, the above-mentioned item model display method also includes: displaying the operation bar of the first item model and the first item details page of the first item in the scene space; in response to the option selection operation input for the reserved option in the operation bar, marking the first item model with a reserved mark; in response to the first exit operation input for the first item details page, switching the page displayed in the scene space from the first item details page to the first item collection page, and in the case where the first item model is marked with a reserved mark, continuing to display the first item model in the scene space, wherein the first item is selected from the first item collection page. Among them, the explanations of the terms that are the same or corresponding to the above-mentioned embodiments are not repeated here.

[0072] See also Figure 3 The method of this embodiment may specifically include the following steps:

[0073] S210: Displaying the scene space where the wearer of the head mounted display device is located on the display screen.

[0074] S220. In response to the first item selection operation, display a first item model of the selected first item, an operation bar of the first item model, and a first item details page of the first item in the scene space.

[0075] Among them, in the embodiment of the present invention, the first item can be selected by the user from the first item collection page, and the first item collection page at least records the description information 1 of the first item. Of course, on this basis, the description information of the remaining items can also be recorded. This is related to the actual situation and is not specifically limited here.

[0076] The first item details page of the first item also records the description information 2 of the first item, and usually, only the description information 2 is recorded thereon, and the description information of other items is not recorded thereon, and the description information 2 is more detailed than the description information 1. For example, here, the sofa model 2 is the first item model and the sofa details page is the first item details page, see Figure 2a , which displays the sofa details page 21 of the sofa model 2.

[0077] One or more operation options are displayed in the operation bar of the first object model, and the operation options may represent the operations that can be performed on the first object model. Figure 2a Here, the sofa model 2 is taken as an example as the first item model. The operation bar 22 of the sofa model 2 displays a retain option 221, a size adjustment option 222, and a purchase option 223.

[0078] In the scene space, a first item model, an operation bar, and a first item details page are displayed.

[0079] S230: In response to an option selection operation input for a reservation option in the operation column, mark the first item model with a reservation mark.

[0080] The retain option in the operation bar of the first item model can be understood as an option for indicating that the first item model needs to be retained (i.e., not closed) when exiting the first item details page corresponding to the first item model. The option selection operation can be understood as an operation for selecting the retain option input. In response to the option selection operation, a retain mark is marked on the first item model so that when the retain mark is subsequently recognized, the first item model continues to be displayed in the scene space.

[0081] S240. In response to a first exit operation input for the first item details page, the page displayed in the scene space is switched from the first item details page to the first item collection page, and the first item model continues to be displayed in the scene space while the first item model is marked with a reserve flag, wherein the first item is selected from the first item collection page.

[0082] Among them, the first exit operation can be understood as an operation input for the first item details page to characterize the exit from the first item details page. It can be understood that the first item is selected from the first item collection page. After the first item is selected, the page displayed in the scene space is switched from the first item collection page to the first item details page. Then, by responding to the first exit operation, the first item details page is exited, that is, the page displayed in the scene space is switched from the first item details page to the first item collection page. On this basis, it is also possible to identify whether there is an item model with a retention mark in the scene space, and then retain the item model with the retention mark if it exists. For example, in the case where the first item model is marked with a retention mark, it can be retained so that the first item model continues to be displayed in the scene space. Exemplarily, Figure 2b The effect diagram of displaying a sofa model 2 in the scene space 1 and the first item collection page 23 in which the user selects the sofa model 2 is exemplarily shown.

[0083] S250: In response to the second object selection operation, display a second object model of the selected second object in the scene space where the first object model is displayed.

[0084] The technical solution of the embodiment of the present invention distinguishes the item models that need to be retained from the item models that can be closed through the retention mark, so that when the user returns to the item collection page from the item details page, the item model with the retention mark can be retained, that is, the item model continues to be displayed in the scene space, so as to support the user to match the item model with the subsequently selected item model, thereby realizing autonomous matching.

[0085] On this basis, an optional technical solution is that after responding to the second item selection operation, the item model display method further includes:

[0086] In the scene space, display a second item details page of the second item;

[0087] In response to an option cancel operation input for the reservation option, canceling the reservation mark;

[0088] In response to a second exit operation input for the second item details page, the page displayed in the scene space is switched from the second item details page to the second item collection page, and when the first item model is not marked with a retention flag, the first item model is stopped from being displayed in the scene space, wherein the second item is selected from the second item collection page.

[0089] The second item details page is similar to the first item details page, and will not be described in detail here. In the scene space, the second item details page is displayed. For example, here, the side table model 3 is the second item model and the side table details page is the second item details page. Figure 2c , which shows the sofa model 2, the side table model 3 and the side table details page 31 of the side table model 3 displayed in the scene space 1.

[0090] The option cancel operation is the opposite of the option selection operation, and represents the operation of canceling the selection of the reservation option. In response to the option cancel operation, the reservation mark on the first item model is canceled, so that when exiting a certain item detail page, the first item model is stopped from being displayed in the scene space.

[0091] The second exit operation is similar to the first exit operation and will not be described in detail here. In response to the second exit operation, the second item details page is exited, that is, the page displayed in the scene space is switched from the second item details page to the second item collection page. On this basis, it is also possible to identify whether there are item models with a reservation mark in the scene space, and close item models without a reservation mark. For example, when the first item model is not marked with a reservation mark, the first item model can be stopped from being displayed in the scene space when exiting the second item details page, because this is an item model that the user does not want to continue to match.

[0092] The above technical solution supports the user to deselect a retention option after selecting the retention option, indicating that the object model corresponding to the retention option is an object model that does not need to be continued to be matched in the scene space. Therefore, the object model can be closed, that is, it will not continue to be displayed in the scene space, thereby improving the matching flexibility.

[0093] Another optional technical solution is that after the page displayed in the scene space is switched from the first item details page to the first item collection page, the item model display method further includes:

[0094] In response to the item update request, switching the page displayed in the scene space from the first item collection page to the second item collection page;

[0095] In response to the second object selection operation, displaying a second object model of the selected second object in the scene space where the first object model is displayed, including:

[0096] In response to a second item selection operation input for the second item collection page, a second item model of the second item selected from the second item collection page is displayed in the scene space where the first item model is displayed.

[0097] Among them, after the page displayed in the scene space switches to the first item collection page, the user may not be able to find the items he wants to match from the first item collection page. At this time, the user can trigger an item update request to request to update the currently displayed items. In combination with the application scenarios that may be involved in the embodiments of the present invention, optionally, the item update request can be triggered by sliding the first item collection page up, down, left, and right; it can be triggered by entering item information in the displayed item search column; of course, it can also be triggered by other methods, which are not specifically limited here. In response to the item update request, the page displayed in the scene space is switched from the first item collection page to the second item collection page, and the second item collection page can be the item collection page obtained after sliding or searching. In this way, the user can browse the second item collection page to confirm whether there are items he wants to match, and trigger the second item selection operation if so.

[0098] The above technical solution supports the user to switch the item collection page by triggering an item update request when the currently displayed item collection page does not contain the items that the user wants to match, so that the user can continue to look for the items he wants to match in the switched item collection page, further ensuring independent matching.

[0099] In order to better understand the retention and closing process of the item model described above, Figure 4 The examples given are illustrative. For example, see Figure 4, when the user selects item A in a certain item collection page, the user can enter the item details page of item A (i.e., the A details page), that is, the A details page is displayed in the scene space, and the item model of item A (i.e., the A model) is displayed. Furthermore, after the user selects the retain option in the operation bar of the A model, the A model can be marked with a retain mark, so that when exiting the A details page and returning to the corresponding item collection page, the A model is retained, that is, the A model continues to be displayed in the scene space. The subsequent processing of items B and C is similar and will not be repeated here. Figure 4 In the last row, since the retain option of model B is unchecked, when exiting the C details page, model B is no longer displayed in the scene space, and only models A and C are displayed.

[0100] akin, Figure 2a-2c It also shows the page switching process of entering the sofa details page 21, exiting the sofa details page 21 and returning to the item collection page corresponding to the sofa model 2, and then entering the side table details page 31.

[0101] On this basis, combined with the above-mentioned examples of immersive space and RealityView, it can be seen that for item models with a reserved mark in the scene space, when exiting the item details page, the item model is not closed, that is, the immersive space and RealityView where the item model is located are not closed, and it coexists with other pages such as the returned item collection page, thereby supporting users to open more item models from the item collection page and display these item models together in the immersive space. In addition, in order to realize the joint display of multiple item models, the multiple item models need to be obtained together, so a data structure that supports the storage of multi-model data can be designed. The model data of an item model may include resource information, attribute information, and attached view information, etc.

[0102] Figure 5 It is a flow chart of another object model display method provided in an embodiment of the present invention. This embodiment is optimized based on the above-mentioned technical solutions. In this embodiment, optionally, after displaying the second object model of the selected second object, the above-mentioned object model display method further includes: in response to the first movement operation input to the first object model, during the movement of the first object model, if the first object model contacts the second object model, the collision result between the first object model and the second object model is displayed in the scene space, or the first object model is controlled to pass through the second object model and continue to move. Among them, the explanations of the terms that are the same or corresponding to the above-mentioned embodiments are not repeated here.

[0103] See also Figure 5 The method of this embodiment may specifically include the following steps:

[0104] S310: Displaying the scene space where the wearer of the head mounted display device is located on the display screen.

[0105] S320: In response to the first object selection operation, display a first object model of the selected first object in the scene space.

[0106] S330: In response to the second object selection operation, display a second object model of the selected second object in the scene space where the first object model is displayed.

[0107] S340. In response to a first movement operation input for the first object model, if the first object model contacts the second object model during its movement, a collision result between the first object model and the second object model is displayed in the scene space, or the first object model is controlled to pass through the second object model and continue to move.

[0108] The first object model and the second object model are two object models displayed in the scene space, and the user can move some or all of the two object models to view the different matching effects of the two object models and the scene space. Here, the application scenario of moving the first object model is taken as an example, and the related contents are described as follows.

[0109] The first movement operation can be understood as an operation input by the user for the first object model to instruct the movement of the first object model. In combination with the application scenarios that may be involved in the embodiments of the present invention, the first movement operation can be triggered by at least one of head movement, eye movement, manual operation, and voice, which can be set according to actual needs and is not specifically limited here.

[0110] In response to the first movement operation, the first object model is controlled to move, and the movement process of the first object model is displayed so that the user knows the movement of the first object model. Moreover, during the movement process, if the first object model contacts the second object model, the collision result between the two object models can be displayed in the scene space, that is, the collision processing between them is performed at this time to ensure that the object models cannot be interlaced, or the first object model is controlled to pass through the second object model and continue to move, so as to ensure that the first object model can be moved to the position to which the user needs to move. Of course, in actual applications, the specific selection of the above two implementation schemes is related to the actual settings and is not specifically limited here.

[0111] On this basis, in combination with the application scenarios that may be involved in the embodiments of the present invention, for the implementation scheme of the collision between two object models, optionally, the display position of the second object model in the scene space is used as the model display position. When the model display position is in the air in the scene space, this indicates that the user has not confirmed the placement position of the second object model in the scene space. In this case, the second object model may be knocked away by the first object model, that is, the collision result is that the second object model leaves the model display position.

[0112] Alternatively, when the model display position is a plane in the scene space, this indicates that the user has basically confirmed the placement position of the second object model in the scene space. In this case, the second object model cannot be knocked away by the first object model, and the first object model stays at the second object model, that is, the collision result is that the first object model stays at an adjacent display position adjacent to the model display position.

[0113] The above two types of collision processing match the user's matching needs and improve matching efficiency.

[0114] According to the technical solution of the embodiment of the present invention, during the process of controlling the movement of the first object model, if it contacts the second object model, collision processing can be performed between the two object models, and the collision result can be displayed in the scene space, thereby ensuring that the object models cannot be interlaced and improving the authenticity of the matching, or the first object model can be controlled to pass through the second object model and continue to move, thereby ensuring that the first object model can be moved to the position required by the user and improving the matching efficiency.

[0115] On this basis, an optional technical solution is that after the object model contacts the second object model, the object model display method further includes:

[0116] determining collision properties of the second item model;

[0117] Displaying the collision result between the first item model and the second item model in the scene space, or controlling the first item model to pass through the second item model and continue to move, including:

[0118] When the collision attribute is with collision, the collision result between the first object model and the second object model is displayed in the scene space; or,

[0119] When the collision attribute is without collision, the first item model is controlled to pass through the second item model and continue to move.

[0120] The collision attribute can indicate whether to perform collision detection on the second object model. In the present technical solution, the collision attribute can be divided into two types: with collision (i.e., collision detection) and without collision (i.e., no collision detection is required). Specifically, if the first object model contacts the second object model, if the collision attribute is with collision, the collision result is displayed in the scene space; if the collision attribute is without collision, the first object model is controlled to pass through the second object model and continue to move.

[0121] The above technical solution can adopt a corresponding processing solution according to the collision property of the second object model when the first object model contacts the second object model during movement, thereby achieving a balance between matching authenticity and matching efficiency and improving the user's matching experience.

[0122] Figure 6 It is a flowchart of another object model display method provided in an embodiment of the present invention. This embodiment is optimized based on the above-mentioned technical solutions. In this embodiment, optionally, the above-mentioned object model display method may also include: in response to a second movement operation input for the first object model, identifying a plane in the scene space where the first object model can be placed, so that during the movement of the first object model, if the distance between the first object model and the plane is within a preset first distance threshold, a first prompt information indicating that the plane can be placed is displayed. Among them, the explanations of the terms that are the same or corresponding to the above-mentioned embodiments are not repeated here.

[0123] See also Figure 6 The method of this embodiment may specifically include the following steps:

[0124] S410: Displaying the scene space where the wearer of the head mounted display device is located on the display screen.

[0125] S420: In response to the first object selection operation, display a first object model of the selected first object in the scene space.

[0126] S430, in response to a second movement operation input for the first object model, identifying a plane in the scene space on which the first object model can be placed, so that during the movement of the first object model, if the distance between the first object model and the plane is within a preset first distance threshold, first prompt information indicating that the plane can be placed is displayed.

[0127] In the process of controlling the movement of the first object model, the plane X on which the first object model can be placed can be identified among all the planes in the scene space. In the embodiment of the present invention, optionally, a plane identification tool can be called to identify the plane data representing the plane in the space data to obtain all the planes, and then the plane type of each plane in the all the planes and the item type of the first object can be used to determine the plane X from the all the planes. Exemplarily, the plane type can be the ground, the tabletop, the sofa surface, the bed surface, the ceiling or the window, etc. In the case where the item type is a cup, the plane whose plane type is the table can be used as the plane X.

[0128] In response to the second movement operation input for the first object model, the plane X in the scene space is identified. In this way, during the movement of the first object model, the distance between the first object model and each plane X can be determined, and when a certain distance is within a preset first distance threshold, a first prompt information can be generated based on the plane X corresponding to the distance to prompt the user to place the first object model that is currently being moved (i.e., placed) on the plane X.

[0129] On this basis, combined with the application scenarios that may be involved in the embodiments of the present invention, optionally, when the scene space is a real space, the plane X can be the plane of the physical object placed in the real space, thereby realizing the matching between the first object model and the physical object, or it can be the plane of the object model X placed in the real space other than the first object model, thereby realizing the matching between the two object models, and the matching is diversified. Optionally, when the scene space is a virtual space, the plane X can be the plane of the object model X in the virtual space, thereby realizing the matching between the two object models.

[0130] S440: In response to the second object selection operation, display a second object model of the selected second object in the scene space where the first object model is displayed.

[0131] The technical solution of the embodiment of the present invention identifies the plane X in the scene space, so that when controlling the movement process of the first object model, when the distance between the first object model and a certain plane X is relatively close, the first prompt information indicating that the plane X can be placed is displayed, so as to prompt the user to use the plane X as a reference plane to place the first object model, thereby improving the authenticity and convenience of the matching.

[0132] On this basis, an optional technical solution is that after displaying the first prompt information indicating that the plane can be placed, the object model display method further includes:

[0133] When the second moving operation stops being received, the first object model is controlled to be placed on the plane, and the placed first object model is displayed.

[0134] In the process of the user moving the first object model, the client can continuously receive the second moving operation. After browsing the first prompt information, if the user agrees with the placement suggestion prompted by the first prompt information, the user can stop moving the first object model. At this time, the client stops receiving the second moving operation, and the first object model can be placed on the plane X prompted by the first prompt information and the placement effect is displayed.

[0135] Exemplarily, the user can move the first object model by pinching it, and when it is moved near a plane X, the client can display an indicator (i.e., first prompt information) near the plane X to indicate that the first object model can be placed on the plane X. At this time, as long as the user lets go, the client can control the first object model to fall freely onto the plane X.

[0136] The above technical solution can assist the user in placing the first object model on the plane X, thereby realizing automatic placement of the first object model and improving the convenience of placement.

[0137] Figure 7 It is a flowchart of another object model display method provided in an embodiment of the present invention. This embodiment is optimized based on the above-mentioned technical solutions. In this embodiment, optionally, after responding to the second object selection operation, the above-mentioned object model display method also includes: obtaining the initial display position of the second object model of the selected second object in the scene space and the model display position of the first object model in the scene space; in the scene space where the first object model is displayed, displaying the second object model of the selected second object, including: when the initial display position and the model display position at least partially overlap, re-displaying the first object model based on the first display mode at the model display position of the scene space, and displaying the second object model based on the second display mode at the initial display position, wherein the first display mode is less prominent in the display effect than the second display mode. Among them, the explanations of the terms that are the same or corresponding to the above-mentioned embodiments are not repeated here.

[0138] See also Figure 7 The method of this embodiment may specifically include the following steps:

[0139] S510: Displaying the scene space where the wearer of the head mounted display device is located on the display screen.

[0140] S520: In response to the first object selection operation, display a first object model of the selected first object in the scene space.

[0141] S530: In response to the second object selection operation, obtain an initial display position of a second object model of the selected second object in the scene space and a model display position of the first object model in the scene space.

[0142] Among them, since the second object model is a newly born object model and has not been displayed in the scene space before, the initial display position of the second object model in the scene space can be obtained here. Combined with the application scenarios that may be involved in the embodiments of the present invention, the initial display position can be obtained by preset.

[0143] Since the first object model has been previously displayed in the scene space, the model display position of the first object model in the scene space can be obtained here. The model display position can be understood as the current display position of the first object model in the scene space.

[0144] In practical applications, further, optionally, the model display position of each object model retained in the scene space can be traversed, and then each model display position is judged whether it overlaps with the initial display position. Optionally, this judgment process can be performed based on the bounding box of the object model.

[0145] S540. When the initial display position and the model display position at least partially overlap, redisplay the first object model at the model display position in the scene space based on the first display mode, and display the second object model at the initial display position based on the second display mode, wherein the first display mode is less prominent in display effect than the second display mode.

[0146] Among them, when the initial display position partially overlaps or completely overlaps with the model display position, in order to allow the user to pay attention to the newly born second object model, the first display mode and the second display mode can be preset, and the first display mode is less prominent in the display effect than the second display mode. For example, the first display mode is a partially transparent display and the second display mode is an opaque display (i.e., a solid display); for example, the first display mode is a non-bold display and the second display mode is a bold display; for example, the first display mode is a non-highlighted display and the second display mode is a highlighted display, and so on; then, the second object model is displayed based on the second display mode at the initial display position, and the first object model is displayed based on the first display mode at the model display position, thereby achieving the effect of highlighting the second object model.

[0147] It can be understood that, at this time, the first object model has removed the collision detection and can be interspersed with the second object model; and for the remaining object models that do not overlap with the second object model, they can be consistent with the second object model, displayed based on the second display mode, with collision detection and allowing interaction, etc.

[0148] According to the technical solution of the embodiment of the present invention, when a newly-born second object model at least partially overlaps with the retained first object model in display position, the second object model is displayed by utilizing a second display mode with a more prominent display effect, and the first object model is displayed by utilizing a first display mode with a less prominent display effect, so that the user can focus on the second object model.

[0149] On this basis, an optional technical solution is that after displaying the second object model at the initial display position based on the second display mode, the object model display method further includes:

[0150] In response to a fourth movement operation inputted for the second object model, acquiring a display position after the movement;

[0151] When the display position after the movement does not overlap with the model display position, the first object model is redisplayed at the model display position based on the second display method.

[0152] The fourth movement operation can be understood as an operation input by the user for the second object model to indicate that the second object model needs to be moved. According to the fourth movement operation, the second object model is controlled to move, and the display position of the second object model after the movement is obtained.

[0153] Furthermore, when the display position after the movement does not overlap with the model display position, the second object model and the first object model do not interfere with each other, and the first object model can be displayed at the model display position based on the second display mode to ensure the normal display of the first object model. In practical applications, optionally, the collision detection and interactivity of the first object model can also be restored to ensure the normal processing of the first object model.

[0154] Another optional technical solution is that after displaying the second object model at the initial display position based on the second display mode, the object model display method further includes:

[0155] In response to an interactive operation input to the first object model, third prompt information indicating that the first object model is not interactive is displayed in the scene space.

[0156] Among them, the interactive operation can be understood as the operation input by the user to the first object model to represent the need to interact with the first object model. The operation can be, for example, at least one of a moving operation, a rotating operation, and a scaling operation. This is related to the actual situation and is not specifically limited here.

[0157] When the initial display position and the model display position at least partially overlap, the first object model is not interactive. This can avoid the situation where the object model that the user needs to interact with cannot be accurately determined when the trigger position of the interactive operation in the scene space is an overlapping position, thereby ensuring accurate interaction. Therefore, after receiving the interactive operation, the third prompt information can be displayed in the scene space to prompt the user that the first object model is not interactive.

[0158] Figure 8 This is a structural block diagram of an object model display device provided in an embodiment of the present invention, and the device is used to execute the object model display method provided in any of the above embodiments. The device and the object model display method of the above embodiments belong to the same inventive concept. For details not described in detail in the embodiment of the object model display device, please refer to the embodiment of the above object model display method. Figure 8 The device is configured on a client, and the client is deployed on a head-mounted display device. The head-mounted display device includes a display screen. The device may include: a scene space display module 610, a first object model display module 620, and a second object model display module 630.

[0159] The scene space display module 610 is used to display the scene space where the wearer of the head mounted display device is located on the display screen;

[0160] A first item model display module 620, configured to display a first item model of the selected first item in the scene space in response to a first item selection operation;

[0161] The second object model display module 630 is used to display a second object model of the selected second object in the scene space where the first object model is displayed in response to the second object selection operation.

[0162] Optionally, the above-mentioned object model display device further includes:

[0163] A first item details page display module, used for displaying an operation bar of a first item model and a first item details page of the first item in a scene space before responding to a second item selection operation;

[0164] A reservation mark module, used for marking a reservation mark on the first item model in response to an option selection operation input for the reservation option in the operation column;

[0165] The first item model continuing display module is used to switch the page displayed in the scene space from the first item details page to the first item collection page in response to a first exit operation input for the first item details page, and to continue to display the first item model in the scene space when the first item model is marked with a retention mark, wherein the first item is selected from the first item collection page.

[0166] On this basis, optionally, the above-mentioned object model display device further includes:

[0167] A second item details page display module, configured to display a second item details page of the second item in the scene space in response to a second item selection operation;

[0168] A reservation mark cancellation module, used for canceling the reservation mark in response to an option cancellation operation input for the reservation option;

[0169] The first object model stop display module is used to switch the page displayed in the scene space from the second object details page to the second object collection page in response to a second exit operation input for the second object details page, and to stop displaying the first object model in the scene space when the first object model is not marked with a retention mark, wherein the second object is selected from the second object collection page.

[0170] Alternatively, the above-mentioned object model display device further includes:

[0171] A second item collection page switching module may be used to switch the page displayed in the scene space from the first item collection page to the second item collection page in response to an item update request after the page displayed in the scene space is switched from the first item details page to the first item collection page;

[0172] The second item model display module 630 is specifically used for:

[0173] In response to a second item selection operation input for the second item collection page, a second item model of the second item selected from the second item collection page is displayed in the scene space where the first item model is displayed.

[0174] Optionally, the above-mentioned object model display device further includes:

[0175] An item collection page opening control display module is used to display an item collection page opening control in the scene space in response to a first item selection operation;

[0176] A matching item collection page display module, which can be used to display a matching item collection page in the scene space in response to a trigger operation inputted for opening the item collection page control, wherein the items represented in the matching item collection page are items that can be matched with the first item and placed in the scene space;

[0177] The second item model display module 630 is specifically used for:

[0178] In response to a third item selection operation inputted for the collocation item collection page, for a second item selected from the collocation item collection page, a second item model of the second item is displayed in the scene space where the first item model is displayed.

[0179] Optionally, the above-mentioned object model display device further includes:

[0180] The first object model control module is used for, after displaying the second object model of the selected second object, in response to a first movement operation input to the first object model, displaying a collision result between the first object model and the second object model in a scene space if the first object model contacts the second object model during its movement, or controlling the first object model to pass through the second object model and continue to move.

[0181] On this basis, optionally, the above-mentioned object model display device further includes:

[0182] A collision attribute determination module, used for determining the collision attribute of the second object model after contact with the second object model;

[0183] The first item model control module includes:

[0184] A collision result display unit is used to display the collision result between the first object model and the second object model in the scene space when the collision attribute is collision-related; or

[0185] The first object model control unit is used to control the first object model to pass through the second object model and continue to move when the collision attribute is no collision.

[0186] Alternatively, for the model display position of the second object model in the scene space,

[0187] When the model display position is in the air in the scene space, the collision result is that the second item model leaves the model display position; and / or,

[0188] When the model display position is a plane in the scene space, the collision result is that the first item model stays at an adjacent display position adjacent to the model display position.

[0189] Optionally, the above-mentioned object model display device further includes:

[0190] The first prompt information display module can be used to respond to the second movement operation input for the first object model, identify the plane in the scene space where the first object model can be placed, so that during the movement of the first object model, if the distance between the first object model and the plane is within a preset first distance threshold, the first prompt information indicating that the plane can be placed is displayed.

[0191] On this basis, optionally, the above-mentioned object model display device further includes:

[0192] The plane placement module is used to control the first object model to be placed on the plane after displaying the first prompt information indicating that the plane can be placed and stop receiving the second movement operation, and display the placed first object model.

[0193] Alternatively, when the scene space is a real space, the plane is a plane of a physical object in the real space or a plane of an object model other than the first object model in the real space; and / or,

[0194] In the case where the scene space is a virtual space, the plane is a plane of item models other than the first item model in the virtual space.

[0195] Optionally, the above-mentioned object model display device further includes:

[0196] The second prompt information display module can be used to respond to the third movement operation input to the first object model, identify the compatible item model that can be matched with the first object model in the scene space, so that during the movement of the first object model, if the distance between the first object model and the compatible item model is within a preset second distance threshold, the second prompt information representing the compatibility with the compatible item model is displayed.

[0197] On this basis, optionally, the above-mentioned object model display device further includes:

[0198] The partial placement module can be used to control the placement of the first object model on the portion of the collocation object model where the first object model can be placed, and display the placed first object model when the third movement operation stops being received.

[0199] Optionally, the above-mentioned object model display device further includes:

[0200] a model display position acquisition module, used to acquire, in response to the second object selection operation, an initial display position of a second object model of the selected second object in the scene space and a model display position of the first object model in the scene space;

[0201] The second item model display module 630 is specifically used for:

[0202] When the initial display position and the model display position at least partially overlap, the first object model is redisplayed at the model display position in the scene space based on the first display mode, and the second object model is displayed at the initial display position based on the second display mode, wherein the first display mode is less prominent in display effect than the second display mode.

[0203] On this basis, optionally, the first display mode is a partially transparent display, and the second display mode is an opaque display.

[0204] Alternatively, the above-mentioned object model display device further includes:

[0205] a module for acquiring a display position after movement, which can be used to acquire a display position after movement in response to a fourth movement operation inputted for the second object model after the second object model is displayed at the initial display position based on the second display mode;

[0206] The first object model redisplay module is used to redisplay the first object model at the model display position based on the second display mode when the display position after the movement does not overlap with the model display position.

[0207] Alternatively, the above-mentioned object model display device further includes:

[0208] The third prompt information display module is used to display the third prompt information indicating that the first object model cannot be interacted with in the scene space in response to the interactive operation input to the first object model after displaying the second object model based on the second display mode at the initial display position.

[0209] The object model display device provided in the embodiment of the present invention is configured on a client, and the client is deployed on a head-mounted display device, and the head-mounted display device includes a display screen. The client displays the scene space where the wearer of the head-mounted display device is located on the display screen through a scene space display module; further, when the user selects the first object, the client displays the first object model of the first object in the scene space through the first object model display module in response to the first object selection operation, so as to support the user to place the first object model in the scene space; further, when the user selects the second object, the client can display the first object model and the second object model of the second object in the scene space through the second object model display module in response to the second object selection operation, so as to support the user to place the first object model and / or the second object model in the scene space, so as to realize the matching of the two object models with the scene space. The above device not only supports the user to match a single object model with the scene space, but also supports the user to match two or at least two object models with the scene space, thereby giving the user a higher degree of freedom in matching, realizing the free selection of object models, and further realizing the free matching between at least two object models and between at least two object models and the scene space.

[0210] The object model display device provided in the embodiment of the present invention can execute the object model display method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0211] It is worth noting that in the embodiment of the above-mentioned object model display device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.

[0212] Fig. 9 A schematic diagram of a head mounted display device 10 that can be used to implement an embodiment of the present invention is shown. The head mounted display device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The head mounted display device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or claimed herein.

[0213] like Fig. 9As shown, the head mounted display device 10 may include a display screen, and on this basis, it also includes at least one processor 11, and a memory connected to the at least one processor 11 in communication, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the head mounted display device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other via a bus 14. The input / output (I / O) interface 15 is also connected to the bus 14.

[0214] A number of components in the head mounted display device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the head mounted display device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0215] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as the item model display method.

[0216] In some embodiments, the item model display method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the head mounted display device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the item model display method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to execute the item model display method in any other appropriate manner (e.g., by means of firmware).

[0217] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0218] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine as a stand-alone software package and partially on a remote machine, or entirely on a remote machine or server.

[0219] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0220] To provide interaction with a user, the systems and techniques described herein may be implemented on a head-mounted display device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the head-mounted display device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0221] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0222] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0223] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0224] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for displaying an object model, characterized in that: Applied to a client, the client is deployed on a head-mounted display device, the head-mounted display device includes a display screen, and the method includes: Displaying, on the display screen, a scene space in which a wearer of the head mounted display device is located; In response to a first object selection operation, displaying a first object model of the selected first object in the scene space; In response to a second object selection operation, a second object model of the selected second object is displayed in the scene space where the first object model is displayed.

2. The method according to claim 1, characterized in that Before the operation of responding to the second item selection, the method further includes: In the scene space, displaying an operation bar of the first item model and a first item details page of the first item; In response to an option selection operation input for a reservation option in the operation bar, marking the first item model with a reservation mark; In response to a first exit operation input for the first item details page, the page displayed in the scene space is switched from the first item details page to the first item collection page, and when the first item model is marked with the retention mark, the first item model continues to be displayed in the scene space, wherein the first item is selected from the first item collection page.

3. The method according to claim 2, characterized in that After the response to the second item selection operation, the method further includes: In the scene space, displaying a second item details page of the second item; In response to an option cancel operation input for the reservation option, canceling the reservation mark; In response to a second exit operation input for the second item details page, the page displayed in the scene space is switched from the second item details page to the second item collection page, and if the first item model is not marked with the retention mark, the first item model is stopped from being displayed in the scene space, wherein the second item is selected from the second item collection page.

4. The method according to claim 2, characterized in that: After switching the page displayed in the scene space from the first item details page to the first item collection page, the method further includes: In response to the item update request, switching the page displayed in the scene space from the first item collection page to the second item collection page; In response to the second object selection operation, displaying a second object model of the selected second object in the scene space where the first object model is displayed, comprises: In response to a second item selection operation input for the second item collection page, a second item model of the second item selected from the second item collection page is displayed in the scene space where the first item model is displayed.

5. The method according to claim 1, characterized in that After the operation of selecting the first item is responded, the method further includes: In the scene space, display an item collection page opening control; In response to a trigger operation of opening a control input for the item collection page, displaying a collocation item collection page in the scene space, wherein the items represented in the collocation item collection page are items that can be placed in the scene space in combination with the first item; In response to the second object selection operation, displaying a second object model of the selected second object in the scene space where the first object model is displayed, comprises: In response to a third item selection operation input to the collocation item collection page, for a second item selected from the collocation item collection page, a second item model of the second item is displayed in the scene space where the first item model is displayed.

6. The method according to claim 1, characterized in that After displaying the second item model of the selected second item, the method further includes: In response to a first movement operation input for the first object model, during the movement of the first object model, if the first object model contacts the second object model, a collision result between the first object model and the second object model is displayed in the scene space, or the first object model is controlled to pass through the second object model and continue to move.

7. The method according to claim 6, characterized in that After the contact with the second object model, the method further includes: determining a collision property of the second object model; The displaying the collision result between the first object model and the second object model in the scene space, or controlling the first object model to pass through the second object model and continue to move, includes: In the case where the collision attribute is collision-related, displaying the collision result between the first object model and the second object model in the scene space; or, When the collision attribute is no collision, the first item model is controlled to pass through the second item model and continue to move.

8. The method according to claim 6, characterized in that For the model display position of the second object model in the scene space, When the model display position is in the air in the scene space, the collision result is that the second object model leaves the model display position; and / or, In the case where the model display position is a plane in the scene space, the collision result is that the first item model stays at an adjacent display position adjacent to the model display position.

9. The method according to claim 1, characterized in that: Also includes: In response to a second movement operation input for the first object model, a plane in the scene space on which the first object model can be placed is identified, so that during the movement of the first object model, if the distance between the first object model and the plane is within a preset first distance threshold, first prompt information indicating that the plane can be placed is displayed.

10. The method according to claim 9, characterized in that After the first prompt information indicating that the plane can be placed is displayed, the method further includes: When the second moving operation stops being received, the first object model is controlled to be placed on the plane, and the placed first object model is displayed.

11. The method according to claim 9, characterized in that: In the case where the scene space is a real space, the plane is a plane of a physical object in the real space or a plane of an object model other than the first object model in the real space; and / or, In a case where the scene space is a virtual space, the plane is a plane of an item model other than the first item model in the virtual space.

12. The method according to claim 1, characterized in that Also includes: In response to a third movement operation input for the first object model, a compatible item model in the scene space that can be combined with the first object model is identified, so that during the movement of the first object model, if the distance between the first object model and the compatible item model is within a preset second distance threshold, second prompt information indicating that the compatibility with the compatible item model can be displayed.

13. The method according to claim 12, characterized in that Also includes: When the third moving operation stops being received, the first object model is controlled to be placed on a portion of the collocation object model where the first object model can be placed, and the placed first object model is displayed.

14. The method according to claim 1, characterized in that After the response to the second item selection operation, the method further includes: Acquire an initial display position of a second object model of a selected second object in the scene space and a model display position of the first object model in the scene space; The step of displaying a second object model of a selected second object in the scene space where the first object model is displayed includes: In a case where the initial display position and the model display position at least partially overlap, the first object model is redisplayed at the model display position in the scene space based on a first display mode, and the second object model is displayed at the initial display position based on a second display mode, wherein the first display mode is less prominent in display effect than the second display mode.

15. The method according to claim 14, characterized in that The first display mode is a partially transparent display, and the second display mode is an opaque display.

16. The method according to claim 14, characterized in that After displaying the second object model at the initial display position based on the second display mode, the method further includes: In response to a fourth moving operation inputted for the second object model, acquiring a display position after the movement; When the moved display position does not overlap with the model display position, the first object model is redisplayed at the model display position based on the second display method.

17. The method according to claim 14, characterized in that After displaying the second object model at the initial display position based on the second display mode, the method further includes: In response to an interactive operation input to the first object model, third prompt information indicating that the first object model is not interactive is displayed in the scene space.

18. An object model display device, characterized in that: The device is configured on a client, the client is deployed on a head mounted display device, the head mounted display device includes a display screen, and the device includes: A scene space display module, used to display the scene space where the wearer of the head mounted display device is located on the display screen; A first item model display module, configured to display a first item model of the selected first item in the scene space in response to a first item selection operation; The second object model display module is used to display a second object model of the selected second object in the scene space where the first object model is displayed in response to a second object selection operation.

19. A head mounted display device, characterized in that: include: Display screen; at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor to enable the at least one processor to perform the item model display method according to any one of claims 1 to 17.

20. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the object model display method as described in any one of claims 1 to 17 when executed.

21. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the computer program implements the object model display method according to any one of claims 1 to 17.

Images