Scene element editing method and device, electronic equipment and computer readable medium

Abstract

The embodiment of the invention discloses a scene element editing method and device, electronic equipment and a computer readable medium. A specific embodiment of the method comprises the following steps: in response to detection of a selection operation corresponding to any scene element in a to-be-created mixed reality space, determining position information of an operator; an operator is displayed at the position, corresponding to the operator position information, in the mixed reality space to be created, and the operator comprises all operation shafts; determining a target axial direction according to each axial direction corresponding to each operation shaft; according to the position information of the operator, axial distance information corresponding to the target axial direction is generated; and displaying the axial distance information in the to-be-created mixed reality space for a user to edit the position of any scene element in the to-be-created mixed reality space. According to the embodiment, the operation of the creation user can be simplified, and the experience of the browsing user is improved.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the field of mixed reality technology, and in particular to a scene element editing method, device, electronic device, and computer-readable medium. Background Art

[0002] Mixed reality (MR) space is a mixture of physical space (or real space) and digital space. It links digital space and physical space in some form. Users can browse the mixed reality space through mixed reality devices and observe the physical space and the digital content associated with it at the same time. Mixed reality space can be used in mixed reality guided tours (MR guided tours), for example, it can be applied to digital exhibition halls, and users can experience the combined virtual and real guided tour effect while visiting the exhibition hall.

[0003] At present, when editing the position of scene elements in a mixed reality space, the method usually adopted is: by collecting data from the real space to form a reconstructed space, directly dragging the scene element to a certain position in the reconstructed space, and determining the position of the scene element in the mixed reality space only based on the position coordinates. However, the inventors have found that when using the above method to edit the position of scene elements in a mixed reality space, the following technical problems often occur:

[0004] Directly drag the scene element to a certain position. When determining the position of the scene element, the mixed reality space has a spatial stereoscopic sense. The position of the scene element in the mixed reality space is determined only according to the position coordinates. The relative position relationship between the set scene element and other elements in the mixed reality space cannot be determined. The user needs to adjust the viewing angle multiple times to determine whether the position is appropriate, which makes the user operation cumbersome. In addition, the position actually edited by the user is less consistent with the expected position, resulting in a poor browsing user experience.

[0005] The above information disclosed in this Background section is only for enhancement of understanding of the background of the inventive concept and therefore it may contain information that does not form the prior art that is already known in this country to a person of ordinary skill in the art. Summary of the invention

[0006] The content of this disclosure is used to introduce concepts in a brief form, which will be described in detail in the detailed implementation section below. The content of this disclosure is not intended to identify the key features or essential features of the technical solution claimed for protection, nor is it intended to limit the scope of the technical solution claimed for protection.

[0007] Some embodiments of the present disclosure propose a scene element editing method, device, electronic device and computer-readable medium based on a mixed reality space to solve the technical problems mentioned in the above background technology section.

[0008] In the first aspect, some embodiments of the present disclosure provide a scene element editing method based on a mixed reality space, the method comprising: determining an operator position information in response to detecting a selection operation corresponding to any scene element in the mixed reality space to be created; displaying an operator at a location corresponding to the operator position information in the mixed reality space to be created, wherein the operator includes various operation axes; determining a target axis according to various axial directions corresponding to the various operation axes; generating axial distance information corresponding to the target axis according to the operator position information; and displaying the axial distance information in the mixed reality space to be created for a user to edit the position of any scene element in the mixed reality space to be created.

[0009] Optionally, the method further includes: performing object collision detection on any of the above scene elements to obtain a collision detection result; in response to determining that the collision detection result satisfies a preset detection condition, performing highlighting processing on any of the above scene elements.

[0010] Optionally, the determining of the operator position information includes: determining the center position information of any of the scene elements; and determining the center position information as the operator position information.

[0011] Optionally, the displaying of the operator at a location corresponding to the operator position information in the mixed reality space to be created includes: determining a direction of the operator; and displaying the operator at a location corresponding to the operator position information in the mixed reality space to be created according to the direction.

[0012] Optionally, the target axis is determined according to the axes corresponding to the operation axes, including: in response to detecting a moving operation acting on any of the scene elements, determining the moving direction corresponding to the moving operation as the target moving direction; in response to determining that the target moving direction is the same as any axis included in the axes, determining any of the axes as the target axis.

[0013] Optionally, the above-mentioned determination of the operator position information in response to detecting a selection operation corresponding to any scene element in the mixed reality space to be created includes: determining the operator position information in response to detecting a selection operation acting on any scene element displayed in the mixed reality space to be created.

[0014] Optionally, the above-mentioned axial distance information corresponding to the above-mentioned target axis is generated based on the above-mentioned operator position information, including: extending the operating axis corresponding to the above-mentioned target axis to obtain an extended operating axis; performing wall collision detection processing on the above-mentioned extended operating axis to obtain collision intersection information; generating axial distance information based on the above-mentioned collision intersection information and the above-mentioned operator position information.

[0015] In the second aspect, some embodiments of the present disclosure provide a scene element editing device based on a mixed reality space, the device comprising: a first determination unit, configured to determine the operator position information in response to detecting a selection operation corresponding to any scene element in the mixed reality space to be created; a first display unit, configured to display the operator at a location corresponding to the operator position information in the above-mentioned mixed reality space to be created, wherein the above-mentioned operator includes various operation axes; a second determination unit, configured to determine the target axis according to the various axes corresponding to the above-mentioned various operation axes; a generation unit, configured to generate axial distance information corresponding to the above-mentioned target axis according to the above-mentioned operator position information; and a second display unit, configured to display the above-mentioned axial distance information in the above-mentioned mixed reality space to be created for the user to edit the position of the above-mentioned any scene element in the above-mentioned mixed reality space to be created.

[0016] Optionally, the scene element editing device based on the mixed reality space may further include a collision detection unit and a highlight display unit. The collision detection unit is configured to perform object collision detection on any of the above scene elements to obtain a collision detection result; and the highlight display unit is configured to perform highlight display processing on any of the above scene elements in response to determining that the collision detection result meets a preset detection condition.

[0017] Optionally, the first determining unit may be further configured to: determine the center position information of the above-mentioned arbitrary scene elements; and determine the above-mentioned center position information as the operator position information.

[0018] Optionally, the first display unit may be further configured to: determine the orientation of the operator; and display the operator at a location corresponding to the operator position information in the mixed reality space to be created according to the orientation.

[0019] Optionally, the second determination unit can be further configured to: in response to detecting a movement operation acting on any of the above-mentioned scene elements, determine the movement direction corresponding to the above-mentioned movement operation as the target movement direction; in response to determining that the above-mentioned target movement direction is the same as any axis included in the above-mentioned axes, determine the above-mentioned any axis as the target axis.

[0020] Optionally, the first determination unit may be further configured to: determine operator position information in response to detecting a selection operation acting on any scene element displayed in the mixed reality space to be created.

[0021] Optionally, the generating unit may be further configured to: extend the operating axis corresponding to the target axis to obtain an extended operating axis; perform wall collision detection on the extended operating axis to obtain collision intersection information; and generate axial distance information based on the collision intersection information and the operator position information.

[0022] In a third aspect, some embodiments of the present disclosure provide an electronic device comprising: one or more processors; a storage device on which one or more programs are stored, and when the one or more programs are executed by the one or more processors, the one or more processors implement the method described in any implementation manner of the above-mentioned first aspect.

[0023] In a fourth aspect, some embodiments of the present disclosure provide a computer-readable medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the method described in any implementation manner of the first aspect.

[0024] The above-mentioned embodiments of the present disclosure have the following beneficial effects: the scene element editing method based on the mixed reality space of some embodiments of the present disclosure can simplify the operation of the creation user and improve the experience of the browsing user. Specifically, the reason for the cumbersome operation of the creation user and the poor browsing user experience is that: directly drag the scene element to a certain position, when determining the position of the scene element, the mixed reality space has a spatial stereoscopic sense, and the position of the scene element in the mixed reality space is determined only according to the position coordinates. The relative position relationship between the set scene element and other elements in the mixed reality space cannot be determined, and the creation user needs to adjust the observation angle many times to determine whether the position is appropriate, resulting in cumbersome operation of the creation user, and the position actually edited by the creation user has a low fit with the expected position, resulting in a poor browsing user experience. Based on this, the scene element editing method based on the mixed reality space of some embodiments of the present disclosure, first, in response to detecting the selection operation of any scene element in the mixed reality space to be created, the operator position information is determined. Thus, when the user selects any scene element, the position of the operator can be obtained, which can be used to display the operator. Secondly, the operator is displayed at the position corresponding to the above operator position information in the mixed reality space to be created. Wherein, the above-mentioned operator includes various operation axes. Thus, the operator can be displayed in the mixed reality space to be created, so that it is convenient for the user to adjust the selected scene element. Then, according to the various axial directions corresponding to the above-mentioned various operation axes, the target axial direction is determined. Thus, the direction that the user needs to determine can be obtained, so as to determine the distance information in the corresponding direction. Afterwards, according to the above-mentioned operator position information, the axial distance information corresponding to the above-mentioned target axial direction is generated. Thus, the distance corresponding to the direction that the user needs to determine can be obtained, so that it can be used to prompt the user the relative position of any scene element with other scene elements in the mixed reality space to be created. Finally, the above-mentioned axial distance information is displayed in the above-mentioned mixed reality space to be created for the user to edit the position of the above-mentioned arbitrary scene element in the above-mentioned mixed reality space to be created. Thus, the relative position of any scene element with other scene elements in the mixed reality space to be created on the corresponding axis can be displayed, so that it is convenient for the user to edit the position of any scene element in the above-mentioned mixed reality space to be created. Also, when editing the position of a scene element in the mixed reality space to be created, the relative position relationship between the scene element selected by the creating user and other scene elements in the mixed reality space to be created is determined according to the arbitrary direction selected by the creating user, so that the creating user does not need to adjust the viewing angle multiple times to determine whether the position is appropriate, thereby simplifying the operation of the creating user. Also, because the creating user can place the selected scene element in the expected position according to the displayed distance information, the fit between the actual edited position of the scene element and the expected position is improved, thereby improving the browsing user's experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that components and elements are not necessarily drawn to scale.

[0026] Figure 1 is a flowchart of some embodiments of a scene element editing method based on a mixed reality space according to the present disclosure;

[0027] Figure 2-3 is a schematic diagram of an application scenario of a scene element editing method based on a mixed reality space according to some embodiments of the present disclosure;

[0028] Figure 4 is a flowchart of other embodiments of a scene element editing method based on a mixed reality space according to the present disclosure;

[0029] Figure 5 is a schematic diagram of an application scenario of a scene element editing method based on a mixed reality space according to other embodiments of the present disclosure;

[0030] Figure 6 It is a structural schematic diagram of some embodiments of the scene element editing device based on mixed reality space according to the present disclosure;

[0031] Figure 7 It is a schematic diagram of the structure of an electronic device suitable for implementing some embodiments of the present disclosure. DETAILED DESCRIPTION

[0032] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0033] It should also be noted that, for ease of description, only the parts related to the invention are shown in the drawings. In the absence of conflict, the embodiments and features in the embodiments of the present disclosure can be combined with each other.

[0034] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0035] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0036] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0037] The present disclosure will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments.

[0038] Figure 1 The process 100 of some embodiments of the scene element editing method based on the mixed reality space according to the present disclosure is shown. The scene element editing method based on the mixed reality space includes the following steps:

[0039] Step 101, in response to detecting a selection operation corresponding to any scene element in the mixed reality space to be created, determining operator position information.

[0040] In some embodiments, the execution subject (e.g., browser side) of the scene element editing method based on the mixed reality space can determine the operator position information in response to detecting the selection operation of any scene element in the mixed reality space to be created. Among them, the mixed reality space to be created can be a mixed reality space waiting to be created. The mixed reality space can be a Mesh (triangular patch) map or a point cloud map constructed according to the real space. The selection operation can include but is not limited to at least one of the following: click, hover, drag. The operator position information can characterize the position of the operator in the mixed reality space to be created. The operator can be a device for indicating the position and angle of the corresponding scene element to facilitate the creation of user operations. The operator position information can include but is not limited to the operator coordinates. The operator coordinates can be the coordinates of the operator in the mixed reality space to be created. In practice, first, the execution subject can determine the scene element corresponding to the above-mentioned any scene element control as the target scene element in response to detecting the selection operation acting on any scene element control in the interface for creating the mixed reality space. Then, the coordinates of the lower surface center position of the element model corresponding to the above-mentioned target scene element are determined as the operator position information. The element model may be a bounding box of the corresponding scene element. The lower surface center position coordinates may be the coordinates of the center point of the lower surface in the mixed reality space to be created.

[0041] In some optional implementations of some embodiments, the execution subject may determine the operator position information in response to detecting a selection operation acting on any scene element displayed in the mixed reality space to be created. Thus, the creating user may directly select the scene element to be edited in the mixed reality space.

[0042] In some other optional implementations of some embodiments, the execution subject may determine the operator position information through the following steps:

[0043] The first step is to determine the center position information of any of the above scene elements. In practice, the execution subject may determine the center point coordinates of the element model corresponding to any of the above scene elements as the center position information. The center point coordinates may be the coordinates of the geometric center corresponding to the element model in the mixed reality space to be created.

[0044] In the second step, the above center position information is determined as the operator position information.

[0045] Thus, the operator can be set at the center of the element model corresponding to the scene element, so that the distance between the scene element and other scene elements can be easily determined.

[0046] Step 102: Display the operator at the location corresponding to the operator position information in the mixed reality space to be created.

[0047] In some embodiments, the execution entity may display the operator at a location corresponding to the operator position information in the mixed reality space to be created. The operator may include various operation axes. The various operation axes may have a common endpoint. The various operation axes may be axes indicating different directions. Each operation axis corresponds to a direction. For example, the shape of the operator may be the same as the shape of the three-dimensional coordinate system. In practice, the execution entity may set the common endpoint of each operation axis included in the operator at a location corresponding to the operator position information in the mixed reality space to be created according to a preset direction for display. The preset direction may be a pre-set direction of the operator. The direction may be the direction facing the operator.

[0048] In some optional implementations of some embodiments, the execution subject may display the operator at a location corresponding to the operator position information in the mixed reality space to be created through the following steps:

[0049] The first step is to determine the direction of the operator. In practice, the execution subject may determine the direction of the operator when the operator faces the camera that captures the three-dimensional scene as the direction of the operator.

[0050] The second step is to display the operator at the position corresponding to the operator position information in the mixed reality space to be created according to the above orientation.

[0051] Thus, the orientation of the operator can change along with the perspective conversion of the mixed reality space to be created, so as to remain oriented toward the creating user.

[0052] Step 103: determine the target axis according to the axis directions corresponding to the operation axes.

[0053] In some embodiments, the execution subject may determine the target axis according to the axis corresponding to each of the operation axes. The target axis may be a direction that the user needs to determine in order to determine the distance information in the corresponding direction. In practice, the execution subject may determine the axis corresponding to any of the operation axes as the target axis in response to detecting a selection operation acting on any of the operation axes included in the operation axes.

[0054] In some optional implementations of some embodiments, the execution subject may determine the target axis according to the axis directions corresponding to the operation axes through the following steps:

[0055] In the first step, in response to detecting a movement operation acting on any of the above scene elements, a movement direction corresponding to the above movement operation is determined as a target movement direction. The above movement operation may include but is not limited to at least one of the following: click, drag, and hover.

[0056] In a second step, in response to determining that the target moving direction is the same as any axis included in the above-mentioned axial directions, the above-mentioned arbitrary axis is determined as the target axis.

[0057] Step 104: Generate axial distance information corresponding to the target axis according to the position information of the operator.

[0058] In some embodiments, the execution subject may generate axial distance information corresponding to the target axis according to the position information of the operator. In practice, first, the execution subject may infinitely extend the operation axis of the target axis in both directions to obtain an extended operation axis. Then, for each non-arbitrary scene element included in the mixed reality space to be created, the following sub-steps are performed:

[0059] In the first sub-step, according to a preset collision detection algorithm, the extended operation axis and the non-arbitrary scene element are subjected to collision detection to obtain collision detection information. The preset collision detection algorithm may be an algorithm for detecting whether scene elements in a three-dimensional scene collide. The preset collision detection algorithm may be, but is not limited to, a raycast-based collision detection algorithm or a BVH (Bounding Volume Hierarchies)-based collision detection algorithm. The collision detection information may indicate whether the extended operation axis collides with a non-arbitrary scene element.

[0060] In a second sub-step, in response to determining that the collision detection information satisfies a preset collision condition, the center point coordinates of the element model corresponding to the non-arbitrary scene element are determined as the element intersection coordinates. The preset collision condition may be that the collision detection information indicates that the extended operation axis collides with the non-arbitrary scene element.

[0061] The third sub-step is to input the above-mentioned operator position information and the above-mentioned element intersection coordinates into a formula corresponding to a preset distance algorithm to obtain the distance value between elements. The above-mentioned preset distance algorithm may be an algorithm for calculating the distance between two points. For example, the above-mentioned preset distance algorithm may be a Euclidean distance algorithm.

[0062] In a fourth sub-step, the product of the distance value between the elements and the preset distance multiple is determined as the element distance information. The preset distance multiple may be a preset multiple of the distance between scene elements in the real space relative to the distance between scene elements in the mixed reality space to be created.

[0063] Finally, the determined distance information of each element is determined as the axial distance information corresponding to the above-mentioned target axial direction.

[0064] In some optional implementations of some embodiments, the execution subject may generate axial distance information corresponding to the target axial direction according to the position information of the operator through the following steps:

[0065] The first step is to extend the operating axis corresponding to the target axis to obtain an extended operating axis. In practice, the execution subject can infinitely extend the operating axis in both directions to obtain an extended operating axis.

[0066] The second step is to perform wall collision detection on the extended operating axis to obtain collision intersection information. In practice, the execution entity may perform wall collision detection on the extended operating axis through the preset collision detection algorithm to obtain collision intersection information. The collision intersection information may characterize the position of the collision intersection in the mixed reality space to be created. The collision intersection may be the intersection of the extended operating axis and the wall in the mixed reality space to be created. The collision intersection information may include but is not limited to the collision intersection coordinates. The collision intersection coordinates may be the coordinates of the collision intersection in the mixed reality space to be created.

[0067] The third step is to generate axial distance information based on the above-mentioned collision intersection information and the above-mentioned operator position information. In practice, first, the above-mentioned execution subject can input the collision intersection coordinates included in the above-mentioned collision intersection information and the above-mentioned operator position information into the above-mentioned preset distance algorithm to obtain the collision distance value. Then, the ratio of the above-mentioned collision distance value to the preset space ratio is determined as the axial distance information. Among them, the above-mentioned preset space ratio can be the scaling ratio of the real space to the mixed reality space to be created.

[0068] Thus, the relative position of any scene element in the real space can be obtained, so that it is convenient for the creator to place any scene element in the expected position.

[0069] Step 105 , displaying the axial distance information in the mixed reality space to be created so that the user can edit the position of any scene element in the mixed reality space to be created.

[0070] In some embodiments, the execution entity may display the axial distance information in the mixed reality space to be created so that the user can edit the position of any scene element in the mixed reality space to be created.

[0071] As an example, Figure 2-3 A schematic diagram of an application scenario of a scene element editing method based on a mixed reality space according to some embodiments of the present disclosure is shown. Figure 2-3 The subject is a room in the target mixed reality space. When the user selects any scene element 202 in the mixed reality space 201 to be created, the operator 203 can be displayed at the center point of the element model corresponding to any scene element 202, such as Figure 2 When the target axis selected by the user is the axis corresponding to the operation axis 204, the above-mentioned axial distance information 205 is displayed in the mixed reality space to be created, as shown in FIG. Figure 3 shown.

[0072] The above-mentioned embodiments of the present disclosure have the following beneficial effects: the scene element editing method based on the mixed reality space of some embodiments of the present disclosure can simplify the operation of the creation user and improve the experience of the browsing user. Specifically, the reason for the cumbersome operation of the creation user and the poor browsing user experience is that: directly drag the scene element to a certain position, when determining the position of the scene element, the mixed reality space has a spatial stereoscopic sense, and the position of the scene element in the mixed reality space is determined only according to the position coordinates. The relative position relationship between the set scene element and other elements in the mixed reality space cannot be determined, and the creation user needs to adjust the observation angle many times to determine whether the position is appropriate, resulting in cumbersome operation of the creation user, and the position actually edited by the creation user has a low fit with the expected position, resulting in a poor browsing user experience. Based on this, the scene element editing method based on the mixed reality space of some embodiments of the present disclosure, first, in response to detecting the selection operation of any scene element in the mixed reality space to be created, the operator position information is determined. Thus, when the user selects any scene element, the position of the operator can be obtained, which can be used to display the operator. Secondly, the operator is displayed at the position corresponding to the above operator position information in the mixed reality space to be created. Wherein, the above-mentioned operator includes various operation axes. Thus, the operator can be displayed in the mixed reality space to be created, so that it is convenient for the user to adjust the selected scene element. Then, according to the various axial directions corresponding to the above-mentioned various operation axes, the target axial direction is determined. Thus, the direction that the user needs to determine can be obtained, so as to determine the distance information in the corresponding direction. Afterwards, according to the above-mentioned operator position information, the axial distance information corresponding to the above-mentioned target axial direction is generated. Thus, the distance corresponding to the direction that the user needs to determine can be obtained, so that it can be used to prompt the user the relative position of any scene element with other scene elements in the mixed reality space to be created. Finally, the above-mentioned axial distance information is displayed in the above-mentioned mixed reality space to be created for the user to edit the position of the above-mentioned arbitrary scene element in the above-mentioned mixed reality space to be created. Thus, the relative position of any scene element with other scene elements in the mixed reality space to be created on the corresponding axis can be displayed, so that it is convenient for the user to edit the position of any scene element in the above-mentioned mixed reality space to be created. Also, when editing the position of a scene element in the mixed reality space to be created, the relative position relationship between the scene element selected by the creating user and other scene elements in the mixed reality space to be created is determined according to the arbitrary direction selected by the creating user, so that the creating user does not need to adjust the viewing angle multiple times to determine whether the position is appropriate, thereby simplifying the operation of the creating user. Also, because the creating user can place the selected scene element in the expected position according to the displayed distance information, the fit between the actual edited position of the scene element and the expected position is improved, thereby improving the browsing user's experience.

[0073] Further references Figure 4 , which shows a process 400 of another embodiment of a scene element editing method based on a mixed reality space. The process 400 of the scene element editing method based on a mixed reality space includes the following steps:

[0074] Step 401, in response to detecting a selection operation corresponding to any scene element in the mixed reality space to be created, determining operator position information.

[0075] Step 402: Display the operator at the location corresponding to the operator position information in the mixed reality space to be created.

[0076] Step 403: determine the target axis according to the axis directions corresponding to the operation axes.

[0077] Step 404: Generate axial distance information corresponding to the target axis according to the position information of the operator.

[0078] Step 405: Display the axial distance information in the mixed reality space to be created so that the user can edit the position of any scene element in the mixed reality space to be created.

[0079] In some embodiments, the specific implementation of steps 401-405 and the technical effects brought about can be referred to Figure 1 The corresponding steps 101-105 in the embodiments are not described in detail here.

[0080] Step 406: perform object collision detection on any scene element to obtain a collision detection result.

[0081] In some embodiments, the execution subject may perform object collision detection on any of the scene elements to obtain a collision detection result. In practice, the execution subject may perform object collision detection on any of the scene elements to obtain a collision detection result by using the preset collision detection algorithm. The collision detection result may characterize whether any scene element collides with any target scene element in the mixed reality space to be created. The target scene element may be a scene element in the mixed reality space to be created that is not any of the scene elements.

[0082] Step 407 , in response to determining that the collision detection result satisfies a preset detection condition, highlighting processing is performed on any scene element.

[0083] In some embodiments, the execution subject may perform highlighting processing on any of the scene elements in response to determining that the collision detection result satisfies a preset detection condition. The preset detection condition may be that the collision detection result indicates that any scene element collides with any target scene element in the mixed reality space to be created. In practice, first, the execution subject may perform copy processing on any of the scene elements in response to determining that the collision detection result satisfies the preset detection condition to obtain a copy scene element. The affine transformation of the copy scene element is the same as the affine transformation of the any scene element. Then, the preset highlight material is updated to the material of the copy scene element. The preset highlight material may be a pre-set material capable of highlighting the scene element. The brightness of the preset highlight material may be greater than the brightness of the material of any scene element. Afterwards, the preset depth test function is updated to the depth test function of the copy scene element. The preset depth test function may indicate that the test is passed when the fragment depth value is greater than the depth value of the buffer. Finally, the sum of the drawing priority corresponding to the any scene element and the preset increment is determined as the drawing priority of the copy scene element. The preset increment may be a preset value of the drawing priority increase. For example, the preset increment may be 1.

[0084] As an example, Figure 5 A schematic diagram of an application scenario of a scene element editing method based on a mixed reality space according to some other embodiments of the present disclosure is shown. Figure 5 The subject is a room in the target mixed reality space. When the scene element 502 "dinosaur" in the mixed reality space 501 to be created overlaps with the scene element 503 "table", that is, the foot of the "dinosaur" overlaps with the table, the foot of the scene element 502 "dinosaur" is highlighted, as shown in the shaded area.

[0085] from Figure 4 It can be seen that Figure 1 Compared with the description of some corresponding embodiments, Figure 4 The process 400 of the scene element editing method based on the mixed reality space in some corresponding embodiments embodies the step of expanding the displayed scene elements. Therefore, the schemes described in these embodiments can highlight the overlapping parts when the scene elements overlap with other scene elements, so as to prompt the creator of the relative position of the scene elements and other scene elements, thereby facilitating the creator to edit the position of the scene elements in the mixed reality space to be created.

[0086] Further references Figure 6 As an implementation of the methods shown in the above figures, the present disclosure provides some embodiments of a scene element editing device based on a mixed reality space. These device embodiments are similar to Figure 1 Corresponding to the method embodiments shown, the device can be specifically applied to various electronic devices.

[0087] like Figure 6 As shown, the scene element editing device 600 based on the mixed reality space of some embodiments includes: a first determining unit 601, a first display unit 602, a second determining unit 603, a generating unit 604 and a second display unit 605. The first determining unit 601 is configured to determine the position information of the operator in response to detecting the selection operation of any scene element in the mixed reality space to be created; the first display unit 602 is configured to display the operator at the position information of the operator in the mixed reality space to be created, wherein the operator includes various operating axes; the second determining unit 603 is configured to determine the target axis according to the various axes corresponding to the various operating axes; the generating unit 604 is configured to generate the axial distance information corresponding to the target axis according to the position information of the operator; the second display unit 605 is configured to display the axial distance information in the mixed reality space to be created for the user to edit the position of the any scene element in the mixed reality space to be created.

[0088] Optionally, the scene element editing device 600 based on the mixed reality space may further include a collision detection unit and a highlight display unit (not shown in the figure). The collision detection unit is configured to perform object collision detection on any of the above scene elements to obtain a collision detection result; the highlight display unit is configured to perform highlight display processing on any of the above scene elements in response to determining that the above collision detection result meets a preset detection condition.

[0089] Optionally, the first determining unit 601 may be further configured to: determine the center position information of the above-mentioned arbitrary scene elements; and determine the above-mentioned center position information as the operator position information.

[0090] Optionally, the first display unit 602 may be further configured to: determine the orientation of the operator; and display the operator at a location corresponding to the operator position information in the mixed reality space to be created according to the orientation.

[0091] Optionally, the second determination unit 603 can be further configured to: in response to detecting a movement operation acting on any of the above-mentioned scene elements, determine the movement direction corresponding to the above-mentioned movement operation as the target movement direction; in response to determining that the above-mentioned target movement direction is the same as any axis included in the above-mentioned axes, determine the above-mentioned any axis as the target axis.

[0092] Optionally, the first determination unit 601 may be further configured to: determine operator position information in response to detecting a selection operation acting on any scene element displayed in the mixed reality space to be created.

[0093] Optionally, the generation unit 604 can be further configured to: extend the operating axis corresponding to the above-mentioned target axis to obtain an extended operating axis; perform wall collision detection on the above-mentioned extended operating axis to obtain collision intersection information; and generate axial distance information based on the above-mentioned collision intersection information and the above-mentioned operator position information.

[0094] It can be understood that the units recorded in the scene element editing device 600 based on the mixed reality space and the reference Figure 1 Therefore, the operations, features and beneficial effects described above for the method are also applicable to the device 600 and the units included therein, and will not be described in detail here.

[0095] Reference below Figure 7 , which shows a structural schematic diagram of an electronic device 700 (such as a browser terminal) suitable for implementing some embodiments of the present disclosure. Figure 7 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0096] like Figure 7 As shown, the electronic device 700 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 701, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage device 708 into a random access memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the electronic device 700 are also stored. The processing device 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0097] Typically, the following devices may be connected to the I / O interface 705: an input device 706 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 707 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 708 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 709. The communication device 709 may allow the electronic device 700 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 7 The electronic device 700 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead. Figure 7 Each block shown in the figure may represent one device, or may represent multiple devices as required.

[0098] In particular, according to some embodiments of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, some embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In some such embodiments, the computer program can be downloaded and installed from the network through the communication device 709, or installed from the storage device 708, or installed from the ROM 702. When the computer program is executed by the processing device 701, the above-mentioned functions defined in the method of some embodiments of the present disclosure are executed.

[0099] It should be noted that the computer-readable medium recorded in some embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In some embodiments of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0100] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (Hyper Text Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0101] The computer-readable medium may be included in the electronic device; or it may exist independently without being installed in the electronic device. The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: determines the operator position information in response to detecting a selection operation corresponding to any scene element in the mixed reality space to be created; displays the operator at the position corresponding to the operator position information in the mixed reality space to be created, wherein the operator includes various operation axes; determines the target axis according to the various axes corresponding to the various operation axes; generates the axial distance information corresponding to the target axis according to the operator position information; displays the axial distance information in the mixed reality space to be created for the user to edit the position of any scene element in the mixed reality space to be created.

[0102] Computer program code for performing the operations of some embodiments of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0103] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0104] The units described in some embodiments of the present disclosure may be implemented by software or by hardware. The described units may also be provided in a processor, for example, may be described as: a processor comprising a first determination unit, a first display unit, a second determination unit, a generation unit, and a second display unit. Among them, the names of these units do not constitute a limitation on the unit itself in certain circumstances, for example, the first determination unit may also be described as "a unit that determines the position information of the operator in response to detecting a selection operation corresponding to any scene element in the mixed reality space to be created".

[0105] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0106] The above descriptions are only some preferred embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by a specific combination of the above-mentioned technical features, but should also cover other technical solutions formed by any combination of the above-mentioned technical features or their equivalent features without departing from the above-mentioned inventive concept. For example, the above-mentioned features are replaced with the technical features with similar functions disclosed in the embodiments of the present disclosure (but not limited to) and the technical solutions formed.

Claims

1. A scene element editing method based on a mixed reality space, comprising: In response to detecting a selection operation corresponding to any scene element in the mixed reality space to be created, determining operator position information; Displaying an operator at a position corresponding to the operator position information in the mixed reality space to be created, wherein the operator includes various operation axes; Determine a target axial direction according to the axial directions corresponding to the operating axes; generating axial distance information corresponding to the target axial direction according to the position information of the operator; The axial distance information is displayed in the mixed reality space to be created so that a user can edit the position of any scene element in the mixed reality space to be created.

2. The method according to claim 1, wherein: The method further comprises: Performing object collision detection on any scene element to obtain a collision detection result; In response to determining that the collision detection result meets a preset detection condition, highlighting processing is performed on the arbitrary scene element.

3. The method according to claim 1, wherein: The determining of the operator position information comprises: Determining the center position information of any scene element; The center position information is determined as the operator position information.

4. The method according to claim 1, wherein: The step of displaying the operator at a location corresponding to the operator position information in the mixed reality space to be created includes: determining the orientation of the manipulator; According to the orientation, the operator is displayed at a location corresponding to the operator position information in the mixed reality space to be created.

5. The method according to claim 1, wherein: The determining of the target axis according to the axis directions corresponding to the operation axes includes: In response to detecting a movement operation acting on the arbitrary scene element, determining a movement direction corresponding to the movement operation as a target movement direction; In response to determining that the target movement direction is the same as any axial direction included in the respective axial directions, the arbitrary axial direction is determined as a target axial direction.

6. The method according to claim 1, wherein: The step of determining the position information of the operator in response to detecting a selection operation corresponding to any scene element in the mixed reality space to be created includes: In response to detecting a selection operation acting on any scene element displayed in the mixed reality space to be created, operator position information is determined.

7. The method according to claim 1, wherein: The step of generating axial distance information corresponding to the target axial direction according to the position information of the operator includes: Extending the operating axis corresponding to the target axial direction to obtain an extended operating axis; Performing wall collision detection processing on the extended operating axis to obtain collision intersection information; Axial distance information is generated according to the collision intersection information and the operator position information.

8. A scene element editing device based on a mixed reality space, comprising: A first determining unit is configured to determine operator position information in response to detecting a selection operation corresponding to any scene element in the mixed reality space to be created; A first display unit is configured to display an operator at a position corresponding to the operator position information in the mixed reality space to be created, wherein the operator includes various operation axes; A second determining unit is configured to determine a target axial direction according to each axial direction corresponding to each operating axis; a generating unit configured to generate axial distance information corresponding to the target axial direction according to the operator position information; The second display unit is configured to display the axial distance information in the mixed reality space to be created so that a user can edit the position of any scene element in the mixed reality space to be created.

9. An electronic device, comprising: one or more processors; a storage device having one or more programs stored thereon, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 7.

10. A computer readable medium having a computer program stored thereon, wherein: When the computer program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images