Screen configuration and display method and device of mixed reality space and mixed reality terminal

Abstract

The embodiment of the invention discloses a screen configuration method and device for a mixed reality space, a display method and device and a mixed reality terminal. A specific embodiment of the method comprises the steps of displaying a preset screen element list in a scene editing page in response to detection of a selection operation acting on a media screen editing control displayed in the scene editing page of a target mixed reality space; in response to detection of a dragging operation acting on any preset screen element in the preset screen element list, the dragging operation is released at a position, corresponding to the target mixed reality space, in the scene editing page, and any preset screen element is displayed at the release position; and in response to the detected screen configuration operation corresponding to the any preset screen element, configuring the any preset screen element according to the screen configuration information corresponding to the screen configuration operation, and using the configured any preset screen element as the screen element in the target mixed reality space to play the media asset information. According to the embodiment, the flexibility of screen element configuration is improved.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the field of mixed reality technology, and in particular to screen configuration, display method, device and mixed reality terminal of a mixed reality space. Background Art

[0002] A mixed reality scene is a three-dimensional scene edited by a user in a mixed reality space. At present, when creating a mixed reality scene, the method usually adopted is: based on the collected spatial data, the spatial structure is automatically identified to construct a mixed reality scene in the mixed reality space. If the collected spatial data corresponds to the data of a real electronic screen, a corresponding screen element that can cover the electronic screen is constructed in the mixed reality scene.

[0003] However, the inventors have found that when the above method is adopted, the following technical problems often occur: the construction of screen elements needs to be attached to a real electronic screen, resulting in poor flexibility in the configuration of screen elements, and the size of the screen elements is also limited by the size of the real electronic screen, further resulting in poor flexibility in the configuration of screen elements.

[0004] The above information disclosed in this Background section is only for enhancement of understanding of the background of the inventive concept and therefore it may contain information that does not form the prior art that is already known in this country to a person of ordinary skill in the art. Summary of the invention

[0005] The content of this disclosure is used to introduce concepts in a brief form, which will be described in detail in the detailed implementation section below. The content of this disclosure is not intended to identify the key features or essential features of the technical solution claimed for protection, nor is it intended to limit the scope of the technical solution claimed for protection.

[0006] Some embodiments of the present disclosure propose a screen configuration of a mixed reality space, a screen display method of a mixed reality space, an electronic device, a mixed reality terminal and a computer-readable medium to solve one or more of the technical problems mentioned in the above background technology section.

[0007] In a first aspect, some embodiments of the present disclosure provide a screen configuration method for a mixed reality space, the method comprising: in response to detecting a selection operation of a media screen editing control displayed in a scene editing page acting on a target mixed reality space, displaying a preset screen element list in the above-mentioned scene editing page, wherein each preset screen element is displayed in the above-mentioned preset screen element list; in response to detecting a drag operation acting on any preset screen element in the above-mentioned preset screen element list, and the above-mentioned drag operation is released at a position corresponding to the above-mentioned target mixed reality space in the above-mentioned scene editing page, displaying the above-mentioned any preset screen element at the released position; in response to detecting a screen configuration operation corresponding to the above-mentioned any preset screen element, configuring the above-mentioned any preset screen element according to the screen configuration information corresponding to the above-mentioned screen configuration operation, wherein the configured any preset screen element is used as a screen element in the target mixed reality space to play media information.

[0008] Optionally, the method also includes: in response to detecting a drag operation acting on any preset screen element in the above-mentioned preset screen element list, and the above-mentioned drag operation is released at a position corresponding to the above-mentioned target mixed reality space in the above-mentioned scene editing page, displaying screen element information corresponding to the above-mentioned any preset screen element in the above-mentioned scene editing page.

[0009] Optionally, the scene editing page also displays a media information upload control corresponding to any of the preset screen elements; and the method further includes: in response to detecting a selection operation acting on the media information upload control, displaying a media information selection window for selecting media information; in response to detecting a confirmation operation corresponding to the selected media information, displaying an upload progress window, wherein the upload progress window displays an upload progress bar and the uploaded media information.

[0010] Optionally, the method also includes: in response to determining that the progress bar state of the upload progress bar is the upload completion state, displaying a background color configuration control in the upload progress window; in response to determining that the media information displayed in the upload progress window satisfies a preset end upload order condition, displaying a confirmation control in the upload progress window; in response to detecting a color configuration operation acting on the background color configuration control, determining the background color corresponding to the color configuration operation as a pre-selected background color; in response to detecting a selection operation acting on the confirmation control, determining the pre-selected background color as the background color of any of the preset screen elements, and determining at least one of the uploaded media information as the playback content corresponding to any of the preset screen elements.

[0011] Optionally, the method also includes: in response to determining that the media information displayed in the above-mentioned upload progress window meets the preset front-end upload order condition, displaying a cancel control in the above-mentioned upload progress window; in response to detecting a selection operation acting on the above-mentioned cancel control or a closing operation acting on the above-mentioned upload progress window, and the progress bar status of the above-mentioned upload progress bar is an uploading status, clearing each uploaded media information corresponding to the upload progress bar.

[0012] Optionally, the selected media information includes at least one media information, and the at least one media information is a picture; and the method also includes: in response to determining that there is a picture to be uploaded or an uploaded picture corresponding to the upload progress bar before the media information displayed in the upload progress window, displaying a previous picture switching control in the upload progress window; in response to determining that there is a picture to be uploaded or an uploaded picture corresponding to the upload progress bar after the media information displayed in the upload progress window, displaying a subsequent picture switching control in the upload progress window.

[0013] Optionally, the number of selected media information is a preset number, and the selected media information is one of the following: video, live stream, web page; and the method also includes: in response to detecting that the media information is successfully uploaded, displaying the successfully uploaded media information in the above-mentioned upload progress window, wherein at least one playback control control is displayed in the displayed media information.

[0014] Optionally, the scene editing page also displays a list of playback contents corresponding to any of the preset screen elements, and the playback content list displays at least one playback content corresponding to any of the preset screen elements; and the method also includes: in response to detecting a deletion operation acting on any of the at least one playback content, deleting the any playback content in the screen element displayed on the scene editing page, and deleting the any playback content in the playback content list.

[0015] Optionally, the method also includes: in response to detecting a replacement operation acting on any playback content among the at least one playback content, displaying a replacement window for selecting replacement media information; in response to determining that the any playback content is a picture, determining the number of playback contents included in the playback content list; in response to determining that the number is greater than a preset number, determining whether the replacement media information is a picture; in response to determining that the replacement media information is a picture, determining the replacement media information as the media information to be replaced; in response to detecting a confirmation operation corresponding to the media information to be replaced, determining the media information to be replaced as the playback content used to replace the any playback content.

[0016] Optionally, the method also includes: in response to determining that the amount of uploaded media information corresponding to the above-mentioned screen elements is greater than a preset amount, displaying a carousel time configuration control in the above-mentioned scene editing page; in response to detecting a time configuration operation corresponding to the above-mentioned carousel time configuration control, determining the duration corresponding to the above-mentioned time configuration operation as the carousel interval duration of each media information corresponding to the above-mentioned screen elements.

[0017] Optionally, each media information available for selection corresponds to an operation permission, and the above-mentioned scene editing page also displays a media viewing control; and the method also includes: in response to detecting a selection operation acting on the above-mentioned media viewing control, displaying a media information list, wherein the operation permission corresponding to each media information in the above-mentioned media information list corresponds to the user permission of the current user, and the above-mentioned media information list also displays an upload control; in response to detecting a selection operation acting on the above-mentioned upload control, displaying an upload window for the above-mentioned current user to upload the media information; and displaying each uploaded media information in the above-mentioned media information list.

[0018] In a second aspect, some embodiments of the present disclosure provide a screen display method for a mixed reality space, which is applied to a mixed reality terminal, wherein the mixed reality terminal includes a head-mounted display device, and the method includes: displaying a mixed reality scene of a target mixed reality space in the head-mounted display device, wherein the target mixed reality space includes screen elements, and the screen elements are configured by the method described in any implementation method of the first aspect; in response to determining that the current posture information of the head-mounted display device meets the display conditions of the screen elements, playing the media information pre-configured in the screen elements in the screen elements.

[0019] Optionally, the above-mentioned playing of the media information pre-configured in the above-mentioned screen element in the above-mentioned screen element includes: in response to determining that the above-mentioned media information pre-configured in the above-mentioned screen element is a number of pictures greater than a preset number, determining a carousel interval duration corresponding to the above-mentioned pictures; and carouseling the above-mentioned pictures in the above-mentioned screen element according to the above-mentioned carousel interval duration.

[0020] In a third aspect, some embodiments of the present disclosure provide an electronic device comprising: one or more processors; a storage device on which one or more programs are stored, and when the one or more programs are executed by the one or more processors, the one or more processors implement the method described in any implementation manner of the above-mentioned first aspect.

[0021] In a fourth aspect, some embodiments of the present disclosure provide a mixed reality terminal, comprising: a head-mounted display device for allowing a user to browse a mixed reality scene; the mixed reality terminal is configured to execute the method described in any implementation manner of the second aspect.

[0022] In a fifth aspect, some embodiments of the present disclosure provide a computer-readable medium having a computer program stored thereon, wherein when the program is executed by a processor, the method described in any implementation of the first aspect or the second aspect is implemented.

[0023] The above-mentioned embodiments of the present disclosure have the following beneficial effects: through the screen configuration method of the mixed reality space of some embodiments of the present disclosure, the flexibility of the screen element configuration is improved. Specifically, the reason for the poor flexibility of the screen element configuration is that the construction of the screen element needs to be attached to the real electronic screen, resulting in poor flexibility of the screen element configuration, and the size of the screen element is also limited by the size of the real electronic screen, which further leads to poor flexibility of the screen element configuration. Based on this, the screen configuration method of the mixed reality space of some embodiments of the present disclosure, first, in response to detecting the selection operation of the media screen editing control displayed in the scene editing page acting on the target mixed reality space, a preset screen element list is displayed in the above scene editing page. Among them, each preset screen element is displayed in the above preset screen element list. Thus, when entering the media screen editing mode, each preset screen element can be automatically displayed for user selection. Then, in response to detecting a drag operation acting on any preset screen element in the above preset screen element list, and the above drag operation is released at the position corresponding to the above target mixed reality space in the above scene editing page, the above any preset screen element is displayed at the release position. Thus, when the user drags the preset screen element to the editing position corresponding to the mixed reality space to be edited, the preset screen element can be automatically displayed at the release position of the drag. Finally, in response to detecting the screen configuration operation corresponding to any of the above preset screen elements, any of the above preset screen elements is configured according to the screen configuration information corresponding to the above screen configuration operation. Among them, any preset screen element that has been configured is used as a screen element in the target mixed reality space to play media information. Thus, the user can customize the preset screen element after dragging for playing media information in the screen element. Also because the preset screen elements can be customized by the user in the target mixed reality space, it is not necessary to rely on the real electronic screen when constructing the screen elements, thereby improving the flexibility of the screen element configuration. Also because the size of the screen element does not need to be configured according to the size of the real electronic screen, the flexibility of the screen element configuration is further improved. Thus, the flexibility of the screen element configuration is improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that components and elements are not necessarily drawn to scale.

[0025] Figure 1 is a flowchart of some embodiments of a screen configuration method for a mixed reality space according to the present disclosure;

[0026] Figure 2 is a schematic diagram of a preset screen element list of a screen configuration method for a mixed reality space according to some embodiments of the present disclosure;

[0027] Figure 3 is a schematic diagram of an upload progress window of a screen configuration method for a mixed reality space according to some embodiments of the present disclosure;

[0028] Figure 4 is another schematic diagram of an upload progress window of a screen configuration method for a mixed reality space according to some embodiments of the present disclosure;

[0029] Figure 5 It is a structural schematic diagram of some embodiments of the screen display method of the mixed reality space according to the present disclosure;

[0030] Figure 6 is a schematic diagram of the structure of an electronic device suitable for implementing some embodiments of the present disclosure;

[0031] Figure 7 It is a structural diagram of a mixed reality terminal suitable for implementing some embodiments of the present disclosure. DETAILED DESCRIPTION

[0032] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0033] It should also be noted that, for ease of description, only the parts related to the invention are shown in the drawings. In the absence of conflict, the embodiments and features in the embodiments of the present disclosure can be combined with each other.

[0034] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0035] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0036] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0037] The present disclosure will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments.

[0038] Figure 1 The process 100 of some embodiments of the screen configuration method of the mixed reality space according to the present disclosure is shown. The screen configuration method of the mixed reality space includes the following steps:

[0039] Step 101, in response to detecting a selection operation of a media screen editing control displayed in a scene editing page acting on a target mixed reality space, displaying a preset screen element list in the scene editing page.

[0040] In some embodiments, the execution subject (e.g., a computing device) of the screen configuration method of the mixed reality space may display a preset screen element list in the scene editing page in response to detecting a selection operation of a media screen editing control displayed in a scene editing page acting on the target mixed reality space. Among them, the target mixed reality space may be the mixed reality space currently edited by the user. The scene editing page may be a graphical user interface when editing the target mixed reality space. The media screen editing control may be a control for displaying information about editing screen elements. The preset screen element list may be a list of pre-configured screen elements of different styles that can be selected by the user. Each preset screen element is displayed in the preset screen element list. For example, the preset screen element list may include a preset screen element of a movie border style. The screen element may be a screen style for displaying playback content within a border. The execution subject may be a browser side or an application side.

[0041] In practice, the media screen editing control may be displayed in a left column in the scene editing page. The execution subject may display the preset screen element list in a side expansion column corresponding to the media screen editing control.

[0042] As an example, the list of preset screen elements displayed in the scene editing page can be referred to Figure 2 . Figure 2In the example, a media screen editing control 202 is displayed in the left column of the scene editing page 201. A preset screen element list 203 is displayed in the right expanded column of the media screen editing control 202.

[0043] Step 102, in response to detecting a drag operation on any preset screen element in the preset screen element list, and the drag operation is released at a position corresponding to the target mixed reality space in the scene editing page, displaying any preset screen element at the released position.

[0044] In some embodiments, the execution subject may respond to detecting a drag operation acting on any preset screen element in the preset screen element list, and the drag operation is released at a position corresponding to the target mixed reality space in the scene editing page, and display the any preset screen element at the release position. Among them, the drag operation may be an operation of first selecting a preset screen element and then dragging the selected preset screen element to another position. The release position may be a position where the dragging of the selected preset screen element is canceled. For example, the drag operation may be a moving operation with the left mouse button pressed and held. For another example, the drag operation may be a moving operation after double-clicking. The release position may be the position of the mouse pointer in the target mixed reality space when the left mouse button is released. In practice, the execution subject may display any preset screen element fixedly at the release position.

[0045] Step 103 , in response to detecting a screen configuration operation corresponding to any preset screen element, configuring any preset screen element according to screen configuration information corresponding to the screen configuration operation.

[0046] In some embodiments, the above-mentioned execution subject may configure any of the above-mentioned preset screen elements according to the screen configuration information corresponding to the above-mentioned screen configuration operation in response to detecting the screen configuration operation corresponding to any of the above-mentioned preset screen elements. Among them, the above-mentioned screen configuration operation may be a configuration operation for any of the above-mentioned preset screen elements. The above-mentioned screen configuration operation may include but is not limited to at least one of the following: size configuration operation, shape configuration operation, color configuration operation, ratio configuration operation, placement angle configuration operation. The above-mentioned screen configuration information may be attribute-related information of the configured screen element. The above-mentioned screen configuration information may include but is not limited to: screen side length, screen contour coordinate point, screen color, screen ratio, placement angle. In practice, the above-mentioned execution subject may set the various attributes of any of the above-mentioned preset screen elements according to the above-mentioned screen configuration information. Among them, any preset screen element that has been configured is used as a screen element in the target mixed reality space to play media information.

[0047] Optionally, the execution subject may also respond to the detection of a drag operation acting on any preset screen element in the preset screen element list, and the drag operation is released at the position corresponding to the target mixed reality space in the scene editing page, and the screen element information corresponding to any preset screen element is displayed in the scene editing page. Among them, the screen element information may be the attribute information of any preset screen element. The screen element information may include but is not limited to at least one of the following: style identification, thumbnail, aspect ratio. In practice, the execution subject may display the screen element information in the right column of the scene editing page. Optionally, after the user selects the aspect ratio, each aspect ratio may be displayed in the form of a drop-down list for the user to select, so as to adjust the aspect ratio of the screen element. Thus, after the user drags the preset screen element to the position corresponding to the target mixed reality space, the screen element information of the preset screen element may be automatically displayed.

[0048] Optionally, the scene editing page further displays a media resource information upload control corresponding to any of the preset screen elements. The media resource information upload control may be a control for uploading media resource information played in any of the preset screen elements. When any of the preset screen elements is selected, the media resource information upload control may be displayed in the right column of the scene editing page.

[0049] Optionally, the execution subject may also display a media information selection window for selecting media information in response to detecting a selection operation acting on the media information upload control. The media information selection window may be a file selection window for a user to select media information for uploading. Here, the media information may be information for playing. The media information may include but is not limited to at least one of the following: pictures and videos. The format and file size of the selected media information may respectively meet the preset format condition and the preset size restriction condition. Here, the specific setting of the preset format condition and the preset size restriction condition is not limited. Then, in response to detecting a confirmation operation corresponding to the selected media information, an upload progress window is displayed. The upload progress window may be a window for displaying the upload progress of the media information to be uploaded. The upload progress bar and the uploaded media information are displayed in the upload progress window. The upload progress bar represents the upload progress of all the media information to be uploaded. The uploaded media information may be switched to display by a switching operation. If the media information corresponding to the screen element is not configured, the screen element may be used to display the default media information. The default media information may be pre-configured. In this way, the user can view the upload progress of the media asset information.

[0050] Optionally, the execution subject may display a background color configuration control in the upload progress window in response to determining that the progress bar state of the upload progress bar is in the upload completion state. When the progress bar state is in the upload completion state, it may indicate that all media asset information to be uploaded has been uploaded. The background color configuration control may be a control for configuring the color of the background image in the screen element. As an example, the upload progress window may refer to Figure 3 . Figure 3 In the upload progress window 301 , uploaded media asset information 302 and a background color configuration control 303 are displayed.

[0051] Secondly, in response to determining that the media information displayed in the upload progress window meets the preset end upload order condition, a confirmation control is displayed in the upload progress window. The preset end upload order condition may be that the number of selected media information is greater than 1 and the media information is the last one. The preset end upload order condition may also be that the number of selected media information is 1. The confirmation control may be a control for confirming and closing the window. As an example, refer to Figure 4 , the uploaded media asset information 304 displayed in the upload progress window 301 can meet the preset end upload order condition, then the confirmation control 305 can be displayed in the upload progress window 301. It can be understood that when the media asset information is not uploaded, the confirmation control cannot be selected. Then, in response to detecting the color configuration operation acting on the above-mentioned background color configuration control, the background color corresponding to the above-mentioned color configuration operation is determined as the pre-selected background color. Among them, the above-mentioned color configuration operation can be an operation for configuring the background color. For example, the above-mentioned color configuration operation can be an operation for selecting a preset color. For another example, the above-mentioned color configuration operation can also be an operation of drawing colors from other positions in the page to configure the background color. Afterwards, in response to detecting the selection operation acting on the above-mentioned confirmation control, the above-mentioned pre-selected background color is determined as the background color of the above-mentioned any preset screen element, and the at least one media asset information uploaded is determined as the playback content corresponding to the above-mentioned any preset screen element.

[0052] Optionally, the execution subject may also display a cancel control in the upload progress window in response to determining that the media asset information displayed in the upload progress window meets the preset front-end upload order condition. The preset front-end upload order condition may be that the number of selected media asset information is greater than 1, and the media asset information is the first one. The preset front-end upload order condition may also be that the number of selected media asset information is 1. The cancel control may be a control for canceling the media asset information uploaded this time and closing the window. Secondly, the execution subject may clear the uploaded media asset information corresponding to the upload progress bar in response to detecting a selection operation acting on the cancel control or a closing operation acting on the upload progress window, and the progress bar state of the upload progress bar is in the uploading state. Optionally, the execution subject may also clear the uploaded media asset information corresponding to the upload progress bar in response to detecting a refresh operation corresponding to the upload progress window, and the progress bar state of the upload progress bar is in the uploading state. Thus, the uploaded media asset information can be cleared during intermittent uploading.

[0053] Optionally, the selected media asset information may include at least one media asset information, and the at least one media asset information is all pictures. When the at least one media asset information is all pictures, the number of the at least one media asset information may be less than a preset value.

[0054] Optionally, the execution subject may display a previous picture switching control in the upload progress window in response to determining that there are pictures to be uploaded or pictures that have been uploaded that correspond to the upload progress bar before the media information displayed in the upload progress window. In practice, the execution subject may display the previous picture switching control on the left side below the area where the media information is displayed. For example, the previous picture switching control may be a button that displays "Previous". Secondly, in response to determining that there are pictures to be uploaded or pictures that have been uploaded that correspond to the upload progress bar after the media information displayed in the upload progress window, a subsequent picture switching control may be displayed in the upload progress window. In practice, the execution subject may display the subsequent picture switching control on the right side below the area where the media information is displayed. For example, the subsequent picture switching control may be a button that displays "Next". Thus, the user can switch to view each picture through the picture switching control.

[0055] Optionally, the number of the selected media resource information is a preset number, and the selected media resource information is one of the following: video, live stream, web page. The preset number may be 1.

[0056] Optionally, the execution subject may display the successfully uploaded media information in the upload progress window in response to detecting that the media information is successfully uploaded. Among them, at least one playback control control is displayed in the displayed media information. When the displayed media information is a video, the at least one playback control control may include but is not limited to at least one of the following: a playback on / off switch control, a progress adjustment control, and a volume adjustment control. When the displayed media information is a live stream, the at least one playback control control may include but is not limited to at least one of the following: a bullet screen display control control, a live broadcast switching control, and a volume adjustment control. When the displayed media information is a web page, the at least one playback control control may include but is not limited to at least one of the following: a web browsing sliding control and a font size configuration control. It should be noted that when the selected media information is a video, a live stream, or a web page, no other media information can be selected. When the selected media information is a picture, only media information of the picture type can be selected within a preset number threshold.

[0057] Optionally, the scene editing page also displays a list of playback contents corresponding to any of the preset screen elements. The playback content list displays at least one playback content corresponding to any of the preset screen elements. Each playback content corresponds to a previously selected media asset information. Each playback content displayed in the playback content list is used to be played in any of the preset screen elements.

[0058] Optionally, the execution subject may delete the arbitrary playback content in the screen element displayed on the scene editing page and delete the arbitrary playback content in the playback content list in response to detecting a deletion operation acting on any playback content in the at least one playback content. Here, the deletion operation may be a selection operation acting on a deletion control corresponding to the arbitrary playback content. Thus, the playback content displayed in the screen element and the playback content list may be deleted synchronously.

[0059] Optionally, the execution subject may display a replacement window for selecting replacement media information in response to detecting a replacement operation acting on any of the at least one playback content. The replacement operation may be a selection operation acting on a replacement control corresponding to the arbitrary playback content. It is understandable that the delete control and the replacement control may be directly displayed at the position corresponding to the arbitrary playback content in the page, or may be displayed in a list of operation items popped up by right-clicking. Next, in response to determining that the arbitrary playback content is a picture, the number of playback contents included in the playback content list may be determined. Then, in response to determining that the number is greater than a preset number, it may be determined whether the replacement media information is a picture. The preset number may be 1. Afterwards, in response to determining that the replacement media information is a picture, the replacement media information may be determined as the media information to be replaced. Finally, in response to detecting a confirmation operation corresponding to the media information to be replaced, the media information to be replaced may be determined as the playback content for replacing the arbitrary playback content. Thus, when multiple pictures are pre-selected, the user can only select a picture to replace the previously selected picture. When one picture is pre-selected, the user can select a picture or a video to replace the previously selected picture.

[0060] Optionally, the execution entity may display a carousel time configuration control in the scene editing page in response to determining that the number of uploaded media information corresponding to the screen element is greater than a preset number. The preset number may be 1. The carousel time configuration control may be a control for configuring the duration of the carousel. Secondly, in response to detecting a time configuration operation corresponding to the carousel time configuration control, the duration corresponding to the time configuration operation may be determined as the carousel interval duration of each media information corresponding to the screen element. The time configuration operation may be an operation of selecting a pre-configured duration or an operation of inputting a duration. Thus, the carousel duration may be configured when multiple media information are selected.

[0061] Optionally, each media asset information available for selection corresponds to an operation permission. The operation permission may include but is not limited to at least one of the following: view, delete, upload. The above scene editing page also displays a media asset viewing control. The media asset viewing control may be displayed in the left column of the scene editing page.

[0062] Optionally, the execution entity may display a media information list in response to detecting a selection operation on the media viewing control. The operation permissions corresponding to each piece of media information in the media information list correspond to the user permissions of the current user. An upload control is also displayed in the media information list. Then, in response to detecting a selection operation on the upload control, an upload window may be displayed for the current user to upload media information. Finally, each piece of uploaded media information may be displayed in the media information list. It should be noted that the number of pieces of media information uploaded each time may be less than a preset value. For example, the preset value may be 9. Each piece of media information in the media information list may be media information uploaded and in use by users in the organization corresponding to the current user. In this way, the user can view all viewable media information.

[0063] The above-mentioned embodiments of the present disclosure have the following beneficial effects: through the screen configuration method of the mixed reality space of some embodiments of the present disclosure, the flexibility of the screen element configuration is improved. Specifically, the reason for the poor flexibility of the screen element configuration is that the construction of the screen element needs to be attached to the real electronic screen, resulting in poor flexibility of the screen element configuration, and the size of the screen element is also limited by the size of the real electronic screen, which further leads to poor flexibility of the screen element configuration. Based on this, the screen configuration method of the mixed reality space of some embodiments of the present disclosure, first, in response to detecting the selection operation of the media screen editing control displayed in the scene editing page acting on the target mixed reality space, a preset screen element list is displayed in the above scene editing page. Among them, each preset screen element is displayed in the above preset screen element list. Thus, when entering the media screen editing mode, each preset screen element can be automatically displayed for user selection. Then, in response to detecting a drag operation acting on any preset screen element in the above preset screen element list, and the above drag operation is released at the position corresponding to the above target mixed reality space in the above scene editing page, the above any preset screen element is displayed at the release position. Thus, when the user drags the preset screen element to the editing position corresponding to the mixed reality space to be edited, the preset screen element can be automatically displayed at the release position of the drag. Finally, in response to detecting the screen configuration operation corresponding to any of the above preset screen elements, any of the above preset screen elements is configured according to the screen configuration information corresponding to the above screen configuration operation. Among them, any preset screen element that has been configured is used as a screen element in the target mixed reality space to play media information. Thus, the user can customize the preset screen element after dragging for playing media information in the screen element. Also because the preset screen elements can be customized by the user in the target mixed reality space, it is not necessary to rely on the real electronic screen when constructing the screen elements, thereby improving the flexibility of the screen element configuration. Also because the size of the screen element does not need to be configured according to the size of the real electronic screen, the flexibility of the screen element configuration is further improved. Thus, the flexibility of the screen element configuration is improved.

[0064] Further references Figure 5 , which shows a process 500 of another embodiment of a screen display method for a mixed reality space. The process 500 of the screen display method for a mixed reality space, applied to a mixed reality terminal, includes the following steps:

[0065] Step 501: Display a mixed reality scene of a target mixed reality space in a head-mounted display device.

[0066] In some embodiments, the execution subject of the screen display method of the mixed reality space (for example, the mixed reality terminal) can display the mixed reality scene of the target mixed reality space in the above-mentioned head-mounted display device. Among them, the above-mentioned mixed reality terminal includes a head-mounted display device. The head-mounted display device can be MR glasses. Optionally, the above-mentioned mixed reality terminal may also include a mobile device. The above-mentioned mobile device can be used to provide computing power and / or electricity for the head-mounted display device. For example, the above-mentioned mobile device may include but is not limited to one of the following: a mobile phone, a tablet computer, and a smart terminal. The above-mentioned mixed reality scene may be the above-mentioned target mixed reality space after loading. Various scene elements may be displayed in the above-mentioned mixed reality scene. The above-mentioned target mixed reality space may contain at least one screen element. Each screen element is Figure 1 The steps in the corresponding embodiments are configured.

[0067] Step 502: In response to determining that the current posture information of the head mounted display device meets the display condition of the screen element, play the media asset information pre-configured in the screen element in the screen element.

[0068] In some embodiments, the execution entity may play the media information pre-configured in the screen element in response to determining that the current posture information of the head-mounted display device meets the display conditions of the screen element. The posture information may be multi-degree-of-freedom position and posture information. The posture information may be 3DOF or 6DOF posture data. The display condition may be that the screen element is within the field of view corresponding to the posture information, that is, the user can see the screen element. In practice, the execution entity may play the video in a loop in response to determining that the playback content in the screen element is a video.

[0069] Optionally, the execution subject may display the selected media information in full screen mode in response to detecting a selection operation on the media information displayed in the screen element. Here, the selection operation of the viewing user may include but is not limited to at least one of the following: gesture selection, voice selection, touch selection.

[0070] In some optional implementations of some embodiments, the execution subject may play the media resource information pre-configured in the screen element in the screen element through the following steps:

[0071] In the first step, in response to determining that the media asset information pre-configured in the screen element is greater than a preset number of pictures, a carousel interval duration corresponding to the pictures is determined, wherein the preset number may be 1. The carousel interval duration may be pre-configured.

[0072] The second step is to rotate the above pictures in the above screen elements according to the above rotation interval, so that the viewing user can view the rotation pictures.

[0073] Figure 5 The process 500 of the screen configuration method of the mixed reality space in some corresponding embodiments embodies the steps of playing the playback content of the screen element. Therefore, the scheme described in these embodiments can enable the viewing user to view the playback content pre-configured in the screen element.

[0074] Reference below Figure 6 , which shows a schematic diagram of the structure of an electronic device 600 suitable for implementing some embodiments of the present disclosure. The electronic devices in some embodiments of the present disclosure may include but are not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle terminals (such as vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Figure 6 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0075] like Figure 6 As shown, the electronic device 600 may include a processing device 601 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage device 608 into a random access memory (RAM) 603. In the RAM 603, various programs and data required for the operation of the electronic device 600 are also stored. The processing device 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0076] Typically, the following devices may be connected to the I / O interface 605: an input device 606 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 607 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 608 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 609. The communication device 609 may allow the electronic device 600 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 6 The electronic device 600 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead. Figure 6 Each block shown in the figure may represent one device, or may represent multiple devices as required.

[0077] In particular, according to some embodiments of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, some embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In some such embodiments, the computer program can be downloaded and installed from the network through the communication device 609, or installed from the storage device 608, or installed from the ROM 602. When the computer program is executed by the processing device 601, the above-mentioned functions defined in the method of some embodiments of the present disclosure are executed.

[0078] It should be noted that the computer-readable medium recorded in some embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In some embodiments of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0079] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0080] The computer-readable medium may be included in the electronic device; or it may exist independently without being installed in the electronic device. The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: in response to detecting a selection operation of a media screen editing control displayed in a scene editing page acting on a target mixed reality space, a preset screen element list is displayed in the scene editing page, wherein each preset screen element is displayed in the preset screen element list; in response to detecting a drag operation acting on any preset screen element in the preset screen element list, and the drag operation is released at a position corresponding to the target mixed reality space in the scene editing page, the preset screen element is displayed at the released position; in response to detecting a screen configuration operation corresponding to any preset screen element, the preset screen element is configured according to the screen configuration information corresponding to the screen configuration operation, wherein the configured preset screen element is used as a screen element in the target mixed reality space to play media information.

[0081] Computer program code for performing the operations of some embodiments of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0082] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0083] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0084] Figure 7 The mixed reality terminal 700 is shown as some embodiments of the screen display method for the mixed reality space of the present disclosure. The mixed reality terminal includes a head mounted display device 701. The head mounted display device 701 is used for allowing a user to browse a mixed reality scene. The mixed reality terminal is configured to execute Figure 5 The steps in the corresponding embodiments.

[0085] Optionally, the mixed reality end may also include a mobile device 702. The mobile device 702 may be, but is not limited to: a mobile phone, a tablet computer, a smart terminal. The mobile device 702 is connected to the head-mounted display device 701. Here, the connection between the mobile device 702 and the head-mounted display device 701 may be a wired connection or a wireless connection. In some embodiments, both the head-mounted display device 701 and the mobile device 702 may include a processor. In some optional implementations of some embodiments, the head-mounted display device 701 may be used as an external display device of the mobile device 702 and does not have data processing capabilities. The mobile device 702 may provide power support for the head-mounted display device 701.

[0086] The above-mentioned various embodiments of the present disclosure have the following beneficial effects: through the mixed reality terminal of some embodiments of the present disclosure, users can watch the mixed reality scene.

[0087] The above descriptions are only some preferred embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by a specific combination of the above-mentioned technical features, but should also cover other technical solutions formed by any combination of the above-mentioned technical features or their equivalent features without departing from the above-mentioned inventive concept. For example, the above-mentioned features are replaced with the technical features with similar functions disclosed in the embodiments of the present disclosure (but not limited to) and the technical solutions formed.

Claims

1. A screen configuration method for a mixed reality space, comprising: In response to detecting a selection operation of a media screen editing control displayed in a scene editing page acting on a target mixed reality space, displaying a preset screen element list in the scene editing page, wherein each preset screen element is displayed in the preset screen element list; In response to detecting a drag operation on any preset screen element in the preset screen element list, and the drag operation is released at a position corresponding to the target mixed reality space in the scene editing page, displaying the any preset screen element at the released position; In response to detecting a screen configuration operation corresponding to any preset screen element, the arbitrary preset screen element is configured according to screen configuration information corresponding to the screen configuration operation, wherein the configured arbitrary preset screen element is used as a screen element in a target mixed reality space to play media information.

2. The method according to claim 1, wherein: The method further comprises: In response to detecting a drag operation acting on any preset screen element in the preset screen element list, and the drag operation being released at a position corresponding to the target mixed reality space in the scene editing page, screen element information corresponding to the any preset screen element is displayed in the scene editing page.

3. The method according to claim 1, wherein: The scene editing page also displays a media resource information upload control corresponding to any preset screen element; as well as The method further comprises: In response to detecting a selection operation on the media resource information upload control, displaying a media resource information selection window for selecting media resource information; In response to detecting a confirmation operation corresponding to the selected media asset information, an upload progress window is displayed, wherein the upload progress window displays an upload progress bar and the uploaded media asset information.

4. The method according to claim 3, wherein: The method further comprises: In response to determining that the progress bar state of the upload progress bar is an upload completion state, displaying a background color configuration control in the upload progress window; In response to determining that the media asset information displayed in the upload progress window meets a preset end upload sequence condition, displaying a confirmation control in the upload progress window; In response to detecting a color configuration operation acting on the background color configuration control, determining a background color corresponding to the color configuration operation as a preselected background color; In response to detecting a selection operation acting on the confirmation control, the preselected background color is determined as the background color of the arbitrary preset screen element, and the at least one uploaded media asset information is determined as the playback content corresponding to the arbitrary preset screen element.

5. The method according to claim 4, wherein: The method further comprises: In response to determining that the media asset information displayed in the upload progress window meets a preset front-end upload sequence condition, displaying a cancel control in the upload progress window; In response to detecting a selection operation on the cancel control or a closing operation on the upload progress window, and the progress bar state of the upload progress bar is an uploading state, clearing each uploaded media asset information corresponding to the upload progress bar.

6. The method according to claim 3, wherein: The selected media asset information includes at least one piece of media asset information, and the at least one piece of media asset information is a picture; as well as The method further comprises: In response to determining that there is a to-be-uploaded picture or an uploaded picture corresponding to the upload progress bar before the media asset information displayed in the upload progress window, displaying a previous picture switching control in the upload progress window; In response to determining that there are to-be-uploaded pictures or uploaded pictures corresponding to the upload progress bar after the media asset information displayed in the upload progress window, a subsequent picture switching control is displayed in the upload progress window.

7. The method according to claim 3, wherein: The number of the selected media resource information is a preset number, and the selected media resource information is one of the following: video, live stream, web page; as well as The method further comprises: In response to detecting that the media asset information is successfully uploaded, the successfully uploaded media asset information is displayed in the upload progress window, wherein at least one playback control widget is displayed in the displayed media asset information.

8. The method according to claim 3, wherein: The scene editing page also displays a play content list corresponding to the arbitrary preset screen element, and the play content list displays at least one play content corresponding to the arbitrary preset screen element; as well as The method further comprises: In response to detecting a deletion operation on any playback content in the at least one playback content, the random playback content is deleted in the screen element displayed on the scene editing page, and the random playback content is deleted in the playback content list.

9. The method according to claim 8, wherein: The method further comprises: In response to detecting a replacement operation acting on any of the at least one play content, displaying a replacement window for selecting replacement media asset information; In response to determining that the arbitrary playback content is a picture, determining the number of playback contents included in the playback content list; In response to determining that the number is greater than a preset number, determining whether the replacement media asset information is a picture; In response to determining that the replacement media asset information is a picture, determining the replacement media asset information as the media asset information to be replaced; In response to detecting a confirmation operation corresponding to the to-be-replaced media asset information, the to-be-replaced media asset information is determined as the playback content for replacing the arbitrary playback content.

10. The method according to claim 3, wherein: The method further comprises: In response to determining that the amount of uploaded media asset information corresponding to the screen element is greater than a preset amount, displaying a carousel time configuration control in the scene editing page; In response to detecting a time configuration operation corresponding to the carousel time configuration control, the duration corresponding to the time configuration operation is determined as the carousel interval duration of each piece of media asset information corresponding to the screen element.

11. The method according to claim 3, wherein: Each available media resource information has corresponding operation permissions, and the scene editing page also displays a media resource viewing control; as well as The method further comprises: In response to detecting a selection operation acting on the media asset viewing control, displaying a media asset information list, wherein the operation authority corresponding to each media asset information in the media asset information list corresponds to the user authority of the current user, and the media asset information list also displays an upload control; In response to detecting a selection operation on the upload control, displaying an upload window for the current user to upload media information; The uploaded media asset information is displayed in the media asset information list.

12. A screen display method of a mixed reality space, applied to a mixed reality terminal, the mixed reality terminal including a head-mounted display device, the method comprising: Displaying a mixed reality scene of a target mixed reality space in the head mounted display device, wherein the target mixed reality space includes screen elements, and the screen elements are configured by the method according to any one of claims 1 to 11; In response to determining that the current position information of the head mounted display device meets the display condition of the screen element, media asset information pre-configured in the screen element is played in the screen element.

13. The method according to claim 12, wherein: The playing of the media resource information pre-configured in the screen element in the screen element includes: In response to determining that the media asset information pre-configured in the screen element is a number of pictures greater than a preset number, determining a carousel interval duration corresponding to each of the pictures; The pictures are rotated in the screen element according to the rotation interval.

14. An electronic device comprising: one or more processors; a storage device having one or more programs stored thereon, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 8.

15. A mixed reality terminal, comprising: A head-mounted display device for allowing users to browse mixed reality scenes; The mixed reality terminal is configured to execute the method according to claims 12-13.

Images