Search content display method for three-dimensional space, ar device, and computer readable medium

Abstract

Embodiments of the present disclosure disclose a search content display method in a three-dimensional space, an AR device and a computer readable medium. A specific embodiment of the method comprises: obtaining a search content sequence; generating respective display position information of respective search contents according to a sequence order of the respective search contents in the search content sequence; displaying respective search content cards corresponding to the respective search contents in the three-dimensional space, wherein the search content cards are displayed in respective three-dimensional display layers corresponding to depth coordinates of the respective search contents according to the sequence order of the search content sequence, and respective search content cards corresponding to respective search contents in a field of view angle region are arranged at a front end of the search content sequence; and in response to detecting a sliding refresh operation for respective three-dimensional display layers in the three-dimensional space, displaying updated respective search content cards in the respective three-dimensional display layers. The embodiment improves the adaptability of the displayed search content to the AR device and improves the stereoscopic and spatial effects when viewed by a wearer.

Description

Technical Field

[0001] Embodiments of this disclosure relate to the field of extended reality technology, and more specifically to methods for displaying search content in three-dimensional space, AR devices, and computer-readable media. Background Technology

[0002] With the gradual development of augmented reality technology, the application of AR devices is becoming increasingly widespread. Search results are information obtained based on filtering criteria and settings. Currently, when displaying search results through AR devices, the common method is to tile the results within a two-dimensional page in three-dimensional space.

[0003] However, the inventors discovered that when displaying search content in the above manner, the following technical problems often exist: the tiling display method is the same as the display method in two-dimensional applications, resulting in poor compatibility of the displayed search content with AR devices, and poor sense of stereoscopic effect and spatial effect when the user wears the device.

[0004] The information disclosed in this background section is only intended to enhance the understanding of the background of the inventive concept, and therefore may contain information that does not constitute prior art known to those skilled in the art. Summary of the Invention

[0005] The summary portion of this disclosure is intended to provide a brief overview of the concepts, which will be described in detail in the detailed description portion. This summary portion is not intended to identify key or essential features of the claimed technical solutions, nor is it intended to limit the scope of the claimed technical solutions.

[0006] Some embodiments of this disclosure provide a method for displaying search content in three-dimensional space, an AR device, and a computer-readable medium to address one or more of the technical problems mentioned in the background section above.

[0007] Firstly, some embodiments of this disclosure provide a method for displaying search content in a three-dimensional space. The method includes: obtaining a sequence of search content based on input information from a search box displayed in the corresponding three-dimensional space or the current user's preference information, wherein the search content sequence includes N search content items, and each search content item is sorted according to its popularity; generating display position information for each search content item based on the sequence order n (1 <= n <= N, an integer) of each search content item in the search content sequence, wherein the display position information includes a horizontal coordinate X, a vertical coordinate Y, and a depth coordinate Z, where the horizontal coordinate X represents the horizontal order relative to the camera position, the vertical coordinate Y represents the vertical order relative to the column corresponding to the horizontal coordinate X, and the depth coordinate Z represents the depth order relative to the camera position; and displaying the corresponding search content item in the three-dimensional space based on the horizontal coordinate X, vertical coordinate Y, and depth coordinate Z. Each search content card displays the homepage information of the corresponding search content. Based on the order in the search content sequence, these search content cards are displayed in the 3D display layer corresponding to the depth coordinates of the search content. In each 3D display layer of the aforementioned 3D space, the search content corresponding to each search content card in the corresponding field of view area is arranged at the beginning of the search content sequence. The display brightness of the 3D display layer farther from the camera position is less than that of the 3D display layer closer to the camera position. All search content cards have the same horizontal width. In response to detecting a sliding refresh operation on each 3D display layer in the aforementioned 3D space, updated search content cards are displayed in each of the aforementioned 3D display layers. The aforementioned 3D space is displayed in an AR device with a FOV range of 40-60 degrees, where N ranges from 11 to 55, the horizontal coordinate X ranges from -5 to 5, and the depth coordinate Z ranges from 1 to 4.

[0008] Optionally, Z can take values ​​from 1 to 3; when n is divisible by 3, Z = 3; when n is not divisible by 3 but is divisible by 2, Z = 2; when n is neither divisible by 3 nor by 2, Z = 1.

[0009] Optionally, the method further includes: in response to detecting a sliding back operation for each of the three-dimensional display layers in the three-dimensional space, and the current display in each of the three-dimensional display layers is an updated search content card, displaying, for each three-dimensional display layer, the search content card that was previously displayed in the three-dimensional display layer.

[0010] Optionally, the method further includes: in response to detecting a hover operation acting on a search content card displayed in any three-dimensional display layer, moving the target search content card to a target layer, wherein the target search content card is the search content card corresponding to the hover operation, the distance of the target layer from the camera position is less than the distance of each of the three-dimensional display layers from the camera position, and the card size of the target search content card displayed in the target layer is greater than the card size of the target search content card displayed in any of the three-dimensional display layers.

[0011] Optionally, the above-mentioned method of moving the target search content card to the target layer includes: determining the card size of the target search content card in the above-mentioned any three-dimensional display layer; determining the magnification factor of the target search content card based on the determined card size; generating the card size of the search content card in the target layer as the target card size based on the magnification factor and the determined card size; moving the target search content card to the target layer, while simultaneously magnifying the target search content card to the target card size.

[0012] Optionally, moving the target search content card to the target layer includes: in response to determining that any of the three-dimensional display layers is not the three-dimensional display layer closest to the camera position, moving the target search content card to the target layer; simultaneously, for each three-dimensional display layer before any of the three-dimensional display layers, in response to determining that the target search content card has moved to the three-dimensional display layer, moving each search content card adjacent to the target search content card in the three-dimensional display layer to both sides; and in response to determining that the target search content card has moved out of the three-dimensional display layer, resetting each search content card in the moved three-dimensional display layer.

[0013] Optionally, the method further includes: in response to detecting a selection operation performed on the target search content card in the target layer, enlarging the target search content card and displaying it at the center of the target layer, and hiding the search content cards displayed in each of the three-dimensional display layers, wherein the target layer also displays a refresh control and a return control; obtaining a related content sequence corresponding to the search content corresponding to the target search content card; and displaying related content cards corresponding to the related content sequence around the target search content card in the three-dimensional space.

[0014] Optionally, the above-mentioned method of enlarging and displaying the target search content card at the center position of the target layer includes: in response to determining that the content type corresponding to the target search content card is image-text or text-text, enlarging the target search content card to the target magnification of the corresponding field of view area; displaying the enlarged target search content card at the center position of the target layer; and in response to detecting a content sliding operation on the target search content card, displaying the content corresponding to the content sliding operation while sliding the target search content card.

[0015] Optionally, the edges of each search content card are also displayed on both sides of the aforementioned field of view area, and the brightness of each search content card edge is less than the brightness of the three-dimensional display layer corresponding to the edge of the search content card; and the method further includes: in response to detecting a field of view movement operation in the aforementioned three-dimensional space, displaying each search content card in the updated field of view area corresponding to the field of view movement operation, and updating the brightness of each search content card edge to the brightness of the three-dimensional display layer corresponding to the edge of the search content card for each search content card edge on the side of the aforementioned field of view area corresponding to the field of view movement operation.

[0016] Optionally, any three-dimensional display layer in the aforementioned three-dimensional space corresponds to a pre-divided sequence of card display columns, which are arranged in a counter-clockwise ascending order from the center. The number of search content cards that can be displayed in each card display column is less than a preset number. The generation of display position information for each of the aforementioned search contents includes: determining the card size corresponding to each search content based on its content type in the aforementioned search content sequence, wherein each determined card size includes the same card width; determining the first card display column in the aforementioned card display column sequence as the current card display column; determining the first search content in the aforementioned search content sequence as the current search content; and performing the following iterative steps based on the current card display column and the current search content: in response to determining the current... If the remaining display size of the card display column is greater than the card size corresponding to the current search content, and the number of each search content to be displayed corresponding to the current card display column is less than the difference between the preset number and the preset value, then the horizontal and vertical coordinates of the current search content are determined based on the initial vertical coordinate of the current card display column or the vertical coordinate of the last search content to be displayed. The next search content is then used as the current search content, and the above loop steps are executed again. In response to determining that the remaining display size of the current card display column is greater than the card size corresponding to the current search content, or that the number of each search content to be displayed corresponding to the current card display column is less than the difference between the preset number and the preset value, the next card display column is used as the current card display column, and the above loop steps are executed again.

[0017] Optionally, generating the display position information for each of the search contents further includes: for each search content in the search content sequence, performing the following steps: in response to determining that the sequence number of the search content satisfies a first preset divisibility condition corresponding to a first value, determining the first value as the depth coordinate corresponding to the search content; in response to determining that the sequence number of the search content satisfies a second preset divisibility condition corresponding to a second value, determining the second value as the depth coordinate corresponding to the search content; in response to determining that the sequence number of the search content does not satisfy the first preset divisibility condition and the second preset divisibility condition, determining a third value as the depth coordinate corresponding to the search content, wherein the second value is greater than the first value, and the first value is greater than the third value; and determining the horizontal coordinate, vertical coordinate, and depth coordinate corresponding to the search content as the display position information corresponding to the search content.

[0018] Secondly, some embodiments of this disclosure provide an AR device, including: one or more processors; a display screen for imaging in front of a user; and a storage device storing one or more programs that, when executed by one or more processors, cause the one or more processors to implement the method described in any implementation of the first aspect above.

[0019] Thirdly, some embodiments of this disclosure provide a computer-readable medium having a computer program stored thereon, wherein the program, when executed by a processor, implements the method described in any of the implementations of the first aspect above.

[0020] The above-described embodiments of this disclosure have the following beneficial effects: the three-dimensional space search content display method of some embodiments of this disclosure improves the adaptability of the displayed search content to AR devices and enhances the stereoscopic and spatial sense when viewed by the user. Specifically, the reason for the poor adaptability of the displayed search content to AR devices and the poor stereoscopic and spatial sense when viewed by the user is that the tiling display method is the same as the display method in two-dimensional applications, resulting in poor adaptability of the displayed search content to AR devices and poor stereoscopic and spatial sense when viewed by the user. Based on this, the three-dimensional space search content display method of some embodiments of this disclosure first obtains a search content sequence based on the input information of the search box displayed in the corresponding three-dimensional space or the current user's preference information. The search content sequence includes N search contents, which are sorted according to information popularity. Thus, each search content arranged according to popularity can be obtained based on the user's input information or the user's preference information. Then, based on the sequence order n (1 <= n <= N, which is an integer) of each search content in the above search content sequence, the display position information of each search content is generated. The display location information includes horizontal coordinate X, vertical coordinate Y, and depth coordinate Z. Horizontal coordinate X represents the horizontal order relative to the camera position. Vertical coordinate Y represents the vertical order relative to the column corresponding to horizontal coordinate X. Depth coordinate Z represents the depth order relative to the camera position. Therefore, the display location information for each search item can be determined according to its popularity. The display location information, including horizontal coordinate X, vertical coordinate Y, and depth coordinate Z, indicates that the display location information is three-dimensional. Next, based on the horizontal coordinate X, vertical coordinate Y, and depth coordinate Z corresponding to each search item, each search item card is displayed in the aforementioned three-dimensional space. The search item card displays the homepage content information of the corresponding search item. According to the order in the search item sequence, the search item cards are displayed in the three-dimensional display layer corresponding to the depth coordinate of the search item. In the aforementioned three-dimensional display layers, the search content corresponding to each search content card in the field of view area is arranged at the beginning of the search content sequence. The display brightness of the three-dimensional display layer farther from the camera position is lower than that of the three-dimensional display layer closer to the camera position. All the search content cards have the same horizontal width. Therefore, by utilizing the three-dimensional display position information, search content can be displayed in different layers in three-dimensional space in the form of cards, and more popular search content can be displayed as cards in the field of view area. The fact that all the displayed search content cards have the same horizontal width allows for a neat arrangement of the search content cards, making them easy for the user to view.The 3D display layers closer to the camera have higher brightness, making it easier for users to view the content displayed on these layers. Finally, in response to a detected swipe refresh operation on each 3D display layer in the aforementioned 3D space, updated search content cards are displayed on each of these layers. This 3D space is displayed on an AR device with a field of view (FOV) of 40-60 degrees. Here, N ranges from 11 to 55, the horizontal coordinate X ranges from -5 to 5, and the depth coordinate Z ranges from 1 to 4. This allows for a comprehensive refresh of the search content cards displayed on each 3D display layer. Because the search content cards are displayed on different 3D display layers at varying distances from the camera and with varying brightness, the integration with the AR device's functionality is enhanced, improving the compatibility of the displayed search content with the AR device. Furthermore, the different depths and brightness levels of the displayed search content cards enhance the sense of depth and space for the user when viewing them. This improves the compatibility of the displayed search content with AR devices and enhances the sense of depth and space for users. Attached Figure Description

[0021] The above and other features, advantages, and aspects of the embodiments of this disclosure will become more apparent from the accompanying drawings and the following detailed description. Throughout the drawings, the same or similar reference numerals denote the same or similar elements. It should be understood that the drawings are schematic, and elements are not necessarily drawn to scale.

[0022] Figure 1 This is a flowchart of some embodiments of the method for displaying search content in three-dimensional space according to the present disclosure;

[0023] Figure 2 A schematic diagram illustrating the arrangement of search content in a three-dimensional space search content display method according to some embodiments of the present disclosure;

[0024] Figure 3-5 This is a schematic diagram of an application scenario of a method for displaying search content in three-dimensional space according to some embodiments of the present disclosure;

[0025] Figure 6 These are flowcharts of some other embodiments of the method for displaying search content in three-dimensional space according to this disclosure;

[0026] Figure 7 This is a schematic diagram of arranging related content cards according to some other embodiments of the three-dimensional space search content display method of this disclosure;

[0027] Figure 8 This is a schematic diagram of the structure of an AR device suitable for implementing some embodiments of the present disclosure. Detailed Implementation

[0028] Embodiments of this disclosure will now be described in more detail with reference to the accompanying drawings. While some embodiments of this disclosure are shown in the drawings, it should be understood that this disclosure can be implemented in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of this disclosure. It should be understood that the accompanying drawings and embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of protection of this disclosure.

[0029] It should also be noted that, for ease of description, only the parts relevant to the invention are shown in the accompanying drawings. Unless otherwise specified, the embodiments and features described in this disclosure can be combined with each other.

[0030] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are used only to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units or their interdependencies.

[0031] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0032] The names of messages or information exchanged between multiple devices in the embodiments of this disclosure are for illustrative purposes only and are not intended to limit the scope of such messages or information.

[0033] Before performing any of the operations involving the collection, storage, or use of user personal information (such as input information and preference information) disclosed in this disclosure, the relevant organizations or individuals shall fulfill their obligations, including conducting personal information security impact assessments, informing personal information subjects, and obtaining prior authorization and consent from personal information subjects.

[0034] This disclosure will now be described in detail with reference to the accompanying drawings and embodiments.

[0035] Figure 1 A flow 100 of some embodiments of a three-dimensional space search content display method according to the present disclosure is shown. The three-dimensional space search content display method includes the following steps:

[0036] Step 101: Obtain the sequence of search content based on the input information of the search box displayed in the corresponding three-dimensional space or the current user's preference information.

[0037] In some embodiments, the execution entity of the three-dimensional space search content display method (e.g., an AR device) can obtain a sequence of search content from a server via a wired or wireless connection based on the input information of the search box displayed in the corresponding three-dimensional space or the current user's preference information. The three-dimensional space can be a space with depth attributes used for integration with the real-world scene. The search box can be a box for inputting the information to be searched. The input information can be information confirming the search. For example, the input information can be text entered via a keyboard. The input information can also be voice or text entered via voice. Alternatively, the input information can be an image. The current user can be a user wearing an AR device. The preference information can be pre-configured information representing user preference attributes. For example, the preference information can include, but is not limited to, preferred news types and preferred information presentation methods (video, images, text). The search content sequence can be various contents retrieved based on the input information or preference information. The content types of each search content in the search content sequence can include, but are not limited to, video, image / text, and text. Optionally, video can be specifically divided into horizontal video and vertical video. For example, the aspect ratio of horizontal video can be 16:9. For vertical video formats, the aspect ratio can be 9:16. The search content sequence described above can include N search terms, where each search term is sorted according to its popularity. For example, popularity can be determined based on the initial popularity of the information, the level of interaction with the information, and the decreasing popularity over time. The search terms in the search content sequence can be arranged in descending order of popularity.

[0038] It should be noted that the aforementioned wireless connection methods may include, but are not limited to, 3G / 4G connection, WiFi connection, Bluetooth connection, WiMAX connection, Zigbee connection, UWB (ultra wideband) connection, and other currently known or future wireless connection methods.

[0039] Step 102: Generate the display position information of each search content according to the sequence order n (1<=n<=N, which is an integer) of each search content in the search content sequence.

[0040] In some embodiments, the execution entity can generate display position information for each search content based on the sequence order n (1 <= n <= N, an integer) of the search content sequence. In practice, the execution entity can arrange the search content sequentially from top to bottom and sides using an initial horizontal coordinate to obtain the horizontal and vertical coordinates of each search content. The area size corresponding to each search content can be the same or different depending on the content type. The initial horizontal coordinate can correspond to the first position at the top center of the field of view. The horizontal coordinate X represents the horizontal order relative to the camera position, and the vertical coordinate Y represents the vertical order relative to the column corresponding to the horizontal coordinate X. The horizontal coordinate to the left of the initial horizontal coordinate can be negative. The horizontal coordinate to the right of the initial horizontal coordinate can be positive. The initial vertical coordinate can be the first position at the top of the field of view. The vertical coordinate can be positive. Vertically downwards can be the positive direction. Then, each search content can be sequentially divided into different 3D display layers in the 3D space. The division method can be a sequential polling method. For example, the 3D space can include 4 3D display layers. The aforementioned execution entity can assign the first search result to the first 3D display layer, the second search result to the second 3D display layer, the third search result to the third 3D display layer, the fourth search result to the fourth 3D display layer, the fifth search result to the first 3D display layer, and so on. Next, the order of the 3D display layers corresponding to each search result can be determined as depth coordinates, and the horizontal, vertical, and depth coordinates corresponding to the search result can be determined as the display position information of the search result. The depth coordinate Z represents the depth order relative to the camera position. The larger the depth coordinate, the farther the distance from the camera position.

[0041] Optionally, any three-dimensional display layer in the aforementioned three-dimensional space corresponds to a pre-divided sequence of card display columns. These card display column sequences are arranged in a counter-clockwise increasing order from the center. For example, the central axis of the field of view can be the middle column, i.e., column 1. The right side can be even-numbered columns (columns 2, 4, 6, 8, and 10). The left side can be odd-numbered columns (columns 3, 5, 7, 9, and 11). The number of search content cards that can be displayed in each card display column is less than a preset number. For example, the preset number can be 4. Optionally, the total height of the search content cards and the spacing between them in each card display column can be less than a preset height. For example, the preset height can be 1270px.

[0042] In some optional implementations of certain embodiments, the execution entity may generate the display location information for each of the search contents through the following steps:

[0043] The first step is to determine the card size corresponding to each search item in the above search content sequence based on its content type. The determined card sizes include the same card width. In practice, the card size for each content type can be pre-defined. For example, the card size for video items can be the card size for a video header image ratio of 9:16 (vertical video) or 16:9 (horizontal video). The card size for a 9:16 video header image ratio can be 320px:(569px+100px), where 320px is the card width, 569px is the height of the cropped video header image, and 100px is the height of the search content title. The card size for a 16:9 video header image ratio can be 320px:(180px+100px), where 180px is the height of the cropped video header image, and 100px is the height of the search content title. The card size for image / text or text-based cards can be 320px:(240px+100px), where 240px can be the height of the cropped main image or text box. The aspect ratio of the cropped main image or text box can be 4:3.

[0044] The second step is to determine the first card display column in the above card display column sequence as the current card display column.

[0045] The third step is to determine the first search term in the above search term sequence as the current search term.

[0046] Fourth, based on the current card display column and the current search content, execute the following loop steps:

[0047] The first sub-step, in response to determining that the remaining display size of the current card display column is greater than the card size corresponding to the current search content, and that the number of each search content to be displayed corresponding to the current card display column is less than the difference between the aforementioned preset number and preset value, determines the horizontal and vertical coordinates of the current search content based on the initial vertical coordinate of the current card display column or the vertical coordinate of the last search content to be displayed, and takes the next search content as the current search content, and repeats the above loop steps. Here, the remaining display size can be the size of the remaining space in the current card display column where cards can be arranged. Each search content to be displayed corresponding to the current card display column can be the search content determined to be arranged in the current card display column. The initial vertical coordinate of the first card display column can be at the top, i.e., 1. The initial vertical coordinate of the second card display column can be at the bottom, i.e., the preset number 4. The initial vertical coordinate of the third card display column can be at the top, i.e., 1. It can be understood that, thus, each search content can be arranged counterclockwise in each card display column. In practice, the aforementioned execution entity can, in response to determining that the current card display column does not correspond to search content, determine the horizontal coordinate of the current search content as the column number corresponding to the current card display column, and determine the initial vertical coordinate of the current card display column as the vertical coordinate of the current search content. The aforementioned execution entity can also, in response to determining that the current card display column corresponds to search content, determine the last search content corresponding to the current card display column as the previous search content. Then, in response to the initial vertical coordinate of the current card display column being at the top, determine the next vertical coordinate of the vertical coordinate corresponding to the previous search content as the vertical coordinate of the current search content. In response to the initial vertical coordinate of the current card display column being at the bottom, determine the previous vertical coordinate of the vertical coordinate corresponding to the previous search content as the vertical coordinate of the current search content.

[0048] The second sub-step, in response to determining that the remaining display size of the current card display column is greater than the card size corresponding to the current search content, or that the number of each search content to be displayed corresponding to the current card display column is less than the difference between the aforementioned preset number and preset value, sets the next card display column as the current card display column and executes the above loop steps again. Thus, the two-dimensional arrangement coordinates of each search content can be determined according to the information popularity order of the search content, the card size, and the arrangement order of each card display column.

[0049] Fifth, for each search term in the above search term sequence, perform the following steps:

[0050] The first sub-step involves determining the depth coordinates corresponding to the search content by setting the sequence number of the search content to satisfy a first preset divisibility condition. The first value can be 2. The first preset divisibility condition can be that the sequence number is divisible by 2 but not by 3.

[0051] The second sub-step involves determining the depth coordinates corresponding to the search content by setting the sequence number of the searched content to satisfy a second preset divisibility condition. The second preset divisibility condition allows the sequence number to be divisible by 3.

[0052] The third sub-step involves determining that the sequence number of the search content does not satisfy the first and second preset divisibility conditions, and then setting a third value as the depth coordinate corresponding to the search content. The second value is greater than the first value, and the first value is greater than the third value. The third value can be 1.

[0053] The fourth sub-step involves determining the horizontal, vertical, and depth coordinates of the search content as the display location information for that search content. This allows the three-dimensional coordinates of the search content to be determined according to its information popularity.

[0054] As an example, a diagram illustrating the arrangement of search results can be found here. Figure 2 . Figure 2 In the image, the card display sequence is divided into 11 columns. The middle column is column 1. The left columns are odd-numbered, and the right columns are even-numbered. There are a total of 39 search terms. The smaller the number, the higher the information's popularity. Search terms with smaller numbers are prioritized and placed in the middle. The search terms in column 1 are arranged from top to bottom within the field of view, with the first search term aligned with the top edge of the field of view. The search terms in column 2 are arranged from bottom to top within the field of view, with the last search term aligned with the bottom edge of the field of view. The search terms in column 3 are arranged from top to bottom within the field of view, with the last search term aligned with the bottom edge of the field of view. The search terms are divided into three different 3D display layers.

[0055] Optionally, for each search item in the above search content sequence, the executing entity can determine the depth coordinates of each search item according to a preset hierarchical arrangement. For example, the hierarchical arrangement order can be "1, 2, 3, 2, 1, 3". For example, the depth coordinate of the first search item can be 1. The depth coordinate of the second search item can be 2. The depth coordinate of the third search item can be 3. The depth coordinate of the fourth search item can be 2. The depth coordinate of the fifth search item can be 1. The depth coordinate of the sixth search item can be 3. The depth coordinate of the seventh search item can be 1. This sequence can be repeated to determine the depth coordinates of each search item.

[0056] Step 103: Based on the horizontal coordinate X, vertical coordinate Y, and depth coordinate Z corresponding to each search content, display the corresponding search content cards in three-dimensional space.

[0057] In some embodiments, the execution entity can display corresponding search content cards in the three-dimensional space based on the horizontal coordinate X, vertical coordinate Y, and depth coordinate Z corresponding to each search content. The search content cards display the homepage content information of the corresponding search content. This homepage content information can be information for users to preview. Specifically, for search content cards of video content, the homepage content information may include a video header image cropped to a preset size and a string from the search content title that can be accommodated within a preset title size. For search content cards of image-text content, the homepage content information may include a main image cropped to a preset size and a string from the search content title that can be accommodated within a preset title size. For search content cards of text content, the homepage content information may include a text box of a preset size and a string from the search content title that can be accommodated within a preset title size. The text box may display a brief summary of the search content; brief summaries not displayed due to text box size limitations may be represented by ellipses. Here, the preset sizes and preset title sizes may be the same or different. Based on the order of the search content sequence, the search content cards are displayed in the 3D display layer corresponding to the depth coordinates of the search content. In each 3D display layer of the aforementioned 3D space, the search content corresponding to each search content card in the corresponding field of view area is arranged at the front of the search content sequence. This allows the user to view the more popular search content cards from a direct viewing angle. The brightness of the 3D display layer farther from the camera is lower than that of the 3D display layer closer to the camera. For example, the brightness of the first 3D display layer can be 1 (normal brightness), the brightness of the second 3D display layer can be 0.7 (brightness reduced by 30%), and the brightness of the third 3D display layer can be 0.4 (brightness reduced by 60%). This allows the user to better view the search content cards in the foreground 3D display layers. All the search content cards have the same horizontal width. This results in a more orderly arrangement of the search content cards.

[0058] In practice, for each search query, the aforementioned execution entity can determine the display position and 3D display layer of the search query card according to the horizontal coordinate X, vertical coordinate Y, and depth coordinate Z corresponding to the search query. Then, a preset search query card template can be displayed at the designated display position in the 3D display layer, and the corresponding homepage content information can be displayed within the search query card template. Here, the display position can be a 3D coordinate position mapped to a 3D coordinate system. The search query card template can be a blank card template. The edges of the search query card template can be covered with a thick shadow. For example, the edges of the search query card template can present a thick, transparent, luminous glass shadow. The card sizes corresponding to each search query card template can be the same or different depending on the content type.

[0059] Optionally, the search result card may include a main area and a sub-area. For search result cards with video content, the main area can display the video's title image, which may also include a video playback icon. The sub-area can display the search result title. For search result cards with text / image content, the main area can display the main image, and the sub-area can display the search result title. For search result cards with text content, the main area can display a text box, which may also include an icon of the application from which the text originated. The sub-area can display the search result title. It is understood that, due to area size limitations, the search result title displayed in the sub-area can be a partial string, with the remaining string represented by ellipses.

[0060] Optionally, the search content cards corresponding to the first card display column can be moved upwards to the top edge of the field of view, aligning the top of the first search content card with the top edge of the field of view. The search content cards corresponding to the second and third card display columns can be moved downwards to the bottom edge of the field of view, aligning the bottom of the last search content card with the bottom edge of the field of view. Similarly, the search content cards corresponding to the fourth and fifth card display columns can be moved upwards to the top edge of the field of view, aligning the top of the first search content card with the top edge of the field of view. It is understood that the alignment direction of the card display columns where the search content cards overlap with the top or bottom edge of the field of view changes every even-numbered column. This reversal of alignment direction at even-numbered columns ensures a more balanced distribution of the search content cards in space.

[0061] Step 104: In response to detecting a sliding refresh operation for each 3D display layer in the 3D space, display the updated search content cards in each 3D display layer.

[0062] In some embodiments, the execution entity may, in response to detecting a swipe refresh operation on each of the three-dimensional display layers in the three-dimensional space, display updated search content cards in each of the three-dimensional display layers. The swipe refresh operation may be a left swipe operation acting on the entire three-dimensional space. Here, the left swipe operation can be determined by recognizing user gestures. For example, a left swipe operation may correspond to a gesture of waving to the left. The search content corresponding to each updated search content card may be search content corresponding to the input information or the preference information, and the corresponding information popularity is lower than that of each search content in the search content sequence. In practice, the method by which the execution entity displays the updated search content cards in each of the three-dimensional display layers can refer to steps 102-103, and will not be repeated here.

[0063] It should be noted that the aforementioned 3D space can be displayed in AR devices with a field of view (FOV) of 40-60 degrees. The value of N ranges from 11 to 55. Here, displaying 11 to 55 search content cards in the 3D space is a range determined by the FOV size for user comfort. The horizontal coordinate X ranges from -5 to 5. This range indicates that a maximum of 11 columns of search content cards can be displayed in the 3D space, with the other 5 columns distributed on either side of the middle column. The maximum of 11 columns of search content cards in the 3D space is a range determined by the FOV size for user comfort. The depth coordinate Z ranges from 1 to 4. This range indicates that a maximum of 4 3D display layers for displaying search content cards can be displayed in the 3D space. The maximum of 4 3D display layers is a range determined by the user's perception of spatial hierarchy; too many layers would lead to cluttered spatial content.

[0064] Optionally, the value of Z can range from 1 to 3. Displaying a maximum of 3D display layers in 3D space can be determined based on the user's perception of spatial hierarchy, further reducing the clutter of spatial content. When n is divisible by 3, Z = 3. When n is not divisible by 3 but is divisible by 2, Z = 2. When n is neither divisible by 3 nor by 2, Z = 1. This ensures that the search results displayed at the top are placed in 3D display layers closer to the camera position.

[0065] Optionally, the aforementioned execution entity can also respond to detecting a swipe-back operation for each 3D display layer in the aforementioned 3D space, and the currently displayed content cards in each 3D display layer are updated search terms. For each 3D display layer, the previously displayed search terms cards are displayed in that 3D display layer. The swipe-back operation can be an operation to return to the previous state. For example, the swipe-back operation can be a right swipe. Here, the right swipe operation can be determined by recognizing the user's gesture. For example, a right swipe operation can correspond to a rightward hand gesture. Thus, the user can view the historical display content in the 3D space through gesture operations. It is understood that the number of swipe-back operations can be set to be less than or equal to a preset number, thereby allowing the user to view a limited number of historical display contents.

[0066] Optionally, the edges of each search content card are also displayed on both sides of the aforementioned field of view area. The brightness of each search content card edge is lower than the brightness of the corresponding 3D display layer. For example, the brightness of the search content card edge can be reduced by 40% compared to the brightness of its corresponding 3D display layer.

[0067] As an example, the various 3D display layers in 3D space can be referenced. Figure 3 . Figure 3 In the image, the search content cards are arranged in three layers: 3D display layer 301, 3D display layer 302, and 3D display layer 303. Each layer has a different level of brightness, with the 3D display layers closer to the camera having higher brightness. Higher brightness indicates brighter content. The various search content cards can be referenced. Figure 4 . Figure 4 The display can show content in a three-dimensional space when viewed directly by the user. The field of view 401 can display all five columns of search content cards. The user can turn their head to view the other three columns of search content cards on either side. The edges of each search content card are also displayed on both sides of the field of view 401, including the edges of the search content cards on the left and right sides.

[0068] Optionally, the execution entity may also, in response to detecting a field-of-view movement operation in the aforementioned three-dimensional space, display each search content card in the updated field-of-view area corresponding to the field-of-view movement operation, and update the display brightness of the edge portion of each search content card on the side of the field-of-view area corresponding to the field-of-view movement operation to the display brightness of the corresponding three-dimensional display layer. The field-of-view movement operation can be an operation where the user turns their head to look at another area, causing the field of view to move accordingly, and thus the field-of-view area to update. Therefore, when the user looks at the area where the edge portion of the search content card is located, the display brightness of the edge portion of the search content card can be restored to the originally set display brightness of the three-dimensional display layer.

[0069] As an example, users in Figure 4 Turning your head to the left in the corresponding 3D space will display various search result cards for reference. Figure 5 . Figure 5 The remaining three columns of search results cards on the left can be displayed in the middle. Figure 4 The edges of the various search result cards with reduced brightness are displayed in the middle. Figure 5 The brightness and darkness of the display can be restored to the level of the 3D display layer.

[0070] Optionally, the aforementioned execution entity can, in response to detecting a hover operation on a search content card displayed in any 3D display layer, enlarge the target search content card in that 3D display layer. The target search content card is the search content card corresponding to the hover operation. In the enlarged target search content card, the size of the sub-area used to display the search content title is larger than the original size of the sub-area. When the content type corresponding to the target search content card is video, the enlarged target search content card can automatically loop the video. When the content type corresponding to the target search content card is text / image, the size of the main area in the enlarged target search content card is larger than the original size of the main area, thus allowing for image enlargement. When the content type corresponding to the target search content card is text / image or text, the displayed content in the enlarged target search content card supports page turning. In practice, the target search content card can be enlarged proportionally by a predetermined factor. For example, the predetermined factor can be 1.3 times.

[0071] The above-described embodiments of this disclosure have the following beneficial effects: the three-dimensional space search content display method of some embodiments of this disclosure improves the adaptability of the displayed search content to AR devices and enhances the stereoscopic and spatial sense when viewed by the user. Specifically, the reason for the poor adaptability of the displayed search content to AR devices and the poor stereoscopic and spatial sense when viewed by the user is that the tiling display method is the same as the display method in two-dimensional applications, resulting in poor adaptability of the displayed search content to AR devices and poor stereoscopic and spatial sense when viewed by the user. Based on this, the three-dimensional space search content display method of some embodiments of this disclosure first obtains a search content sequence based on the input information of the search box displayed in the corresponding three-dimensional space or the current user's preference information. The search content sequence includes N search contents, which are sorted according to information popularity. Thus, each search content arranged according to popularity can be obtained based on the user's input information or the user's preference information. Then, based on the sequence order n (1 <= n <= N, which is an integer) of each search content in the above search content sequence, the display position information of each search content is generated. The display location information includes horizontal coordinate X, vertical coordinate Y, and depth coordinate Z. Horizontal coordinate X represents the horizontal order relative to the camera position. Vertical coordinate Y represents the vertical order relative to the column corresponding to horizontal coordinate X. Depth coordinate Z represents the depth order relative to the camera position. Therefore, the display location information for each search item can be determined according to its popularity. The display location information, including horizontal coordinate X, vertical coordinate Y, and depth coordinate Z, indicates that the display location information is three-dimensional. Next, based on the horizontal coordinate X, vertical coordinate Y, and depth coordinate Z corresponding to each search item, each search item card is displayed in the aforementioned three-dimensional space. The search item card displays the homepage content information of the corresponding search item. According to the order in the search item sequence, the search item cards are displayed in the three-dimensional display layer corresponding to the depth coordinate of the search item. In the aforementioned three-dimensional display layers, the search content corresponding to each search content card in the field of view area is arranged at the beginning of the search content sequence. The display brightness of the three-dimensional display layer farther from the camera position is lower than that of the three-dimensional display layer closer to the camera position. All the search content cards have the same horizontal width. Therefore, by utilizing the three-dimensional display position information, search content can be displayed in different layers in three-dimensional space in the form of cards, and more popular search content can be displayed as cards in the field of view area. The fact that all the displayed search content cards have the same horizontal width allows for a neat arrangement of the search content cards, making them easy for the user to view.The 3D display layers closer to the camera have higher brightness, making it easier for users to view the content displayed on these layers. Finally, in response to a detected swipe refresh operation on each 3D display layer in the aforementioned 3D space, updated search content cards are displayed on each of these layers. This 3D space is displayed on an AR device with a field of view (FOV) of 40-60 degrees. Here, N ranges from 11 to 55, the horizontal coordinate X ranges from -5 to 5, and the depth coordinate Z ranges from 1 to 4. This allows for a comprehensive refresh of the search content cards displayed on each 3D display layer. Because the search content cards are displayed on different 3D display layers at varying distances from the camera and with varying brightness, the integration with the AR device's functionality is enhanced, improving the compatibility of the displayed search content with the AR device. Furthermore, the different depths and brightness levels of the displayed search content cards enhance the sense of depth and space for the user when viewing them. This improves the compatibility of the displayed search content with AR devices and enhances the sense of depth and space for users.

[0072] Further reference Figure 6 The diagram illustrates a flow 600 of another embodiment of a method for displaying search content in three-dimensional space. Flow 600 of this method includes the following steps:

[0073] Step 601: Obtain the sequence of search content based on the input information of the search box displayed in the corresponding three-dimensional space or the current user's preference information.

[0074] Step 602: Generate the display position information of each search content according to the sequence order n (1<=n<=N, which is an integer) of each search content in the search content sequence.

[0075] Step 603: Based on the horizontal coordinate X, vertical coordinate Y, and depth coordinate Z corresponding to each search content, display the corresponding search content cards in three-dimensional space.

[0076] Step 604: In response to detecting a sliding refresh operation for each 3D display layer in the 3D space, display the updated search content cards in each 3D display layer.

[0077] In some embodiments, the specific implementation of steps 601-604 and the resulting technical effects can be found in [reference]. Figure 1 Steps 101-104 in the corresponding embodiments will not be repeated here.

[0078] Step 605: In response to detecting a hover operation on a search content card displayed in any 3D display layer, move the target search content card out to the target layer.

[0079] In some embodiments, the execution subject of the three-dimensional space search content display method (e.g., an AR device) can move the target search content card to the target layer in response to detecting a hover operation on a search content card displayed in any three-dimensional display layer. The hover operation can be an operation where an anchor point stays on the search content card for a preset duration. For example, the anchor point can be placed on the search content card by manipulating a ray, by head-tracking, or by hovering the mouse over the search content card. The target search content card is the search content card corresponding to the hover operation. The target layer can be a layer in front of the three-dimensional display layers. The distance of the target layer from the camera position is less than the distance of each of the three-dimensional display layers from the camera position. The card size of the target search content card displayed in the target layer is larger than the card size of the target search content card displayed in any of the three-dimensional display layers. For example, the card size of the target search content card displayed in the target layer can be twice the card size of the target search content card displayed in any of the three-dimensional display layers. For search result cards that include both image and text elements, the search result cards displayed in the target layer can show the main image and text box at their original size ratio. A slider can also be displayed on the search result cards to allow users to scroll and view the content. The full title of the search result can be displayed in the search result cards shown in the target layer.

[0080] In some optional implementations of certain embodiments, the aforementioned execution entity may move the target search content card to the target layer through the following steps:

[0081] The first step is to determine the card size of the target search content card in any of the three-dimensional display layers.

[0082] The second step is to determine the magnification factor of the target search content card based on the determined card size. In practice, the executing entity can determine the first preset factor as the magnification factor in response to determining that the target search content card is a video and that the aspect ratio of the video's first image is a first preset aspect ratio. The executing entity can also determine the second preset factor as the magnification factor in response to determining that the target search content card is a video and that the aspect ratio of the video's first image is a second preset aspect ratio. The executing entity can also determine the third preset factor as the magnification factor in response to determining that the target search content card is a text / image type. The third preset factor can be greater than the second preset factor. The second preset factor can be greater than the first preset factor. For example, the first preset factor can be 1.3. The second preset factor can be 2. The third preset factor can be 3. The first preset aspect ratio can be 9:16. The second preset aspect ratio can be 16:9.

[0083] The third step involves generating the target card size based on the magnification factor and the determined card size, within the target layer of the search content card. In practice, the executing entity can determine the target card size by multiplying the magnification factor by the card size.

[0084] Fourth, move the target search content card to the target layer, and simultaneously enlarge it to the size of the target card. This creates a gradual enlargement animation as the target search content card moves from the 3D display layer to the target layer.

[0085] In some optional implementations of certain embodiments, the execution entity may, in response to determining that any of the three-dimensional display layers is not the three-dimensional display layer closest to the camera position, move the target search content card to the target layer. Simultaneously, for each three-dimensional display layer preceding the target display layer, in response to determining that the target search content card has moved to the three-dimensional display layer, move each search content card adjacent to the target search content card in that three-dimensional display layer to both sides; and in response to determining that the target search content card has moved out of the three-dimensional display layer, reset each search content card in the moved three-dimensional display layer. This allows the search content cards adjacent to the target search content card in the preceding three-dimensional display layers to exhibit a motion effect of moving to both sides and then resetting, thereby creating a motion effect of the target search content card being squeezed forward.

[0086] Optionally, the aforementioned implementing entity may also perform the following steps:

[0087] The first step involves detecting a selection operation on the target search content card within the target layer, enlarging the target search content card to its center position within the target layer, and hiding the search content cards displayed in each of the 3D display layers. The selection operation can be a confirmation of selecting the target search content card. For example, the selection operation can be a gesture operation, such as pinching and separating the thumb and forefinger. The center position can be the center of the field of view area within the target layer. The target layer also displays refresh and return controls. The refresh control refreshes the content related to the target search content card. The return control returns to the previous screen state. This allows access to the sub-space of the target search content card for display.

[0088] The second step is to obtain the relevant content sequence corresponding to the search content of the target search content card mentioned above. Here, each relevant content in the relevant content sequence can be any relevant content that meets a preset condition in terms of similarity to the target search content card mentioned above. The preset condition can be a preset order based on similarity. The preset order can be pre-set. The relevant content in the relevant content sequence can also be arranged in descending order of information popularity.

[0089] Third, in the aforementioned three-dimensional space, display the corresponding related content cards around the target search content card, which correspond to the aforementioned related content sequence. In practice, the executing entity can display the related content cards around the target search content card according to a pre-set subspace card display column sequence. Odd-numbered columns in the subspace card display column sequence can be arranged to the left of the target search content card, and even-numbered columns can be arranged to the right of the target search content card. The arrangement of related content sequences in the subspace card display column can be referenced. Figure 1 Steps 102-103 in the corresponding embodiments will not be repeated here. Optionally, after determining the depth coordinates of each relevant content card, the depth coordinates of the relevant content cards in the 3D display layers after the first 3D display layer can be randomly set to 1. This allows for the priority display of more relevant content cards in the earlier layers. For example, the depth coordinates of 1 / 3 of the relevant content cards in the second 3D display layer can be randomly set to 1. The depth coordinates of 2 / 3 of the relevant content cards in the third 3D display layer can be randomly set to 1.

[0090] As an example, a diagram illustrating the arrangement of related content cards can be found here. Figure 7 . Figure 7In the image, the subspace card display sequence can be divided into 11 columns. The first column is located on the left, near the center. For the target search content card 701, the left side has odd-numbered columns, and the right side has even-numbered columns. There are a total of 39 related content cards. The smaller the serial number, the higher the information popularity. Related content cards with smaller serial numbers are prioritized and placed in the center. The related content cards in the first column are arranged from top to bottom in the field of view, with the first related content card aligned with the top edge of the field of view. The related content cards in the second column are arranged from bottom to top in the field of view, with the last related content card aligned with the bottom edge of the field of view. The related content cards are divided into three different 3D display layers.

[0091] In some optional implementations of certain embodiments, the aforementioned execution entity may enlarge and display the target search content card at the center of the target layer through the following steps:

[0092] The first step, in response to determining that the content type corresponding to the aforementioned target search content card is image-text or text-based, is to magnify the target search content card to a target magnification within the corresponding field of view. This target magnification can be a factor that ensures the magnified target search content card essentially fills the field of view. For example, the target magnification could be 3.5x. This makes it easier for users to read the text.

[0093] The second step is to display the enlarged target search content card in the center of the target layer mentioned above.

[0094] Third, in response to detecting a content swiping action on the target search content card, the corresponding content is displayed on the target search content card. This allows users to swipe to view both image and text content.

[0095] from Figure 6 It can be seen from this that, with Figure 1 Compared to the description of some corresponding embodiments, Figure 6 The flow 600 of the three-dimensional space search content display method in some corresponding embodiments embodies the step of expanding upon hovering the search content card. Thus, the scheme described in these embodiments can move the hovered search content card to a target layer closer to the user for magnified display, facilitating detailed viewing.

[0096] The following is for reference. Figure 8 It shows a schematic diagram of the structure of an AR device 800 suitable for implementing some embodiments of the present disclosure. Figure 8 The AR device shown is merely an example and should not be construed as limiting the functionality and scope of the embodiments of this disclosure.

[0097] like Figure 8 As shown, the AR device 800 may include a processing unit 801 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage device 808 into a random access memory (RAM) 803. The RAM 803 also stores various programs and data required for the operation of the AR device 800. The processing unit 801, ROM 802, and RAM 803 are interconnected via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0098] Typically, the following devices can be connected to I / O interface 805: input devices 806 including, for example, a touchscreen, touchpad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 807 including, for example, a microdisplay, speaker, vibrator, etc.; and communication devices 809. The microdisplay is used to project an image in front of the user's eyes in conjunction with optical elements. Communication device 809 allows AR device 800 to communicate wirelessly or wiredly with other devices to exchange data. Although... Figure 8 An AR device 800 with various devices is shown; however, it should be understood that implementation or possession of all the devices shown is not required. More or fewer devices may be implemented alternatively. Figure 8 Each box shown can represent a device or multiple devices as needed.

[0099] In particular, according to some embodiments of this disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, some embodiments of this disclosure include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via a communication device 809, or installed from a storage device 808, or installed from a ROM 802. When the computer program is executed by the processing device 801, it performs the functions defined in the methods of some embodiments of this disclosure.

[0100] It should be noted that, in some embodiments of this disclosure, the computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium may be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In some embodiments of this disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In some embodiments of this disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium can be any computer-readable medium other than a computer-readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wires, optical fibers, RF (radio frequency), etc., or any suitable combination thereof.

[0101] In some implementations, clients and servers can communicate using any currently known or future-developed network protocol such as HTTP (Hypertext Transfer Protocol) and can interconnect with digital data communication (e.g., communication networks) of any form or medium. Examples of communication networks include local area networks (“LANs”), wide area networks (“WANs”), the Internet (e.g., the Internet of Things), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future-developed networks.

[0102] The aforementioned computer-readable medium may be included in the aforementioned AR device; or it may exist independently and not assembled into the AR device. The aforementioned computer-readable medium carries one or more programs, which, when executed by the AR device, cause the AR device to: obtain a sequence of search content based on the input information of the search box displayed in the corresponding three-dimensional space or the current user's preference information, wherein the sequence of search content includes N search content items, and each search content item is sorted according to its information popularity; generate display position information for each search content item based on the sequence order n (1 <= n <= N, an integer) of each search content item in the sequence of search content items, wherein the display position information includes horizontal coordinate X, vertical coordinate Y, and depth coordinate Z, where horizontal coordinate X represents the horizontal order relative to the camera position, vertical coordinate Y represents the vertical order relative to the column corresponding to horizontal coordinate X, and depth coordinate Z represents the depth order relative to the camera position; and display the corresponding search content item in the aforementioned three-dimensional space based on the horizontal coordinate X, vertical coordinate Y, and depth coordinate Z. Each search query card displays the homepage information of the corresponding search query. Based on the order in the search query sequence, these search query cards are displayed in the 3D display layer corresponding to the depth coordinate of the search query. In each 3D display layer of the 3D space, the search queries corresponding to the search query cards in the field of view area are arranged at the front of the search query sequence. The brightness of the 3D display layer farther from the camera is less than that of the 3D display layer closer to the camera. All search query cards have the same horizontal width. In response to detecting a sliding refresh operation on each 3D display layer in the 3D space, updated search query cards are displayed in each 3D display layer. The 3D space is displayed in an AR device with a FOV range of 40-60 degrees, where N ranges from 11 to 55, the horizontal coordinate X ranges from -5 to 5, and the depth coordinate Z ranges from 1 to 4.

[0103] Computer program code for performing operations of some embodiments of this disclosure can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, and C++, and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer can be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or can be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0104] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0105] The functions described above in this document can be performed, at least in part, by one or more hardware logic components. For example, exemplary types of hardware logic components that can be used, without limitation, include: Field Programmable Gate Arrays (FPGAs), Application-Specific Integrated Circuits (ASICs), Application Standard Products (ASSPs), System-on-Chip (SoCs), Complex Programmable Logic Devices (CPLDs), and so on.

[0106] The above description is merely a selection of preferred embodiments of this disclosure and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of the invention involved in the embodiments of this disclosure is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the above-described inventive concept. For example, technical solutions formed by substituting the above-described features with (but not limited to) technical features with similar functions disclosed in the embodiments of this disclosure.

Claims

1. A method for displaying search content in three-dimensional space, comprising: Based on the input information of the search box displayed in the corresponding three-dimensional space or the current user's preference information, a search content sequence is obtained, wherein the search content sequence includes N search content, each search content is sorted according to information popularity, and the preference information is pre-configured information representing user preference attributes; Based on the sequence order n (1 <= n <= N, which is an integer) of each search content in the search content sequence, the display position information of each search content is generated. The display position information includes horizontal coordinate X, vertical coordinate Y, and depth coordinate Z. The horizontal coordinate X represents the horizontal order relative to the camera position, the vertical coordinate Y represents the vertical order of the column corresponding to the horizontal coordinate X, and the depth coordinate Z represents the depth order relative to the camera position. The depth coordinate Z also represents the order of the three-dimensional display layers corresponding to each search content. Based on the horizontal coordinate X, vertical coordinate Y, and depth coordinate Z corresponding to each search content, search content cards are displayed in the three-dimensional space. The search content cards display the homepage content information of the corresponding search content. According to the order in the search content sequence, the search content cards are displayed in the three-dimensional display layer corresponding to the depth coordinate of the search content. In each three-dimensional display layer of the three-dimensional space, the search content corresponding to each search content card in the field of view area is arranged at the front of the search content sequence. The display brightness of the three-dimensional display layer farther away from the camera position is less than that of the three-dimensional display layer closer to the camera position. Each search content card has the same horizontal width. In response to detecting a sliding refresh operation for each of the three-dimensional display layers in the three-dimensional space, updated search content cards are displayed in each of the three-dimensional display layers; The three-dimensional space is displayed in an AR device with a field of view (FOV) of 40-60 degrees, where N ranges from 11 to 55, the horizontal coordinate X ranges from -5 to 5, and the depth coordinate Z ranges from 1 to 4.

2. The method according to claim 1, wherein, The value of Z ranges from 1 to 3; Z = 3 when n is divisible by 3; When n is not divisible by 3 but is divisible by 2, Z=2; Z = 1 when n is neither divisible by 3 nor by 2.

3. The method according to claim 1, wherein, The method further includes: In response to detecting a slide-back operation for each 3D display layer in the 3D space, and the currently displayed 3D display layer is an updated search content card, for each 3D display layer, the search content card that was previously displayed in the 3D display layer is displayed in the 3D display layer.

4. The method according to claim 1, wherein, The method further includes: In response to detecting a hover operation on a search content card displayed in any 3D display layer, the target search content card is moved to the target layer, wherein the target search content card is the search content card corresponding to the hover operation, the distance of the target layer from the camera position is less than the distance of each 3D display layer from the camera position, and the card size of the target search content card displayed in the target layer is greater than the card size of the target search content card displayed in any 3D display layer.

5. The method according to claim 4, wherein, The step of moving the target search content card out to the target layer includes: Determine the card size of the target search content card in any three-dimensional display layer; Based on the determined card size, determine the magnification factor of the target search content card; Based on the magnification factor and the determined card size, the card size of the search content card in the target layer is generated as the target card size; Move the target search content card out to the target layer, and simultaneously enlarge the target search content card to the size of the target card.

6. The method according to claim 4, wherein, The step of moving the target search content card out to the target layer includes: In response to determining that the arbitrary 3D display layer is not the 3D display layer closest to the camera position, the target search content card is moved out to the target layer. At the same time, for each 3D display layer before the arbitrary 3D display layer, in response to determining that the target search content card has moved to the 3D display layer, each search content card adjacent to the target search content card in the 3D display layer is moved to both sides. In response to determining that the target search content card has moved out of the 3D display layer, each search content card in the moved 3D display layer is reset.

7. The method according to claim 4, wherein, The method further includes: In response to detecting a selection operation on the target search content card in the target layer, the target search content card is enlarged and displayed at the center of the target layer, and the search content cards displayed in each of the three-dimensional display layers are hidden. The target layer also displays a refresh control and a return control. Obtain the relevant content sequence of the search content corresponding to the target search content card; In the three-dimensional space, each related content card corresponding to the related content sequence is displayed around the target search content card.

8. The method according to claim 7, wherein, The step of enlarging and displaying the target search content card at the center of the target layer includes: In response to determining that the content type corresponding to the target search content card is image-text or text, the target search content card is magnified to the target magnification of the corresponding field of view area; The enlarged target search content card is displayed in the center of the target layer; In response to detecting a content swiping operation on the target search content card, the display content corresponding to the content swiping operation is displayed on the target search content card.

9. The method according to claim 1, wherein, The edges of each search content card are also displayed on both sides of the field of view area. The brightness of the edge of each search content card is less than the brightness of the three-dimensional display layer corresponding to the edge of the search content card. as well as The method further includes: In response to the detection of a field of view movement operation in the three-dimensional space, each search content card in the updated field of view region corresponding to the field of view movement operation is displayed, and for each edge portion of the search content card in the field of view region corresponding to the field of view movement operation, the display brightness of the edge portion of the search content card is updated to the display brightness of the three-dimensional display layer corresponding to the edge portion of the search content card.

10. The method according to any one of claims 1-9, wherein, Any three-dimensional display layer in the three-dimensional space corresponds to a pre-divided sequence of card display columns. The sequence of card display columns is arranged in a counter-clockwise order from the center position. The number of search content cards that can be displayed in each card display column is less than a preset number. as well as The generation of display location information for each of the search results includes: Based on the content type corresponding to each search content in the search content sequence, the card size corresponding to the search content is determined, wherein the determined card sizes include the same card width; The first card display column in the card display column sequence is determined as the current card display column; The first search item in the search item sequence is determined as the current search item; Based on the current card display column and the current search content, perform the following loop steps: In response to determining that the remaining display size of the current card display column is greater than the card size corresponding to the current search content, and that the number of each search content to be displayed corresponding to the current card display column is less than the difference between the preset number and the preset value, the horizontal and vertical coordinates of the current search content are determined according to the initial vertical coordinate of the current card display column or the vertical coordinate of the last search content to be displayed, and the next search content of the current search content is taken as the current search content, and the loop step is executed again; In response to determining that the remaining display size of the current card display column is greater than the card size corresponding to the current search content, or that the number of each search content to be displayed corresponding to the current card display column is less than the difference between the preset number and the preset value, the next card display column of the current card display column is taken as the current card display column, and the loop step is executed again.

11. The method according to claim 10, wherein, The generation of display location information for each of the search results also includes: For each search item in the sequence of search items, perform the following steps: In response to determining that the sequence number of the search content satisfies a first preset divisibility condition corresponding to a first value, the first value is determined as the depth coordinates corresponding to the search content; In response to determining that the sequence number of the search content satisfies the second preset divisibility condition of the corresponding second value, the second value is determined as the depth coordinate corresponding to the search content; In response to determining that the sequence number of the search content does not satisfy the first preset integer division condition and the second preset integer division condition, a third value is determined as the depth coordinate corresponding to the search content, wherein the second value is greater than the first value, and the first value is greater than the third value; The horizontal, vertical, and depth coordinates corresponding to the search content are determined as the display location information of the search content.

12. An AR device, comprising: One or more processors; A display screen used to project an image in front of the user; Storage device, on which one or more programs are stored, When the one or more programs are executed by the one or more processors, the one or more processors implement the method as described in any one of claims 1-11.

13. A computer-readable medium having a computer program stored thereon, wherein, When the computer program is executed by a processor, it implements the method as described in any one of claims 1-11.

Images