Content display method, apparatus, and computer-readable storage medium

Abstract

Embodiments of the present disclosure disclose a content display method and device and a computer readable storage medium. The method comprises: determining a screen addition reference position in a three-dimensional model; determining an observation line-of-sight direction of the three-dimensional model; adding a virtual screen group in a three-dimensional space in which the three-dimensional model is located based on the screen addition reference position and the observation line-of-sight direction; determining respective corresponding material content of a plurality of virtual screens in the virtual screen group; and displaying the respective corresponding material content through the plurality of virtual screens. In the embodiments of the present disclosure, in a three-dimensional model display scene, not only the information of the object represented by the three-dimensional model can be presented, but also additional information can be presented through the plurality of virtual screens in the virtual screen group, so that the information presented to the user is more abundant, thereby better meeting actual needs.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of three-dimensional modeling and display, and in particular to a content display method, device and computer readable storage medium. BACKGROUND

[0002] Three-dimensional models are increasingly used, and current three-dimensional models can only present information of objects represented by the three-dimensional models in the form of the models, and cannot present other information. For example, a three-dimensional model can include a three-dimensional house model, and the three-dimensional house model can only present structural information of the house in the form of the model. Therefore, in a three-dimensional model display scenario, the amount of information that can be presented to a user is small, and actual needs cannot be met. SUMMARY

[0003] To solve the above technical problems, the present disclosure is proposed. Embodiments of the present disclosure provide a content display method, device and computer readable storage medium.

[0004] According to an aspect of an embodiment of the present disclosure, a content display method is provided, comprising:

[0005] determining a screen adding reference position in a three-dimensional model;

[0006] determining an observation line-of-sight direction of the three-dimensional model;

[0007] adding a virtual screen group in a three-dimensional space where the three-dimensional model is located based on the screen adding reference position and the observation line-of-sight direction;

[0008] determining respective corresponding material contents of a plurality of virtual screens in the virtual screen group;

[0009] respectively displaying the respective material contents through the plurality of virtual screens.

[0010] According to another aspect of an embodiment of the present disclosure, a content display device is provided, comprising:

[0011] a first determining module configured to determine a screen adding reference position in a three-dimensional model;

[0012] a second determining module configured to determine an observation line-of-sight direction of the three-dimensional model;

[0013] an adding module configured to add a virtual screen group in a three-dimensional space where the three-dimensional model is located based on the screen adding reference position and the observation line-of-sight direction;

[0014] a third determining module configured to determine respective corresponding material contents of a plurality of virtual screens in the virtual screen group;

[0015] The display module is configured to display corresponding material content through the multiple virtual screens respectively.

[0016] According to a further aspect of the embodiments of the present disclosure, an electronic device is provided, comprising:

[0017] a memory configured to store a computer program product;

[0018] a processor configured to execute the computer program product stored in the memory, and the computer program product, when executed, implements the content display method.

[0019] According to a further aspect of the embodiments of the present disclosure, a computer readable storage medium is provided, having stored thereon computer program instructions, which, when executed by a processor, implement the content display method.

[0020] According to a further aspect of the embodiments of the present disclosure, a computer program product is provided, comprising computer program instructions, which, when executed by a processor, implement the content display method.

[0021] In the embodiments of the present disclosure, the screen adding reference position in the three-dimensional model and the observation line-of-sight direction of the three-dimensional model can be determined, and in combination with the screen adding reference position and the observation line-of-sight direction, a virtual screen group can be added in the three-dimensional space where the three-dimensional model is located, and corresponding material content can be displayed through the multiple virtual screens in the virtual screen group. In this way, in the three-dimensional model display scenario, not only the information of the object represented by the three-dimensional model can be presented, but also additional information can be presented through the multiple virtual screens in the virtual screen group, so that the information presented to the user is more abundant, thereby better meeting the actual needs.

[0022] The technical solutions of the present disclosure will be further described in detail below with reference to the accompanying drawings and embodiments. BRIEF DESCRIPTION OF DRAWINGS

[0023] Figure 1 is a flowchart of a content display method provided by an exemplary embodiment of the present disclosure.

[0024] Figure 2 is a schematic diagram of a virtual screen group in some exemplary embodiments of the present disclosure.

[0025] Figure 3 is a schematic diagram of the display effect of a virtual screen group in an exemplary embodiment of the present disclosure.

[0026] Figure 4 is a flowchart of a method for adding a virtual screen group in a three-dimensional space where a three-dimensional model is located, provided by some exemplary embodiments of the present disclosure.

[0027] Figure 5 is a flowchart of a method for determining a plurality of screen setting positions in a three-dimensional space in which a three-dimensional model is located, according to some example embodiments of the present disclosure.

[0028] Figure 6 is a flowchart of a method for determining a respective material content of each virtual screen in a virtual screen group, according to some example embodiments of the present disclosure.

[0029] Figure 7 is a flowchart of a method for moving a virtual screen group, according to some example embodiments of the present disclosure.

[0030] Figure 8 is a flowchart of a method for determining a screen movement vector, according to some example embodiments of the present disclosure.

[0031] Figure 9 is a flowchart of a method for moving a virtual screen group, according to some example embodiments of the present disclosure.

[0032] Figure 10 is a flowchart of a method for moving a virtual screen group, according to some example embodiments of the present disclosure.

[0033] Figure 11 is a schematic diagram of a display effect of a virtual screen group, according to another example embodiment of the present disclosure.

[0034] Figure 12 is a schematic diagram of a content display device, according to some example embodiments of the present disclosure.

[0035] Figure 13 is a schematic diagram of a content display device, according to some example embodiments of the present disclosure.

[0036] Figure 14 is a schematic diagram of an electronic device, according to an example embodiment of the present disclosure. DETAILED DESCRIPTION

[0037] Example embodiments according to the present disclosure will be described in detail below with reference to the accompanying drawings. The described embodiments are merely some embodiments of the present disclosure, and the present disclosure is not limited to the example embodiments described herein.

[0038] It should be noted that the relative arrangement, numerical expressions, and numerical values of the components and steps set forth in these embodiments do not limit the scope of the present disclosure, unless otherwise specifically stated.

[0039] Those skilled in the art will understand that the terms "first," "second," etc., in the embodiments of this disclosure are only used to distinguish different steps, devices, or modules, and do not represent specific technical meanings or necessary logical sequences. "Multiple" can refer to two or more, and "at least one" can refer to one, two, or more.

[0040] It should also be understood that any component, data or structure mentioned in the embodiments of this disclosure can generally be understood as one or more unless expressly defined or given to the contrary in the context.

[0041] In this disclosure, the term "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. In this disclosure, the character " / " generally indicates that the preceding and following related objects are in an "or" relationship.

[0042] It should also be understood that the description of the various embodiments in this disclosure emphasizes the differences between the various embodiments, and the similarities or similarities can be referred to each other. For the sake of brevity, they will not be described in detail.

[0043] The embodiments disclosed herein can be applied to electronic devices such as terminal devices, computer systems, and servers, and can operate together with a wide range of other general-purpose or special-purpose computing system environments or configurations. Examples of well-known terminal devices, computing systems, environments, and / or configurations suitable for use with electronic devices such as terminal devices, computer systems, and servers include, but are not limited to: personal computer systems, server computer systems, thin clients, thick clients, handheld or laptop devices, microprocessor-based systems, set-top boxes, programmable consumer electronics, network PCs, minicomputer systems, mainframe computer systems, and distributed cloud computing environments including any of the above systems, etc.

[0044] Electronic devices such as terminal devices, computer systems, and servers can be described in the general context of computer system executable instructions (such as program modules) executed by a computer system. Typically, program modules can include routines, programs, object programs, components, logic, data structures, etc., which perform specific tasks or implement specific abstract data types. Computer systems / servers can be implemented in distributed cloud computing environments, where tasks are performed by remote processing devices linked through communication networks. In distributed cloud computing environments, program modules can reside on local or remote computing system storage media, including storage devices.

[0045] Exemplary method

[0046] Figure 1 This is a flowchart illustrating a content display method provided by some exemplary embodiments of this disclosure.Figure 1 The method shown may include steps 120, 130, 140, 150 and 160.

[0047] Step 120: Determine the screen reference position in the 3D model.

[0048] Optionally, a 3D model of the target object can be drawn using 3D software. In one example, the target object can be an indoor scene, and the 3D model can be a 3D house model. Of course, the target object is not limited to an indoor scene; it can also be an outdoor scene, and this disclosure does not limit it. For ease of understanding, the embodiments of this disclosure are all illustrated using the case of a 3D house model as an example.

[0049] Optionally, a panoramic image of the interior space of the 3D house model can be displayed on the screen of an electronic device. The electronic device may include, but is not limited to, mobile phones, tablets, etc.

[0050] Optionally, the user can specify the location where a virtual screen should be added to the 3D model through the first input operation. The user-specified location can then serve as the reference location for adding the screen. The first input operation can include, but is not limited to, touch input, keyboard input, mouse input, and voice input. Other types of input operations discussed below can be referenced in the description of the first input operation types in this section; further details on other input operation types will not be provided thereafter.

[0051] Step 130: Determine the viewing direction of the 3D model.

[0052] Optionally, the user can specify the direction facing when observing the 3D model through a second input operation, and the direction specified by the user can be used as the viewing direction.

[0053] Step 140: Based on the screen, add reference positions and viewing directions, and add virtual screen groups in the 3D space where the 3D model is located.

[0054] Optionally, the three-dimensional space in which the three-dimensional model resides can be a virtual reality (VR) space.

[0055] Optionally, a virtual screen group may include multiple virtual screens. For example, such as Figure 2As shown, a virtual screen group can include N virtual screens, namely virtual screen 1, virtual screen 2, virtual screen 3, ..., virtual screen N. The value of N can be a pre-set value, or it can be a value determined through calculation. The shapes and sizes of the N virtual screens can be the same or substantially the same. The N virtual screens can be parallel or substantially parallel to each other. All N virtual screens can be transparent. The position, orientation, and other information of each of the N virtual screens in three-dimensional space can be determined based on adding reference positions to the screens and the direction of the viewing line. For clarity, examples of this determination method will be provided later.

[0056] Step 150: Determine the material content corresponding to each of the multiple virtual screens in the virtual screen group.

[0057] Optionally, users can specify the content for each of the multiple virtual screens via a third-party input method. The types of content can include, but are not limited to, text, images, and patterns.

[0058] In some embodiments, the content corresponding to each of the multiple virtual screens can also be automatically determined by an algorithm. For clarity, the determination method will be illustrated with examples later.

[0059] Step 160: Display the corresponding material content through multiple virtual screens.

[0060] Optionally, the content can be displayed on multiple virtual screens according to a pre-defined display style; that is, the display style used on multiple virtual screens can be uniform. The display style may include, but is not limited to, scaling ratio, alignment, etc.

[0061] In some embodiments, a user can specify a display style for multiple virtual screens separately through a fourth input operation; that is, the display styles used by the multiple virtual screens can be different.

[0062] In one example, there can be two screen reference positions: one for the first screen and one for the second screen. Corresponding to the first screen reference position, as shown... Figure 3 As shown, two virtual screens can be added in 3D space. One virtual screen is used to display the first material content 210, and the other virtual screen is used to display the second material content 220. A reference position is added corresponding to the second screen, such as... Figure 3 As shown, three virtual screens can be added in three-dimensional space. One virtual screen is used to display the third material content 230, another virtual screen is used to display the fourth material content 240, and the third virtual screen is used to display the fifth material content 250.

[0063] In the embodiments of this disclosure, a screen addition reference position and the viewing direction of the 3D model can be determined. Combining the screen addition reference position and the viewing direction, a virtual screen group can be added in the 3D space where the 3D model is located. Multiple virtual screens within the virtual screen group can then display corresponding content. Thus, in a 3D model display scenario, not only can the information of the object represented by the 3D model itself be presented, but additional information can also be presented through multiple virtual screens in the virtual screen group. Therefore, the information presented to the user is richer, better meeting practical needs.

[0064] Figure 4 This is a flowchart illustrating a method for adding virtual screen groups in a three-dimensional space containing a three-dimensional model, provided by some exemplary embodiments of this disclosure. Figure 4 The method shown may include steps 410, 420, and 430. Optionally, a combination of steps 410, 420, and 430 may be used as an alternative implementation of step 140 of this disclosure.

[0065] Step 410: Determine the screen normal direction based on the reference position added to the screen and the direction of the viewing line.

[0066] Optionally, the direction passing through the reference position on the screen and parallel to the viewing direction can be used as the screen normal direction. Alternatively, the direction passing through the reference position on the screen and slightly deviating from the viewing direction can also be used as the screen normal direction.

[0067] Step 420: Based on the screen reference position and screen normal direction, determine multiple screen setting positions in the 3D space where the 3D model is located.

[0068] In some alternative embodiments of this disclosure, such as Figure 5 As shown, step 420 may include steps 4201, 4203, 4205, 4207 and 4209.

[0069] Step 4201: Determine the image to be displayed.

[0070] Optionally, users can select an image from the image library through the fifth input operation, and the selected image can then be used as the image to be displayed.

[0071] Step 4203: Segment the image to be displayed to obtain multiple segmented images.

[0072] Step 4205: Determine the first number of segmented images included in the multiple segmented images.

[0073] Optionally, the image to be displayed can be segmented according to a preset segmentation rule to obtain multiple segmented images. For example, the image can be segmented according to foreground and background ranges, resulting in two segmented images (i.e., a first quantity of 2), where one segmented image is the foreground and the other is the background image. The foreground and background images can correspond to different depth ranges. As another example, the image can be segmented according to foreground, midground, and background ranges, resulting in three segmented images (i.e., a first quantity of 3), where one segmented image is the foreground, another is the midground, and the third is the background image. The foreground, midground, and background images can correspond to different depth ranges. Yet another example is segmenting the image according to object type. Assuming the image contains five animals, the multiple segmented images can be five segmented images (i.e., a first quantity of 5), with each segmented image containing one animal.

[0074] Step 4207: Based on the first number, determine the second number of virtual screens to be added.

[0075] Optionally, the first quantity can be directly determined as the second quantity, that is, the second quantity and the first quantity can be the same. Of course, the second quantity and the first quantity can also be different. For example, if the value of the second quantity is greater than a preset quantity, then the preset quantity can be determined as the second quantity, or the product of the first preset quantity and a preset coefficient (which is less than 1) can be used as the second quantity.

[0076] Step 4209: Based on the screen reference position and screen normal direction, determine the second number of screen setting positions in the three-dimensional space where the three-dimensional model is located.

[0077] Optionally, the straight line containing the screen normal direction (hereinafter referred to as the target straight line) and the viewpoint position in the 3D model (i.e., the viewpoint position when the user observes the 3D model) can be determined. Next, starting from the point where the screen reference position is added, points can be taken at equal intervals along the target straight line in a direction away from the viewpoint position until a second number of points are taken (the first point in the second number of points is the point where the screen reference position is added). The position of each point in the second number of points can be used as a screen setting position, thus determining the second number of screen setting positions.

[0078] Of course, the method for determining the second number of screen positions is not limited to this. For example, points can be selected along a direction away from the viewing point, not according to the equal spacing rule, but according to the rule of gradually increasing or decreasing spacing. Another example is that points can be selected not from the point where the screen reference position is located, but from other points on the target line that are relatively close to the point where the screen reference position is located.

[0079] Figure 4 In the illustrated embodiment, the image to be displayed can be segmented, and a second number of virtual screens to be added can be adaptively determined by referring to a first number of segmented images. This allows for the subsequent determination of the screen setting positions for the second number of virtual screens, and the addition of a virtual screen group comprising the second number of virtual screens into the three-dimensional space. This approach can better ensure the reasonableness of the number of virtual screens included in the virtual screen group, avoiding an excessive or insufficient number of virtual screens. This approach is beneficial for displaying additional information while minimizing the impact on the display effect of the three-dimensional model.

[0080] Of course, step 420 is not limited to Figure 4 The implementation method is shown below. For example, on the target straight line, starting from the reference position added to the screen, points can be taken at equal intervals along the direction away from the observation viewpoint until a preset number of points are taken. This can determine a preset number of screen setting positions, which can then be used as multiple screen setting positions in step 420.

[0081] Step 430: Based on the positions and normal directions of multiple screens, add a virtual screen group in the 3D space where the 3D model is located.

[0082] Optionally, a virtual screen can be added to each of the multiple screen setting locations, and each virtual screen can be made perpendicular or substantially perpendicular to the screen normal direction. In this way, the virtual screen group can be added in three-dimensional space.

[0083] In the embodiments of this disclosure, by combining the screen addition reference position and the viewing direction, the screen normal direction can be reasonably determined. For example, the screen normal direction can be adapted to the viewing direction. By combining the screen addition reference position and the screen normal direction, multiple screen setting positions can be reasonably determined. By combining multiple screen setting positions and the screen normal direction, the position and orientation of each virtual screen in three-dimensional space can be clearly defined. Based on this, the addition of virtual screen groups can be realized efficiently and reliably. Furthermore, since the screen normal direction is adapted to the viewing direction, it is convenient for users to view the material content displayed on each virtual screen.

[0084] Figure 6This is a flowchart illustrating a method for determining the material content corresponding to each of multiple virtual screens in a virtual screen group, provided by some exemplary embodiments of this disclosure. Figure 6 The method shown may include steps 610, 620, and 630. Optionally, a combination of steps 610, 620, and 630 may be used as an alternative implementation of step 150 of this disclosure.

[0085] Step 610: Based on the distance between the screen setting position and the screen addition reference position of each of the multiple virtual screens in the virtual screen group, determine the screen layer information corresponding to each of the multiple virtual screens.

[0086] Optionally, for any one of the multiple virtual screens, the distance between the screen setting position and the screen addition reference position can be determined through simple geometric calculations.

[0087] Based on the distances between multiple virtual screens, the screen hierarchy information corresponding to each virtual screen can be determined. For example, ... Figure 2 As shown, there are N virtual screens. According to the order of their corresponding distances from smallest to largest, the N virtual screens are virtual screen 1, virtual screen 2, ..., virtual screen N. Then, the screen layer information corresponding to virtual screen 1 can be determined as layer 1, the screen layer information corresponding to virtual screen 2 can be determined as layer 2, ..., and the screen layer information corresponding to virtual screen N can be determined as layer N.

[0088] Of course, the method of determining the screen layer information corresponding to each of the multiple virtual screens is not limited to this. For example, a correspondence between distance range and layer can be set. For any virtual screen, the distance range to which the virtual screen belongs can be determined, and the layer corresponding to the distance range can be used as the screen layer information corresponding to the virtual screen.

[0089] Step 620: Based on the screen hierarchy information corresponding to each of the multiple virtual screens, determine the segmentation image corresponding to each of the multiple segmentation images from the multiple segmentation images.

[0090] Optionally, for any virtual screen among multiple virtual screens, a depth range that matches the screen hierarchy information corresponding to the virtual screen can be determined, and the segmentation image corresponding to the depth range can be selected from multiple segmentation images as the segmentation image corresponding to the virtual screen.

[0091] In one example, by segmenting the image to be displayed, three segmented images can be obtained: a foreground image, a middle image, and a background image. The N virtual screens can be three virtual screens: Virtual Screen 1, Virtual Screen 2, and Virtual Screen 3. Virtual Screen 1 corresponds to layer 1, Virtual Screen 2 to layer 2, and Virtual Screen 3 to layer 3. That is, among Virtual Screen 1, Virtual Screen 2, and Virtual Screen 3, Virtual Screen 1 is closest to the viewpoint, and Virtual Screen 3 is farthest from the viewpoint. Since the depth value in the depth range corresponding to the foreground image is less than the depth value in the depth range corresponding to the middle image, and the depth value in the depth range corresponding to the middle image is less than the depth value in the depth range corresponding to the background image, the depth range corresponding to the foreground image can be used as the depth range adapted to layer 1, the depth range corresponding to the middle image as the depth range adapted to layer 2, and the depth range corresponding to the background image as the depth range adapted to layer 3. In this way, the foreground image can be determined as the segmented image corresponding to virtual screen 1, the middle image can be determined as the segmented image corresponding to virtual screen 2, and the background image can be determined as the segmented image corresponding to virtual screen 3.

[0092] Of course, the implementation of step 620 is not limited to this. For example, for any virtual screen among multiple virtual screens, an object type that matches the screen hierarchy information corresponding to that virtual screen can be determined, and a segmentation image that includes objects of that object type can be selected from multiple segmentation images as the segmentation image corresponding to that virtual screen.

[0093] Step 630: For any virtual screen among the multiple virtual screens, determine the material content corresponding to the virtual screen based on the segmented image corresponding to the virtual screen.

[0094] Optionally, for any virtual screen among multiple virtual screens, the segmented image corresponding to that virtual screen can be directly determined as the material content corresponding to that virtual screen. Alternatively, the segmented image corresponding to that virtual screen can be preprocessed such as denoising and enhancement, and the preprocessed segmented image can be determined as the material content corresponding to that virtual screen.

[0095] In the embodiments of this disclosure, the distance between the screen setting position and the screen addition reference position of each of the multiple virtual screens in the virtual screen group can be referenced to reasonably determine the screen layer information for the multiple virtual screens. Based on the determined screen layer information, the corresponding segmented images can be reasonably determined for the multiple virtual screens. In this way, suitable material content can be adaptively determined for the virtual screens for display without the need for the user to specify the material content corresponding to each of the multiple virtual screens. The degree of intelligence is high, which is conducive to improving the user experience.

[0096] Figure 7 This is a flowchart illustrating a method for moving virtual screen groups provided by some exemplary embodiments of this disclosure. Figure 7 The method shown may include steps 710 and 720.

[0097] Step 710: In response to a change in the direction of the viewing line, determine the screen movement vector based on the information about the change in the direction of the viewing line.

[0098] Optionally, the user can change the direction of their gaze through a sixth input operation. For example, before the user performs the sixth input operation, the direction of their gaze can be vector A, and after the user performs the sixth input operation, the direction of their gaze can be vector B. The information regarding the change in the direction of the gaze can include vector A, vector B, and the angle difference between vector B and vector A. In some embodiments, the information regarding the change in the direction of the gaze can also include the start time point and the end time point of the change.

[0099] In some alternative embodiments of this disclosure, such as Figure 8 As shown, determining the screen movement vector based on the change information of the viewing direction in step 710 may include steps 7101, 7103, 7105 and 7107.

[0100] Step 7101: Determine the first spatial coordinates of the reference virtual screen in the virtual screen group in the world coordinate system corresponding to the three-dimensional space before the direction of the observation line changes.

[0101] Optionally, the reference virtual screen in the virtual screen group can be the virtual screen closest to the viewing point in the virtual screen group. In one example, the reference virtual screen could be... Figure 2 Virtual screen 1 in the middle.

[0102] Optionally, the world coordinate system corresponding to the three-dimensional space can be a three-dimensional coordinate system constructed with any point in the three-dimensional space as the origin. The position of the reference virtual screen in the world coordinate system corresponding to the three-dimensional space can be represented by the position of the geometric center point of the reference virtual screen (or other points included in the reference virtual screen; in this disclosure, the case of the geometric center point is used as an example) in the world coordinate system.

[0103] Optionally, the first spatial coordinates can be represented as (x1, y1, z1).

[0104] Step 7103: Determine the screen coordinates of the reference virtual screen in the screen coordinate system corresponding to the device screen of the electronic device before the viewing direction changes.

[0105] Optionally, the screen coordinate system corresponding to the device screen can be a two-dimensional coordinate system constructed from any two-dimensional points included in the device screen (such as the top-left corner point, bottom-left corner point, etc.). The position of the reference virtual screen in the screen coordinate system can be characterized by the position of the geometric center point of the reference virtual screen in the screen coordinate system.

[0106] Alternatively, screen coordinates can be represented as (s, t).

[0107] Step 7105: With the screen coordinates corresponding to the reference virtual screen fixed as a constraint, and based on the change information of the viewing direction, determine the second spatial coordinates of the reference virtual screen in the world coordinate system after the viewing direction changes.

[0108] Optionally, the reference virtual screen can have a corresponding local coordinate system. The local coordinate system can be a three-dimensional coordinate system constructed with the geometric center point of the reference virtual screen as its origin. The user's observation of the three-dimensional model can involve a camera coordinate system. The transformation matrix between the local coordinate system and the world coordinate system can be represented as a ModelMatrix. The transformation matrix between the world coordinate system and the camera coordinate system can be represented as a viewMatrix. The transformation matrix between the camera coordinate system and the screen coordinate system can be represented as a projectionMatrix.

[0109] Before the direction of the line of sight changes, the following formula can be used:

[0110] (x, y, z, w) = projectionMatrix*viewMartix*ModelMatrix*(x0, y0, z0, 1.0)

[0111] (s, t) = (x / w, y / w)

[0112] Where (x0, y0, z0, 1.0) represents the homogeneous representation of the coordinates of the geometric center point of the reference virtual screen in the local coordinate system, and (x, y, z, w) represents the homogeneous representation of the screen coordinates.

[0113] As the viewing direction changes, the viewMatrix changes accordingly. The changed viewMatrix can be calculated based on the change in the viewing direction. Since the screen coordinates (s, t) are fixed as a constraint, (x, y, z, w) are also fixed. Furthermore, the projectionMatrix (x0, y0, z0, 1.0) can also be considered fixed. Therefore, to ensure the above formula remains valid, the ModelMatrix can be changed. Multiplying the changed ModelMatrix by (x0, y0, z0, 1.0) yields the second spatial coordinates. Optionally, the second spatial coordinates can be represented as (x2, y2, z2).

[0114] Step 7107: The vector pointing from the spatial position represented by the first spatial coordinates to the spatial position represented by the second spatial coordinates is used as the screen movement vector.

[0115] Optionally, the screen movement vector can be represented as v. Since the first spatial coordinates are represented as (x1, y1, z1) and the second spatial position is represented as (x2, y2, z2), then v = (x2 - x1, y2 - y1, z2 - z1).

[0116] It's important to note that the display of a virtual screen on the device screen involves three transformation matrices (MVP): the transformation matrix between the local coordinate system and the world coordinate system (M in MVP), the transformation matrix between the world coordinate system and the camera coordinate system (V in MVP), and the transformation matrix between the camera coordinate system and the screen coordinate system (P in MVP). For a point on the virtual screen, its coordinates can start in the local coordinate system. Using the three transformation matrices, these coordinates can be transformed sequentially into world coordinates, view coordinates, clip coordinates, and screen coordinates. In this way, by using the MVP matrix, the screen movement vector can be determined efficiently and reliably, effectively indicating the direction and distance of movement. Furthermore, since the determination of the screen movement vector is constrained by the fixed screen coordinates of the base virtual screen, after the virtual screen group's movement ends, from the user's perspective, the position of the virtual screen group on the device screen is the same as its position before the change in the viewing direction; that is, the position of the virtual screen group on the rendering canvas remains unchanged.

[0117] Step 720: Move the virtual screen group in three-dimensional space according to the screen movement vector so that the relative position of the virtual screen group and the three-dimensional model changes.

[0118] In some alternative embodiments of this disclosure, such as Figure 9 As shown, step 720 may include steps 7201, 7203 and 7205.

[0119] Step 7201: Obtain the screen hierarchy information corresponding to each of the multiple virtual screens in the virtual screen group.

[0120] In step 7201, the screen hierarchy information corresponding to each of the multiple virtual screens in the virtual screen group can be determined. The specific determination method can be found in the description of step 610 above. Alternatively, after determining the screen hierarchy information corresponding to each of the multiple virtual screens in step 610, this information can be recorded. In step 7201, the recorded screen hierarchy information corresponding to each of the multiple virtual screens can then be directly retrieved.

[0121] In some embodiments, users can also specify the screen hierarchy information corresponding to each of the multiple virtual screens through the seventh input operation.

[0122] Step 7203: Based on the screen hierarchy information corresponding to each of the multiple virtual screens, determine the movement time point corresponding to each of the multiple virtual screens.

[0123] Optionally, by referring to the screen hierarchy information corresponding to each of the multiple virtual screens, the movement time point corresponding to the higher-level virtual screen can be made later, and the movement time point corresponding to the lower-level virtual screen can be made earlier.

[0124] In one example, N virtual screens can be three virtual screens: Virtual Screen 1, Virtual Screen 2, and Virtual Screen 3. Virtual Screen 1 corresponds to screen layer 1, Virtual Screen 2 to screen layer 2, and Virtual Screen 3 to screen layer 3. Furthermore, if the change in the viewing direction ends at time point t1, then time point t1 can be taken as the movement time point for Virtual Screen 1. A time point t2, which is later than time point t1 by a preset duration, can be taken as the movement time point for Virtual Screen 2, and a time point t3, which is later than time point t2 by a preset duration, can be taken as the movement time point for Virtual Screen 3. The preset duration can include, but is not limited to, 0.2 seconds, 0.4 seconds, 0.5 seconds, 1 second, etc., and will not be listed here.

[0125] In some embodiments, the interval between time point t2 and time point t1, and the interval between time point t3 and time point t2, may not be a preset duration, but a randomly determined duration.

[0126] In other embodiments, time point t1 can be used as the movement time point corresponding to virtual screen 1, and time point t2, which is later than time point t1 by a preset time, can be used as the movement time points corresponding to virtual screen 2 and virtual screen 3 respectively.

[0127] Step 7205: For any virtual screen among the multiple virtual screens, starting from the movement time point corresponding to that virtual screen, move the virtual screen in three-dimensional space according to the screen movement vector.

[0128] Optionally, for any one of the multiple virtual screens, the virtual screen can be moved starting from the corresponding movement time point, and the movement direction and distance of the virtual screen are indicated by the screen movement vector. Furthermore, the virtual screen can move at a constant speed, accelerate, or decelerate.

[0129] Figure 9 In the illustrated embodiment, the screen hierarchy information corresponding to each of the multiple virtual screens can be referenced to determine appropriate movement time points for each virtual screen, so that each virtual screen starts moving from the corresponding movement time point. In this way, the start movement time of the multiple virtual screens can be different, thereby creating a staggered visual effect, bringing users a richer visual experience and dynamic perception, and enhancing the fun.

[0130] In some alternative embodiments of this disclosure, such as Figure 10 As shown, the method provided in the embodiments of this disclosure further includes steps 1010 and 1020.

[0131] Step 1010: In response to a change in the direction of the line of sight, determine the angular velocity of the process of the change in the direction of the line of sight.

[0132] Optionally, the information on the change in the line of sight can include the angle difference between vector B and vector A, as well as the start and end times of the change. The duration between the start and end times is the duration of the change. By dividing the angle difference by the duration of the change, the angular velocity of the change in the line of sight can be obtained.

[0133] Step 1020: Determine the screen movement speed that matches the angular velocity.

[0134] Optionally, a function (hereinafter referred to as the objective function) can be pre-defined with angular velocity as the independent variable and movement speed as the dependent variable; wherein, the movement speed can be positively correlated with the angular velocity. In this way, the angular velocity determined in step 1010 can be input into the objective function, and the corresponding movement speed can be determined through calculation. This movement speed can then be used as the screen movement speed in step 1010.

[0135] Accordingly, step 720, which involves moving the virtual screen group in three-dimensional space according to the screen movement vector, may include step 7207.

[0136] Step 7207: Move the virtual screen group in three-dimensional space according to the screen movement vector and screen movement speed.

[0137] Optionally, for any virtual screen among multiple virtual screens, movement can begin from the movement time point corresponding to that virtual screen, with the screen movement speed as the initial speed, and can proceed at a constant speed, accelerate, decelerate, etc. Furthermore, the movement direction and distance of the virtual screen are indicated by the screen movement vector.

[0138] It should be noted that the angular velocity of the observation line direction change process can characterize how quickly the observation line direction changes. Figure 10 In the embodiment shown, the screen movement speed can be reasonably determined based on the rate at which the viewing direction changes, which helps each virtual screen to move at an appropriate speed according to the actual situation.

[0139] In some embodiments, each virtual screen can be moved at a preset speed, without taking into account the angular velocity of the change in the direction of the viewing line.

[0140] In the embodiments of this disclosure, when the viewing direction changes, a screen movement vector can be reasonably determined, and the virtual screen group can be moved in three-dimensional space according to the screen movement vector. In this way, the virtual screen group can present a staggered and layered effect, for example... Figure 11 The layered effect creates a stronger sense of space. Furthermore, the movement of the virtual screen group allows for changes in its relative position to the 3D model in 3D space, ensuring that the final position of the virtual screen group displayed on the device screen remains constant, thus facilitating user viewing of the content displayed on each virtual screen.

[0141] In summary, the embodiments of this disclosure can display a set of staggered virtual screens with spatial relationships in VR space, for example, as... Figure 2 As shown, virtual screens 1, 2, ..., N can be displayed, and these virtual screens can extend along the viewing direction. Virtual screen 1 can be considered the base layer, virtual screen 2 the intermediate layer, and virtual screen N the surface layer. The distance d between the base layer and the surface layer can be considered the height of the entire layered virtual screen. Users can actively upload the content they want to display on each virtual screen.

[0142] Furthermore, when a user views the layered virtual screens, if the direction of their gaze changes, the different virtual screens can be controlled to begin moving at different points in time. For example, once the direction of the gaze changes, the base layer immediately begins moving, the surface layer begins moving after a 1-second delay, and the middle layer begins moving after a delay of t (t is greater than 0 and less than 1) seconds, with the value of t increasing as the distance between the middle layer and the base layer increases. Optionally, the base layer, middle layer, and surface layer can all decelerate their movement, and their respective accelerations can be different. For example, the absolute value of the acceleration of the middle layer can be greater than that of the base layer, and the absolute value of the acceleration of the surface layer can be greater than that of the middle layer. This allows users to obtain a richer visual experience and dynamic perception, enhancing interest and the sense of hierarchy.

[0143] Any content display method provided in the embodiments of this disclosure can be executed by any suitable device with data processing capabilities, including but not limited to: terminal devices and servers. Alternatively, any content display method provided in the embodiments of this disclosure can be executed by a processor, such as by a processor executing any content display method mentioned in the embodiments of this disclosure by calling corresponding instructions stored in memory. Further details will not be elaborated below.

[0144] Exemplary apparatus

[0145] Figure 12 This is a schematic diagram of the structure of a content display device provided in some exemplary embodiments of this disclosure. Figure 12 The apparatus shown includes:

[0146] The first determining module 1220 is used to determine the screen addition reference position in the 3D model;

[0147] The second determining module 1230 is used to determine the viewing direction of the three-dimensional model;

[0148] Add module 1240 to add reference positions and viewing directions based on the screen, and add virtual screen groups in the 3D space where the 3D model is located.

[0149] The third determining module 1250 is used to determine the material content corresponding to each of the multiple virtual screens in the virtual screen group;

[0150] The display module 1260 is used to display corresponding material content through multiple virtual screens.

[0151] In some optional examples, such as Figure 13 As shown, the apparatus provided in the embodiments of this disclosure further includes:

[0152] The fourth determining module 1310 is used to determine the screen movement vector based on the information of the change in the direction of the viewing line in response to a change in the viewing line direction.

[0153] The moving module 1320 is used to move the virtual screen group in three-dimensional space according to the screen moving vector so that the relative position of the virtual screen group and the three-dimensional model changes.

[0154] In some optional examples, the fourth determining module 1310 includes:

[0155] The first determination submodule is used to determine the first spatial coordinates of the reference virtual screen in the virtual screen group in the world coordinate system corresponding to the three-dimensional space before the direction of the observation line changes;

[0156] The second determination submodule is used to determine the screen coordinates of the reference virtual screen in the screen coordinate system corresponding to the device screen of the electronic device before the viewing direction changes.

[0157] The third determination submodule is used to determine the second spatial coordinates of the reference virtual screen in the world coordinate system after the viewing direction changes, based on the information about the change in the viewing direction, with the screen coordinates corresponding to the reference virtual screen fixed as a constraint.

[0158] The fourth determination submodule is used to take the vector from the spatial position represented by the first spatial coordinates to the spatial position represented by the second spatial coordinates as the screen movement vector.

[0159] In some optional examples, the mobile module 1320 includes:

[0160] The acquisition submodule is used to obtain the screen hierarchy information corresponding to each of the multiple virtual screens in the virtual screen group;

[0161] The fifth determination submodule is used to determine the movement time point corresponding to each of the multiple virtual screens based on the screen layer information corresponding to each of the multiple virtual screens.

[0162] The movement submodule is used to move any virtual screen among multiple virtual screens in three-dimensional space, starting from the movement time point corresponding to that virtual screen, according to the screen movement vector.

[0163] In some optional examples, such as Figure 13 As shown, the apparatus in the embodiments of this disclosure further includes:

[0164] The fifth determining module 1330 is used to determine the angular velocity of the process of changing the direction of the observation line in response to a change in the direction of the observation line;

[0165] The sixth determining module 1340 is used to determine the screen movement speed adapted to the angular velocity;

[0166] The movement module 1320 is specifically used to move the virtual screen group in three-dimensional space according to the screen movement vector and the screen movement speed.

[0167] In some optional examples, module 1240 is added, including:

[0168] The sixth submodule is used to determine the screen normal direction based on the added reference position and viewing direction on the screen.

[0169] The seventh submodule is used to determine multiple screen setting positions in the 3D space where the 3D model is located, based on the added reference position and screen normal direction.

[0170] Add a submodule to add virtual screen groups in the 3D space where the 3D model is located, based on the position and screen normal direction of multiple screens.

[0171] In some optional examples, the seventh determined submodule includes:

[0172] The first determining unit is used to determine the image to be displayed;

[0173] The segmentation unit is used to segment the image to be displayed, resulting in multiple segmented images;

[0174] The second determining unit is used to determine a first number of segmented images included in the multiple segmented images;

[0175] The third determining unit is used to determine the second number of virtual screens to be added based on the first number;

[0176] The fourth determining unit is used to determine a second number of screen setting positions in the three-dimensional space where the three-dimensional model is located, based on the screen added reference position and the screen normal direction.

[0177] In some optional examples, the third determining module 1250 includes:

[0178] The eighth determination submodule is used to determine the screen hierarchy information corresponding to each of the multiple virtual screens in the virtual screen group based on the distance between the screen setting position and the screen addition reference position of each of the multiple virtual screens.

[0179] The ninth determination submodule is used to determine the segmentation image corresponding to each of the multiple virtual screens from multiple segmentation images based on the screen layer information corresponding to each of the multiple virtual screens.

[0180] The tenth determination submodule is used to determine the material content corresponding to any virtual screen among multiple virtual screens, based on the segmented image corresponding to that virtual screen.

[0181] Exemplary electronic device

[0182] Below, for reference Figure 14 This describes an electronic device according to embodiments of the present disclosure. The electronic device may be either or both of a first device and a second device, or a standalone device independent of them, which may communicate with the first device and the second device to receive acquired input signals from them.

[0183] Figure 14 A block diagram of an electronic device 1400 according to an embodiment of the present disclosure is shown.

[0184] like Figure 14 As shown, the electronic device 1400 includes one or more processors 1410 and memory 1420.

[0185] The processor 1410 may be a central processing unit (CPU) or other form of processing unit with data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 1400 to perform desired functions.

[0186] The memory 1420 can store one or more computer program products. The memory 1420 may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may, for example, include random access memory (RAM) and / or cache memory. The non-volatile memory may, for example, include read-only memory (ROM), hard disk, flash memory, etc. One or more computer program products may be stored on the computer-readable storage medium, and the processor 1410 can run the computer program products to implement the content display methods of the various embodiments of this disclosure described above and / or other desired functions.

[0187] In one example, the electronic device 1400 may also include an input device 1430 and an output device 1440, which are interconnected via a bus system and / or other forms of connection mechanism (not shown).

[0188] For example, when electronic device 1400 is a first device or a second device, the input device 1430 may be a microphone or a microphone array. When electronic device 1400 is a standalone device, the input device 1430 may be a communication network connector for receiving acquired input signals from the first device and the second device.

[0189] In addition, the input device 1430 may also include, for example, a keyboard, a mouse, etc.

[0190] The output device 1440 can output various information to the outside. The output device 1440 may include, for example, a display, a speaker, a printer, and a communication network and its connected remote output devices, etc.

[0191] Of course, for the sake of simplicity, Figure 14 Only some of the components of the electronic device 1400 relevant to this disclosure are shown, omitting components such as buses, input / output interfaces, etc. In addition, the electronic device 1400 may include any other suitable components depending on the specific application.

[0192] Exemplary computer program product and computer readable storage medium

[0193] In addition to the methods and apparatus described above, embodiments of this disclosure may also be computer program products comprising computer program instructions that, when executed by a processor, cause the processor to perform the steps of the content display methods according to various embodiments of this disclosure as described in the "Exemplary Methods" section of this specification.

[0194] The computer program product can be written in any combination of one or more programming languages ​​to perform the operations of the embodiments of this disclosure. The programming languages ​​include object-oriented programming languages ​​such as Java and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on a user's computing device, partially on a user's computing device, as a standalone software package, partially on a user's computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0195] Furthermore, embodiments of this disclosure may also be computer-readable storage media storing computer program instructions that, when executed by a processor, cause the processor to perform the steps of the content display methods according to various embodiments of this disclosure as described in the "Exemplary Methods" section above.

[0196] The computer-readable storage medium may be any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may, for example, include, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0197] The basic principles of this disclosure have been described above with reference to specific embodiments. However, it should be noted that the advantages, benefits, and effects mentioned in this disclosure are merely examples and not limitations, and should not be considered as essential features of each embodiment of this disclosure. Furthermore, the specific details disclosed above are for illustrative and facilitative purposes only, and are not limitations. These details do not limit the scope of this disclosure to the necessity of employing the aforementioned specific details for implementation.

[0198] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For system embodiments, since they largely correspond to method embodiments, the description is relatively simple; relevant parts can be referred to the descriptions in the method embodiments.

[0199] The block diagrams of devices, apparatuses, devices, and systems disclosed herein are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As those skilled in the art will recognize, these devices, apparatuses, devices, and systems can be connected, arranged, and configured in any manner. Words such as “comprising,” “including,” “having,” etc., are open-ended terms meaning “including but not limited to,” and are used interchangeably with them. The terms “or” and “and” as used herein refer to the terms “and / or,” and are used interchangeably with them unless the context clearly indicates otherwise. The term “such as” as used herein refers to the phrase “such as but not limited to,” and is used interchangeably with it.

[0200] The methods and apparatus of this disclosure may be implemented in many ways. For example, they may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above-described order of steps for the methods is for illustrative purposes only, and the steps of the methods of this disclosure are not limited to the order specifically described above unless otherwise specifically stated. Furthermore, in some embodiments, this disclosure may also be implemented as a program recorded on a recording medium, the program including machine-readable instructions for implementing the methods according to this disclosure. Thus, this disclosure also covers recording media storing programs for performing the methods according to this disclosure.

[0201] It should also be noted that in the apparatus, devices, and methods of this disclosure, the components or steps can be disassembled and / or recombined. These disassemblies and / or recombinations should be considered as equivalent solutions to this disclosure.

[0202] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use this disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of this disclosure. Therefore, this disclosure is not intended to be limited to the aspects shown herein, but rather to be carried out within the widest scope consistent with the principles and novel features disclosed herein.

[0203] The above description has been given for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of this disclosure to the forms disclosed herein. Although numerous exemplary aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, alterations, additions, and sub-combinations therein.

Claims

1. A content display method, characterized in that, include: Determine the screen location in the 3D model and add a reference position; Determine the viewing direction of the three-dimensional model; Based on the reference position added to the screen and the direction of the viewing line, a virtual screen group is added to the three-dimensional space where the three-dimensional model is located. Determine the content material corresponding to each of the multiple virtual screens in the virtual screen group; The corresponding content is displayed on the multiple virtual screens respectively; The method further includes: In response to a change in the direction of the viewing line, a screen movement vector is determined based on the information about the change in the direction of the viewing line; The virtual screen group is moved in the three-dimensional space according to the screen movement vector, so that the relative position of the virtual screen group and the three-dimensional model changes.

2. The method according to claim 1, characterized in that, Determining the screen movement vector based on the change information in the viewing direction includes: Before the direction of the observation line changes, the first spatial coordinates of the reference virtual screen in the virtual screen group in the world coordinate system corresponding to the three-dimensional space; Before the direction of the observation line changes, the screen coordinates of the reference virtual screen in the screen coordinate system corresponding to the device screen of the electronic device; With the screen coordinates corresponding to the reference virtual screen fixed as a constraint, and based on the change information of the viewing direction, the second spatial coordinates of the reference virtual screen in the world coordinate system are determined after the viewing direction changes. The vector pointing from the spatial position represented by the first spatial coordinates to the spatial position represented by the second spatial coordinates is used as the screen movement vector.

3. The method according to claim 1, characterized in that, Moving the virtual screen group in the three-dimensional space according to the screen movement vector includes: Obtain the screen hierarchy information corresponding to each of the multiple virtual screens in the virtual screen group; Based on the screen hierarchy information corresponding to each of the multiple virtual screens, the movement time point corresponding to each of the multiple virtual screens is determined; For any one of the multiple virtual screens, starting from the movement time point corresponding to that virtual screen, the virtual screen is moved in the three-dimensional space according to the screen movement vector.

4. The method according to claim 1, characterized in that, The method further includes: In response to a change in the direction of the observation line, the angular velocity of the change in the direction of the observation line is determined; Determine the screen movement speed that matches the angular velocity; Moving the virtual screen group in the three-dimensional space according to the screen movement vector includes: The virtual screen group is moved in the three-dimensional space according to the screen movement vector and the screen movement speed.

5. The method according to claim 1, characterized in that, The step of adding a virtual screen group in the three-dimensional space where the three-dimensional model is located, based on the reference position added to the screen and the viewing direction, includes: Based on the reference position added to the screen and the direction of the viewing line, the screen normal direction is determined; Based on the screen reference position and the screen normal direction, multiple screen setting positions are determined in the three-dimensional space where the three-dimensional model is located. Based on the multiple screen settings positions and the screen normal directions, a virtual screen group is added in the three-dimensional space where the three-dimensional model is located.

6. The method according to claim 5, characterized in that, The step of determining multiple screen setting positions in the three-dimensional space where the three-dimensional model is located, based on the added reference position of the screen and the screen normal direction, includes: Determine the image to be displayed; The image to be displayed is segmented to obtain multiple segmented images; Determine a first number of segmented images included in the plurality of segmented images; Based on the first number, determine the second number of virtual screens to be added; Based on the screen reference position and the screen normal direction, the second number of screen setting positions are determined in the three-dimensional space where the three-dimensional model is located.

7. The method according to claim 6, characterized in that, Determining the content corresponding to each of the multiple virtual screens in the virtual screen group includes: Based on the distance between the screen setting position of each of the multiple virtual screens in the virtual screen group and the screen addition reference position, the screen layer information corresponding to each of the multiple virtual screens is determined; Based on the screen hierarchy information corresponding to each of the multiple virtual screens, the segmentation image corresponding to each of the multiple segmentation images is determined from the multiple segmentation images; For any virtual screen among the multiple virtual screens, the material content corresponding to that virtual screen is determined based on the segmented image corresponding to that virtual screen.

8. A content display device, characterized in that, include: The first determining module is used to determine the screen addition reference position in the 3D model; The second determining module is used to determine the viewing direction of the three-dimensional model; An addition module is used to add a virtual screen group in the three-dimensional space where the three-dimensional model is located, based on the screen adding a reference position and the viewing direction; The third determining module is used to determine the material content corresponding to each of the multiple virtual screens in the virtual screen group; The display module is used to display corresponding material content through the multiple virtual screens; The device further includes: The fourth determining module is used to determine the screen movement vector based on the change information of the viewing direction in response to a change in the viewing direction. A movement module is used to move the virtual screen group in the three-dimensional space according to the screen movement vector, so as to change the relative position of the virtual screen group and the three-dimensional model.

9. A computer-readable storage medium having computer program instructions stored thereon, characterized in that, When the computer program instructions are executed by the processor, they implement the content display method according to any one of claims 1 to 7.

Images