Information display method and device, computer equipment and storage medium

Abstract

The invention provides an information display method and device, computer equipment and a storage medium, which can generate a fisheye image corresponding to a three-dimensional scene model after the three-dimensional scene model is rendered by using a three-dimensional virtual engine, thereby displaying the effect of the three-dimensional scene model by using the fisheye image and realizing multi-angle display of the three-dimensional scene model. Moreover, according to the method, the second position information of the target scene image in the fisheye image can be determined by using the first position information of the target scene object in the three-dimensional scene model, so that the label information of the target scene object can be displayed in the fisheye image by using the second position information, and a user can conveniently know the overall layout of the scene.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to an information display method, device, computer equipment and storage medium. Background Art

[0002] In the scene of decoration design, designers need to carry out a series of designs for the decoration scene, such as interior layout design, color and material design, furniture and furniture accessories design, lighting design, etc. Designers usually use three-dimensional virtual engines for decoration design. The design effect of decoration design is usually displayed in the form of two-dimensional images (such as floor plans, layouts, color samples).

[0003] However, two-dimensional images cannot present the actual dynamics and fluidity of space, making it difficult for users to fully understand the actual feeling of the space; and pictures usually only show one or a limited number of perspectives, which cannot meet the needs of users to observe scene design from different angles. Summary of the invention

[0004] The embodiments of the present disclosure at least provide an information display method, apparatus, computer equipment and storage medium.

[0005] In a first aspect, an embodiment of the present disclosure provides an information display method, including:

[0006] Acquire a three-dimensional scene model rendered by a three-dimensional virtual engine; the three-dimensional scene model includes a plurality of target scene objects;

[0007] Generating a fisheye image corresponding to the three-dimensional scene model;

[0008] Determining second position information of each target scene object in the fisheye image according to first position information of each target scene object in the three-dimensional scene model;

[0009] According to the second position information of each target scene object, label information of each target scene object is displayed in the fisheye image.

[0010] In an optional implementation manner, displaying label information of each target scene object in the fisheye image according to the second position information of each target scene object includes:

[0011] For any of the target scene objects, displaying label information of the target scene object at a target position corresponding to the second position information in the fisheye image according to the second position information of the target scene object;

[0012] Among them, the second position information is used to indicate the position range information of the target scene object; the target position includes: a first position located within the position range of the target scene object, or a second position located outside the position range of the target scene object and the position relationship between the second position and the target scene object satisfies a preset position relationship.

[0013] In an optional implementation manner, a target position corresponding to the second position information is determined according to the following steps;

[0014] According to the user's current observation angle of view relative to the fisheye image and the observation position information, a target position corresponding to the second position information is determined.

[0015] In an optional implementation manner, before determining the second position information of the target scene object in the fisheye image, the method further includes:

[0016] According to the preset target scene object type of the position information to be marked, a target scene object belonging to the target scene object type in the three-dimensional scene model is identified; the target scene object type is business scene related.

[0017] In an optional implementation manner, generating a fisheye image corresponding to the three-dimensional scene model includes:

[0018] According to the three-dimensional scene model, collecting scene images from multiple perspectives;

[0019] The scene images of the multiple perspectives are stitched together to generate the fisheye image.

[0020] In an optional implementation manner, determining the second position information of the target scene object in the fisheye image according to the first position information of each target scene object in the three-dimensional scene model includes:

[0021] For any target scene object, according to the conversion relationship between the three-dimensional coordinate system of the three-dimensional scene model and the spherical coordinate system, convert the first position information of the target scene object in the three-dimensional coordinate system of the three-dimensional scene model into the third position information in the spherical coordinate system;

[0022] According to the conversion relationship between the spherical coordinate system and the image coordinate system of the fisheye image, the third position information in the spherical coordinate system is converted into the second position information of the target scene object in the image coordinate system of the fisheye image.

[0023] In an optional implementation, converting the third position information in the spherical coordinate system into the second position information of the target scene object in the image coordinate system of the fisheye image according to the conversion relationship between the spherical coordinate system and the image coordinate system of the fisheye image includes:

[0024] Acquire a first value range of each coordinate axis in the spherical coordinate system and a second value range of each coordinate axis in the image coordinate system; the value range of each coordinate axis in the spherical coordinate system is determined based on the observation field of view range requirement of the three-dimensional scene model;

[0025] For any angular coordinate axis in the spherical coordinate system, based on the trigonometric function representation corresponding to the coordinates of the angular coordinate axis, convert the first value range into a third value range represented in radians;

[0026] Determining a conversion relationship between the spherical coordinate system and the image coordinate system of the fisheye image based on a conversion relationship between the third value range represented by the radians and the second value range;

[0027] The third position information is converted into the second position information according to a conversion relationship between the spherical coordinate system and the image coordinate system of the fisheye image.

[0028] In an optional implementation, the trigonometric function representation corresponding to the coordinates of the angular coordinate axis converts the first value range into a third value range represented in radians, including:

[0029] Based on the trigonometric function representation corresponding to the coordinates of the angular coordinate axis, converting the first value range into an intermediate value range represented in radians;

[0030] The intermediate value range is translated to obtain the third value range; any value in the third value range is greater than or equal to 0.

[0031] In an optional implementation manner, the three-dimensional scene model also includes multiple target observation positions;

[0032] The method further comprises:

[0033] Determining fifth position information of each target observation position in the fisheye image according to fourth position information of each target observation position in the three-dimensional scene model;

[0034] According to the fifth position information of each target observation position, a position tag of each target observation position is displayed in the fisheye image; the position tag is used to use the corresponding target observation position as a virtual camera shooting position after being triggered, so as to display the fisheye image based on the virtual camera shooting position.

[0035] In a second aspect, the present disclosure also provides an information display device, including:

[0036] An acquisition module, used for acquiring a three-dimensional scene model rendered by a three-dimensional virtual engine; the three-dimensional scene model includes a plurality of target scene objects;

[0037] A generating module, used for generating a fisheye image corresponding to the three-dimensional scene model;

[0038] A determination module, configured to determine second position information of each target scene object in the fisheye image according to first position information of each target scene object in the three-dimensional scene model;

[0039] A display module is used to display the label information of each target scene object in the fisheye image according to the second position information of each target scene object.

[0040] In an optional implementation manner, the display module is specifically used for:

[0041] For any of the target scene objects, displaying label information of the target scene object at a target position corresponding to the second position information in the fisheye image according to the second position information of the target scene object;

[0042] Among them, the second position information is used to indicate the position range information of the target scene object; the target position includes: a first position located within the position range of the target scene object, or a second position located outside the position range of the target scene object and the position relationship between the second position and the target scene object satisfies a preset position relationship.

[0043] In an optional implementation manner, the display module is further used for:

[0044] According to the user's current observation angle of view relative to the fisheye image and the observation position information, a target position corresponding to the second position information is determined.

[0045] In an optional implementation manner, the determining module is further configured to:

[0046] According to the preset target scene object type of the position information to be marked, a target scene object belonging to the target scene object type in the three-dimensional scene model is identified; the target scene object type is business scene related.

[0047] In an optional implementation manner, the generating module is specifically used for:

[0048] According to the three-dimensional scene model, collecting scene images from multiple perspectives;

[0049] The scene images of the multiple perspectives are stitched together to generate the fisheye image.

[0050] In an optional implementation manner, the determining module is specifically configured to:

[0051] For any target scene object, according to the conversion relationship between the three-dimensional coordinate system of the three-dimensional scene model and the spherical coordinate system, convert the first position information of the target scene object in the three-dimensional coordinate system of the three-dimensional scene model into the third position information in the spherical coordinate system;

[0052] According to the conversion relationship between the spherical coordinate system and the image coordinate system of the fisheye image, the third position information in the spherical coordinate system is converted into the second position information of the target scene object in the image coordinate system of the fisheye image.

[0053] In an optional implementation manner, when the determination module converts the third position information in the spherical coordinate system into the second position information of the target scene object in the image coordinate system of the fisheye image according to the conversion relationship between the spherical coordinate system and the image coordinate system of the fisheye image, it is used to:

[0054] Acquire a first value range of each coordinate axis in the spherical coordinate system and a second value range of each coordinate axis in the image coordinate system; the value range of each coordinate axis in the spherical coordinate system is determined based on the observation field of view range requirement of the three-dimensional scene model;

[0055] For any angular coordinate axis in the spherical coordinate system, based on the trigonometric function representation corresponding to the coordinates of the angular coordinate axis, convert the first value range into a third value range represented in radians;

[0056] Determining a conversion relationship between the spherical coordinate system and the image coordinate system of the fisheye image based on a conversion relationship between the third value range represented by the radians and the second value range;

[0057] The third position information is converted into the second position information according to a conversion relationship between the spherical coordinate system and the image coordinate system of the fisheye image.

[0058] In an optional implementation, the determining module, when converting the first value range into a third value range represented by radians based on the trigonometric function representation corresponding to the coordinates of the angular coordinate axis, is used to:

[0059] Based on the trigonometric function representation corresponding to the coordinates of the angular coordinate axis, converting the first value range into an intermediate value range represented in radians;

[0060] The intermediate value range is translated to obtain the third value range; any value in the third value range is greater than or equal to 0.

[0061] In an optional implementation manner, the three-dimensional scene model also includes multiple target observation positions;

[0062] The display module is also used for:

[0063] Determining fifth position information of each target observation position in the fisheye image according to fourth position information of each target observation position in the three-dimensional scene model;

[0064] According to the fifth position information of each target observation position, a position tag of each target observation position is displayed in the fisheye image; the position tag is used to use the corresponding target observation position as a virtual camera shooting position after being triggered, so as to display the fisheye image based on the virtual camera shooting position.

[0065] In a third aspect, an optional implementation of the present disclosure further provides a computer device, a processor, and a memory, wherein the memory stores machine-readable instructions executable by the processor, and the processor is used to execute the machine-readable instructions stored in the memory, and when the machine-readable instructions are executed by the processor, the machine-readable instructions perform the steps of the above-mentioned first aspect, or any possible implementation of the first aspect.

[0066] In a fourth aspect, an optional implementation of the present disclosure further provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed, the steps of the above-mentioned first aspect, or any possible implementation of the first aspect are executed.

[0067] For a description of the effects of the above-mentioned information display device, computer equipment, and computer-readable storage medium, please refer to the description of the above-mentioned information display method, which will not be repeated here.

[0068] It should be understood that the above general description and the following detailed description are merely exemplary and explanatory, and are not intended to limit the technical solutions of the present disclosure.

[0069] The information display method, device, computer equipment and storage medium provided by the embodiments of the present disclosure can generate a fisheye image corresponding to the three-dimensional scene model after obtaining the three-dimensional scene model by rendering with a three-dimensional virtual engine, thereby using the fisheye image to display the effect of the three-dimensional scene model and realizing multi-angle display of the three-dimensional scene model; and, the method can also use the first position information of the target scene object in the three-dimensional scene model to determine the second position information of the target scene image in the fisheye image, and then use the second position information to display the label information of the target scene object in the fisheye image, so as to facilitate the user to understand the overall layout of the scene.

[0070] In order to make the above-mentioned objectives, features and advantages of the present disclosure more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0071] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the following is a brief introduction to the drawings required for use in the embodiments. The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments consistent with the present disclosure and are used together with the specification to illustrate the technical solutions of the present disclosure. It should be understood that the following drawings only illustrate certain embodiments of the present disclosure and should not be regarded as limiting the scope. For ordinary technicians in this field, other relevant drawings can also be obtained based on these drawings without creative work.

[0072] Figure 1 A flowchart showing an information display method provided by some embodiments of the present disclosure is shown;

[0073] Figure 2 A schematic diagram of converting first position information into third position information provided by some embodiments of the present disclosure is shown;

[0074] Figure 3 A schematic diagram showing an image coordinate system provided by some embodiments of the present disclosure;

[0075] Figure 4 A schematic diagram showing a fisheye image provided by some embodiments of the present disclosure;

[0076] Figure 5 A schematic diagram showing an information display device provided by some embodiments of the present disclosure is shown;

[0077] Figure 6 A schematic diagram of a computer device provided by some embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0078] In order to make the purpose, technical scheme and advantages of the embodiments of the present disclosure clearer, the technical scheme in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all of the embodiments. The components of the embodiments of the present disclosure generally described and shown here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present disclosure is not intended to limit the scope of the present disclosure claimed for protection, but merely represents the selected embodiments of the present disclosure. Based on the embodiments of the present disclosure, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present disclosure.

[0079] Research has found that in the scene of decoration design, the design effect of decoration design is usually displayed in the form of two-dimensional images (such as floor plans, layouts, color samples). However, two-dimensional images cannot present the actual dynamics and fluidity of the space, making it difficult for users to fully understand the actual feeling of the space; and the pictures usually only show one or a limited number of perspectives, which cannot meet the needs of users to observe the scene design from different angles.

[0080] Based on the above research, the present disclosure provides an information display method, device, computer equipment and storage medium, which can generate a fisheye image corresponding to the three-dimensional scene model after obtaining the three-dimensional scene model by rendering with a three-dimensional virtual engine, so as to use the fisheye image to display the effect of the three-dimensional scene model and realize multi-angle display of the three-dimensional scene model; and, the method can also use the first position information of the target scene object in the three-dimensional scene model to determine the second position information of the target scene image in the fisheye image, and then use the second position information to display the label information of the target scene object in the fisheye image, so as to facilitate users to understand the overall layout of the scene.

[0081] The defects existing in the above solutions are the results obtained by the inventor after practice and careful research. Therefore, the discovery process of the above problems and the solutions proposed by the present disclosure for the above problems below should be the contributions made by the inventor to the present disclosure during the disclosure process.

[0082] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.

[0083] To facilitate understanding of this embodiment, a method for displaying information disclosed in the embodiment of the present disclosure is first introduced in detail. The execution subject of the method for displaying information provided in the embodiment of the present disclosure is generally a computer device with certain computing capabilities. In some possible implementations, the method for displaying information can be implemented by a processor calling a computer-readable instruction stored in a memory.

[0084] The information display method provided by the embodiment of the present disclosure is described below by taking the execution subject as a terminal device as an example.

[0085] See also Figure 1 FIG. 1 is a flowchart of an information display method provided by an embodiment of the present disclosure, wherein the method includes steps S101 to S104, wherein:

[0086] S101, obtaining a three-dimensional scene model rendered by a three-dimensional virtual engine; the three-dimensional scene model includes a plurality of target scene objects.

[0087] The disclosed embodiments can be applied in the application scenario of decoration design. In this scenario, a three-dimensional model of the scene to be decorated can be established by computer, and decoration design can be performed based on the three-dimensional model of the scene to be decorated, and the design effect can be reflected through the three-dimensional scene model.

[0088] For example, you can obtain a floor plan of the target scene to be renovated, or measure the size of the control, and import it into the 3D modeling software. You can create a 3D model of a building or interior scene, such as walls, floors, ceilings, windows, doors, and other structural elements. After that, you can add furniture, decorations, accessories, etc., and add these elements to the 3D model. After obtaining these 3D models, you can set materials and textures for them, and add scene lighting and other designs, and finally get a 3D scene model.

[0089] The above-mentioned 3D Virtual Engine is a software framework or platform for creating and rendering 3D graphics and virtual worlds.

[0090] The target scene objects mentioned above may include various types. For example, the target scene objects may be object objects in a three-dimensional scene model, such as furniture and decorations; or they may be architectural objects, such as doors, stairs, corridors, rooms, walls, etc.

[0091] S102: Generate a fisheye image corresponding to the three-dimensional scene model.

[0092] In order to show the effect of the decoration design to the user, the 3D scene model can be directly displayed, or the 3D scene model can be photographed to obtain the 2D image corresponding to the 3D scene model. However, directly displaying the 3D model requires the user's device to have the ability to play 3D scene animation or display 3D models, such as hardware support and software support. The 2D image can only display limited information, and the observation angle cannot be switched arbitrarily, which has great limitations.

[0093] Therefore, the disclosed embodiment uses fisheye images to display a three-dimensional scene model. A fisheye image is an image formed using wide-angle photography technology, which can capture an extremely wide range of vision, usually exceeding the range that the human eye can observe. The characteristic of a fisheye lens is its extremely large field of view, which makes the objects in the image appear in a curved shape, usually circular or hemispherical. Through fisheye correction, the picture in the image can appear as a regular perspective image.

[0094] After obtaining the above three-dimensional scene model, a fisheye image corresponding to the three-dimensional scene model can be generated. When generating the fisheye image, a virtual fisheye camera can be directly used to shoot the three-dimensional scene model to obtain scene images of multiple perspectives, and the scene images of multiple perspectives are spliced ​​to generate the fisheye image.

[0095] Alternatively, a common virtual camera may be used to photograph the three-dimensional scene model, and the image photographed by the common camera may be converted into a fisheye image through a conversion technique.

[0096] In the application scenario of the embodiment of the present disclosure, the three-dimensional scene model can be established in a three-dimensional coordinate system, and the origin of the three-dimensional coordinate system can be the same as the position of the camera that shoots the fisheye image. For example, it can be set as the center point of the three-dimensional scene model. An image coordinate system (uv coordinate system) can be established in the fisheye image, and the value range of each coordinate axis in the image coordinate system can be set according to the observation field of view range requirements of the three-dimensional scene model in the embodiment of the present disclosure.

[0097] For example, the observation field of view requirement indicates that a horizontal field of view of 360° and a vertical field of view of 180° are required, and the aspect ratio of the above fisheye image may be 2:1.

[0098] Generally, the value range of the u-axis and the y-axis in the image coordinate system can be set to [0, 1]. In the embodiment of the present disclosure, although the length of the major axis is equivalent to twice the length of the wide axis, the unit length in the major axis value range of the image coordinate system is different from that in the wide axis value range, and the unit length of the major axis is twice the unit length of the wide axis.

[0099] After obtaining the fisheye image, the fisheye image can be directly displayed, thereby realizing the display of the design effect of the three-dimensional scene model. In the process of displaying the fisheye image, the content displayed in the fisheye image can be changed by adjusting the position of the virtual camera.

[0100] S103: Determine second position information of each target scene object in the fisheye image according to first position information of each target scene object in the three-dimensional scene model.

[0101] In order to better demonstrate the design effect of the 3D scene model, the label information of the target scene object can be displayed in the fisheye image. When adding the label of the target scene object to the fisheye image, the label information can usually be added to the area where the target scene object is located. Therefore, it is necessary to determine the position of the target scene object in the fisheye image.

[0102] To this end, first position information of the target scene object in the three-dimensional scene model may be acquired, and second position information of the target scene object in the fisheye image may be determined based on the first position information.

[0103] However, there is a big difference between the presentation forms of the three-dimensional scene model and the fisheye image, and the first position information in the three-dimensional coordinate system cannot be directly converted into the second position information in the image coordinate system. Therefore, the embodiment of the present disclosure adopts the following steps:

[0104] For any target scene object, according to the conversion relationship between the three-dimensional coordinate system of the three-dimensional scene model and the spherical coordinate system, convert the first position information of the target scene object in the three-dimensional coordinate system of the three-dimensional scene model into the third position information in the spherical coordinate system;

[0105] According to the conversion relationship between the spherical coordinate system and the image coordinate system of the fisheye image, the third position information in the spherical coordinate system is converted into the second position information of the target scene object in the image coordinate system of the fisheye image.

[0106] The three-dimensional scene model is built on a three-dimensional coordinate system, which may include a horizontal axis x, a vertical axis y, and a vertical axis z. The origin of the three-dimensional coordinate system may be located on the midline of the three-dimensional scene model, and the origin may be located on the plane where the ground of the three-dimensional scene model is located. There is a conversion relationship between the three-dimensional coordinate system and the spherical coordinate system, and the coordinates in the three-dimensional coordinate system can be converted to the spherical coordinate system. The origin of the spherical coordinate system may coincide with the origin of the three-dimensional coordinate system.

[0107] During the conversion process, the first value range of each coordinate axis in the spherical coordinate system and the second value range of each coordinate axis in the image coordinate system can be obtained. The value range of each coordinate axis in the spherical coordinate system can be determined based on the observation field of view range requirements of the three-dimensional scene model.

[0108] For example, the following value ranges may be used:

[0109] θ∈[0°,360°],φ∈[0°,180°],v∈[0,1],u∈[0,1].

[0110] When performing the conversion, for any angular coordinate axis (i.e., θ or φ) in the spherical coordinate system, the first value range can be converted into a third value range expressed in radians based on the trigonometric function representation corresponding to the coordinates of the angular coordinate axis; then, based on the conversion relationship between the third value range expressed in radians and the second value range, the conversion relationship between the spherical coordinate system and the image coordinate system is determined, and then based on the conversion relationship between the spherical coordinate system and the image coordinate system of the fisheye image, the third position information is converted into the second position information.

[0111] When the first value range is converted to the third value range, there may be negative intervals in the value range. In order to simplify the calculation, the first value range can be converted into an intermediate value range expressed in radians based on the trigonometric function identifier corresponding to the coordinates of the angle coordinate axis, and then the intermediate value range is translated to obtain the third value range, so that any value in the third value range is greater than or equal to 0, thereby eliminating the negative intervals in the third value range.

[0112] For example, see Figure 2 As shown, it is a schematic diagram of converting the first position information into the third position information provided by the embodiment of the present disclosure. The figure includes a three-dimensional coordinate system and a spherical coordinate system. According to trigonometric functions, the coordinates of the target scene object in the three-dimensional coordinate system in the first position information can be used to represent the coordinates in the spherical coordinate system. For example, if the coordinates of a target scene object in the three-dimensional coordinate system are (x, y, z), its coordinates in the spherical coordinate system can be set to (θ, φ, r). According to trigonometric functions, it can be known that:

[0113] x=cosθ·sinφ·r

[0114] y=cosθ·sinφ·r

[0115] z=sinθ·r

[0116] Then we have:

[0117] θ=arcsin(z / r)

[0118] φ=arctan(y / x)

[0119] The third position information may be (arcsin(z / r), arctan(y / x), r). Since the distance between the fisheye image and the camera is preset, r may be set to 1 for ease of calculation.

[0120] Among them, θ is the polar coordinate, which indicates the angle required to rotate counterclockwise from the true north direction (or positive Z axis direction) of the coordinate system to the position of the point; φ is the azimuth coordinate, which indicates the angle required to rotate counterclockwise from the positive X axis direction of the coordinate system to the position of the point. r is the polar diameter, which indicates the distance from the origin of the coordinate system to a certain point on the sphere. This is the radial coordinate in the spherical coordinate system, usually expressed as a positive real number.

[0121] Since the fisheye image is displayed as a map in a spherical shape, there is a corresponding conversion relationship between the image coordinate system and the spherical coordinate system. Therefore, the third position information in the spherical coordinate system can be converted into the second position information in the image coordinate system.

[0122] See also Figure 3 , which is a schematic diagram of the image coordinate system provided by an embodiment of the present disclosure. Figure 3 In the figure, the fisheye image is located under the image coordinate system. The image coordinate system includes a long axis u and a wide axis v. The length of the fisheye image is 1, the width is 1, and the unit length of the long axis is twice the unit length of the wide axis. p is the coordinate point.

[0123] Since the value ranges of the long axis and the wide axis in the image coordinate system are both [0, 1], the third value range can be normalized to be converted into the second value range in the image coordinate system.

[0124] Specifically, according to trigonometric functions, in arcsin(z / r), the value range of z / r is [-1,1], so the value range of arcsin(z / r) (that is, θ) is [-π / 2,π / 2].

[0125] Therefore, the intermediate value range of θ in radians is [-π / 2,π / 2], and the third value range obtained after translation transformation is [0,π].

[0126] Similarly, according to trigonometric functions, in arctan(y / x), the value range of y / x is (-∞,+∞), and the middle value range of φ is [-π / 2,π / 2]. If there is a negative interval, it can be translated, and the third value range of φ can be [-π / 2,π / 2]+π / 2.

[0127] Since the unit length of the long axis in the image coordinate system is twice the unit length of the wide axis, the third value range of φ can be stretched to [-π / 2,π / 2]+3π / 2.

[0128] However, considering that x and y may have positive and negative values, the image coordinates corresponding to x when it is positive and x when it is negative may be the same. In order to distinguish this situation, the two cases of x when it is positive and x when it is negative can be mapped to different value ranges respectively to obtain the final third value range of φ:

[0129] x≥0,φ∈[-π / 2,π / 2]+3π / 2

[0130] x<0, φ∈[-π / 2,π / 2]+π / 2

[0131] Afterwards, the conversion relationship between the third value range and the second value range can be obtained according to normalization, and the third position information can be converted into the second position information by using the conversion relationship between the third value range and the second value range.

[0132] S104: Display label information of each target scene object in the fisheye image according to the second position information of each target scene object.

[0133] After obtaining the second position information of the target scene object, the label information of the target scene object can be displayed in the fisheye image according to the second position information. Exemplarily, for any target scene object, the label information of the target scene object can be displayed at the target position corresponding to the second position information in the fisheye image according to the second position information of the target scene object.

[0134] Among them, the second position information is used to indicate the position range information of the target scene object; the target position may include: a first position located within the position range of the target scene object, or a second position located outside the position range of the target scene object and the position relationship between the target scene object and the target scene object satisfies a preset position relationship.

[0135] The above-mentioned preset position relationship may be a preset distance, and the preset relationship may be determined according to a display state of the target scene object in the fisheye image.

[0136] For example, when the target scene object is a restroom, if the position range corresponding to the restroom is not sufficient to display the label information, the label information can be displayed at a certain distance from the position range, and the distance can be determined according to the size of the position range corresponding to the restroom.

[0137] In a possible implementation, the target position corresponding to the second position information may also be determined according to the user's current observation angle of view relative to the fisheye image and the observation position information.

[0138] The above observation position information may be the shooting position of the virtual camera when the user observes the fisheye image; the observation angle may be the angle between the front of the virtual camera and the reference direction of the fisheye image.

[0139] Exemplarily, the fisheye image area currently observed by the user can be determined based on the user's current observation angle relative to the fisheye image and the observation position information, and the target position corresponding to the second position information can be determined from the fisheye image area.

[0140] For example, the position closest to the area corresponding to the second position information may be determined from the fisheye image area as the target position.

[0141] In this way, even if the user's current observation angle and observation position cannot observe the target scene object, the user can be prompted through the label information that there is a target scene object near the position.

[0142] In a possible implementation manner, scene objects that need to display tag information may be screened to select target scene objects.

[0143] Exemplarily, the target scene object belonging to the target scene object type in the three-dimensional scene model can be identified according to the target scene object type of the preset position information to be marked; the target scene object type is related to the business scene. The business scene can be pre-set with multiple target scene object types. For example, for a business scene for displaying furniture design, furniture can be set as the target scene object type; for a business scene for displaying architectural design, rooms, corridors, etc. can be set as target scene object types.

[0144] Furthermore, multiple target observation positions can be set in the above three-dimensional scene model, and the fifth position information of the target observation position in the fisheye image can be determined according to the fourth position information of each target observation position in the three-dimensional scene model; then, according to the fifth position information of each target observation position, the position label of each target observation position is displayed in the fisheye image. In this way, the user can trigger the position label, and after the position label is triggered, the corresponding target observation position can be used as the virtual camera shooting position, so as to display the fisheye image based on the virtual camera shooting position, thereby achieving the effect of switching the observation angle.

[0145] Figure 4 A schematic diagram of a fisheye image provided by some embodiments of the present disclosure is shown, which includes a target scene object 41, label information 42 corresponding to the target scene object 41, and a position label 43 of the target observation position.

[0146] The information display method provided by the embodiment of the present disclosure can generate a fisheye image corresponding to the three-dimensional scene model after obtaining the three-dimensional scene model by rendering with a three-dimensional virtual engine, thereby using the fisheye image to display the effect of the three-dimensional scene model and realizing multi-angle display of the three-dimensional scene model; and, the method can also use the first position information of the target scene object in the three-dimensional scene model to determine the second position information of the target scene image in the fisheye image, and then use the second position information to display the label information of the target scene object in the fisheye image, so as to facilitate the user to understand the overall layout of the scene.

[0147] Those skilled in the art will appreciate that, in the above method of specific implementation, the order in which the steps are written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of the steps should be determined by their functions and possible internal logic.

[0148] Based on the same inventive concept, an information display device corresponding to the information display method is also provided in the embodiment of the present disclosure. Since the principle of solving the problem by the device in the embodiment of the present disclosure is similar to the above-mentioned information display method in the embodiment of the present disclosure, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be repeated.

[0149] Reference Figure 5 FIG. 1 is a schematic diagram of an information display device provided in an embodiment of the present disclosure, wherein the device comprises:

[0150] An acquisition module 510 is used to acquire a three-dimensional scene model rendered by a three-dimensional virtual engine; the three-dimensional scene model includes a plurality of target scene objects;

[0151] A generating module 520, configured to generate a fisheye image corresponding to the three-dimensional scene model;

[0152] A determination module 530, configured to determine second position information of each target scene object in the fisheye image according to first position information of each target scene object in the three-dimensional scene model;

[0153] The display module 540 is used to display the label information of each target scene object in the fisheye image according to the second position information of each target scene object.

[0154] In an optional implementation manner, the display module 540 is specifically used for:

[0155] For any of the target scene objects, displaying label information of the target scene object at a target position corresponding to the second position information in the fisheye image according to the second position information of the target scene object;

[0156] Among them, the second position information is used to indicate the position range information of the target scene object; the target position includes: a first position located within the position range of the target scene object, or a second position located outside the position range of the target scene object and the position relationship between the second position and the target scene object satisfies a preset position relationship.

[0157] In an optional implementation, the display module 540 is further used for:

[0158] According to the user's current observation angle of view relative to the fisheye image and the observation position information, a target position corresponding to the second position information is determined.

[0159] In an optional implementation manner, the determining module 530 is further configured to:

[0160] According to the preset target scene object type of the position information to be marked, a target scene object belonging to the target scene object type in the three-dimensional scene model is identified; the target scene object type is business scene related.

[0161] In an optional implementation manner, the generating module 520 is specifically used for:

[0162] According to the three-dimensional scene model, collecting scene images from multiple perspectives;

[0163] The scene images of the multiple perspectives are stitched together to generate the fisheye image.

[0164] In an optional implementation manner, the determining module 530 is specifically configured to:

[0165] For any target scene object, according to the conversion relationship between the three-dimensional coordinate system of the three-dimensional scene model and the spherical coordinate system, convert the first position information of the target scene object in the three-dimensional coordinate system of the three-dimensional scene model into the third position information in the spherical coordinate system;

[0166] According to the conversion relationship between the spherical coordinate system and the image coordinate system of the fisheye image, the third position information in the spherical coordinate system is converted into the second position information of the target scene object in the image coordinate system of the fisheye image.

[0167] In an optional implementation manner, when the determination module 530 converts the third position information in the spherical coordinate system into the second position information of the target scene object in the image coordinate system of the fisheye image according to the conversion relationship between the spherical coordinate system and the image coordinate system of the fisheye image, it is configured to:

[0168] Acquire a first value range of each coordinate axis in the spherical coordinate system and a second value range of each coordinate axis in the image coordinate system; the value range of each coordinate axis in the spherical coordinate system is determined based on the observation field of view range requirement of the three-dimensional scene model;

[0169] For any angular coordinate axis in the spherical coordinate system, based on the trigonometric function representation corresponding to the coordinates of the angular coordinate axis, convert the first value range into a third value range represented in radians;

[0170] Determining a conversion relationship between the spherical coordinate system and the image coordinate system of the fisheye image based on a conversion relationship between the third value range represented by the radians and the second value range;

[0171] The third position information is converted into the second position information according to a conversion relationship between the spherical coordinate system and the image coordinate system of the fisheye image.

[0172] In an optional implementation manner, the determination module 530, when converting the first value range into a third value range represented by radians based on the trigonometric function representation corresponding to the coordinates of the angular coordinate axis, is configured to:

[0173] Based on the trigonometric function representation corresponding to the coordinates of the angular coordinate axis, converting the first value range into an intermediate value range represented in radians;

[0174] The intermediate value range is translated to obtain the third value range; any value in the third value range is greater than or equal to 0.

[0175] In an optional implementation manner, the three-dimensional scene model also includes multiple target observation positions;

[0176] The display module 540 is also used for:

[0177] Determining fifth position information of each target observation position in the fisheye image according to fourth position information of each target observation position in the three-dimensional scene model;

[0178] According to the fifth position information of each target observation position, a position tag of each target observation position is displayed in the fisheye image; the position tag is used to use the corresponding target observation position as a virtual camera shooting position after being triggered, so as to display the fisheye image based on the virtual camera shooting position.

[0179] For descriptions of the processing flow of each module in the device and the interaction flow between each module, reference may be made to the relevant descriptions in the above method embodiment, which will not be described in detail here.

[0180] The present disclosure also provides a computer device, such as Figure 6 FIG. 1 is a schematic diagram of a computer device structure provided in an embodiment of the present disclosure, including:

[0181] A processor 61 and a memory 62; the memory 62 stores machine-readable instructions executable by the processor 61, and the processor 61 is used to execute the machine-readable instructions stored in the memory 62. When the machine-readable instructions are executed by the processor 61, the processor 61 performs the following steps:

[0182] Acquire a three-dimensional scene model rendered by a three-dimensional virtual engine; the three-dimensional scene model includes a plurality of target scene objects;

[0183] Generating a fisheye image corresponding to the three-dimensional scene model;

[0184] Determining second position information of each target scene object in the fisheye image according to first position information of each target scene object in the three-dimensional scene model;

[0185] According to the second position information of each target scene object, label information of each target scene object is displayed in the fisheye image.

[0186] In an optional implementation manner, in the instructions executed by the processor 61, displaying label information of each target scene object in the fisheye image according to the second position information of each target scene object includes:

[0187] For any of the target scene objects, displaying label information of the target scene object at a target position corresponding to the second position information in the fisheye image according to the second position information of the target scene object;

[0188] Among them, the second position information is used to indicate the position range information of the target scene object; the target position includes: a first position located within the position range of the target scene object, or a second position located outside the position range of the target scene object and the position relationship between the second position and the target scene object satisfies a preset position relationship.

[0189] In an optional implementation manner, the instructions executed by the processor 61 further include:

[0190] According to the user's current observation angle of view relative to the fisheye image and the observation position information, a target position corresponding to the second position information is determined.

[0191] In an optional implementation manner, the instructions executed by the processor 61 further include:

[0192] According to the preset target scene object type of the position information to be marked, a target scene object belonging to the target scene object type in the three-dimensional scene model is identified; the target scene object type is business scene related.

[0193] In an optional implementation manner, in the instructions executed by the processor 61, the generating of the fisheye image corresponding to the three-dimensional scene model includes:

[0194] According to the three-dimensional scene model, collecting scene images from multiple perspectives;

[0195] The scene images of the multiple perspectives are stitched together to generate the fisheye image.

[0196] In an optional implementation manner, in the instructions executed by the processor 61, determining the second position information of the target scene object in the fisheye image according to the first position information of each target scene object in the three-dimensional scene model includes:

[0197] For any target scene object, according to the conversion relationship between the three-dimensional coordinate system of the three-dimensional scene model and the spherical coordinate system, convert the first position information of the target scene object in the three-dimensional coordinate system of the three-dimensional scene model into the third position information in the spherical coordinate system;

[0198] According to the conversion relationship between the spherical coordinate system and the image coordinate system of the fisheye image, the third position information in the spherical coordinate system is converted into the second position information of the target scene object in the image coordinate system of the fisheye image.

[0199] In an optional implementation manner, in the instructions executed by the processor 61, converting the third position information in the spherical coordinate system into the second position information of the target scene object in the image coordinate system of the fisheye image according to the conversion relationship between the spherical coordinate system and the image coordinate system of the fisheye image includes:

[0200] Acquire a first value range of each coordinate axis in the spherical coordinate system and a second value range of each coordinate axis in the image coordinate system; the value range of each coordinate axis in the spherical coordinate system is determined based on the observation field of view range requirement of the three-dimensional scene model;

[0201] For any angular coordinate axis in the spherical coordinate system, based on the trigonometric function representation corresponding to the coordinates of the angular coordinate axis, convert the first value range into a third value range represented in radians;

[0202] The third position information is converted into the second position information according to a conversion relationship between the spherical coordinate system and the image coordinate system of the fisheye image.

[0203] In an optional implementation, in the instruction executed by the processor 61, the trigonometric function representation corresponding to the coordinates of the angular coordinate axis, converting the first value range into a third value range represented by radians, includes:

[0204] Based on the trigonometric function representation corresponding to the coordinates of the angular coordinate axis, converting the first value range into an intermediate value range represented in radians;

[0205] The intermediate value range is translated to obtain the third value range; any value in the third value range is greater than or equal to 0.

[0206] In an optional implementation manner, the three-dimensional scene model also includes multiple target observation positions;

[0207] The instructions executed by the processor 61 also include:

[0208] Determining fifth position information of each target observation position in the fisheye image according to fourth position information of each target observation position in the three-dimensional scene model;

[0209] According to the fifth position information of each target observation position, a position tag of each target observation position is displayed in the fisheye image; the position tag is used to use the corresponding target observation position as a virtual camera shooting position after being triggered, so as to display the fisheye image based on the virtual camera shooting position.

[0210] The above-mentioned memory 62 includes internal memory 621 and external memory 622; the memory 621 here is also called internal memory, which is used to temporarily store the calculation data in the processor 61, as well as the data exchanged with the external memory 622 such as the hard disk. The processor 61 exchanges data with the external memory 622 through the internal memory 621.

[0211] The specific execution process of the above instructions can refer to the steps of the information display method described in the embodiment of the present disclosure, which will not be repeated here.

[0212] The present disclosure also provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the information display method described in the above method embodiment are executed. The storage medium can be a volatile or non-volatile computer-readable storage medium.

[0213] The present disclosure also provides a computer program product that carries a program code. The program code includes instructions that can be used to execute the steps of the information display method described in the above method embodiment. For details, please refer to the above method embodiment, which will not be repeated here.

[0214] The computer program product may be implemented in hardware, software or a combination thereof. In one optional embodiment, the computer program product is implemented as a computer storage medium. In another optional embodiment, the computer program product is implemented as a software product, such as a software development kit (SDK).

[0215] Those skilled in the art can clearly understand that, for the convenience and simplicity of description, the specific working process of the system and device described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here. In the several embodiments provided in the present disclosure, it should be understood that the disclosed system, device and method can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of the device or unit can be electrical, mechanical or other forms.

[0216] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0217] In addition, each functional unit in each embodiment of the present disclosure may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0218] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present disclosure, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present disclosure. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0219] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present disclosure, which are used to illustrate the technical solutions of the present disclosure, rather than to limit them. The protection scope of the present disclosure is not limited thereto. Although the present disclosure is described in detail with reference to the above-described embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-described embodiments within the technical scope disclosed in the present disclosure, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present disclosure, and should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.

Claims

1. An information display method, characterized in that: include: Acquire a three-dimensional scene model rendered by a three-dimensional virtual engine; the three-dimensional scene model includes a plurality of target scene objects; Generating a fisheye image corresponding to the three-dimensional scene model; Determining second position information of each target scene object in the fisheye image according to first position information of each target scene object in the three-dimensional scene model; According to the second position information of each target scene object, label information of each target scene object is displayed in the fisheye image.

2. The method according to claim 1, characterized in that The step of displaying label information of each target scene object in the fisheye image according to the second position information of each target scene object includes: For any of the target scene objects, displaying label information of the target scene object at a target position corresponding to the second position information in the fisheye image according to the second position information of the target scene object; Among them, the second position information is used to indicate the position range information of the target scene object; the target position includes: a first position located within the position range of the target scene object, or a second position located outside the position range of the target scene object and the position relationship between the second position and the target scene object satisfies a preset position relationship.

3. The method according to claim 2, characterized in that Determine a target position corresponding to the second position information according to the following steps; According to the user's current observation angle of view relative to the fisheye image and the observation position information, a target position corresponding to the second position information is determined.

4. The method according to claim 1, characterized in that: Before determining the second position information of the target scene object in the fisheye image, the method further includes: According to the preset target scene object type of the position information to be marked, a target scene object belonging to the target scene object type in the three-dimensional scene model is identified; the target scene object type is business scene related.

5. The method according to claim 1, characterized in that The generating of a fisheye image corresponding to the three-dimensional scene model comprises: According to the three-dimensional scene model, collecting scene images from multiple perspectives; The scene images of the multiple perspectives are stitched together to generate the fisheye image.

6. The method according to claim 1, characterized in that The determining, according to the first position information of each target scene object in the three-dimensional scene model, the second position information of the target scene object in the fisheye image comprises: For any target scene object, according to the conversion relationship between the three-dimensional coordinate system of the three-dimensional scene model and the spherical coordinate system, convert the first position information of the target scene object in the three-dimensional coordinate system of the three-dimensional scene model into the third position information in the spherical coordinate system; According to the conversion relationship between the spherical coordinate system and the image coordinate system of the fisheye image, the third position information in the spherical coordinate system is converted into the second position information of the target scene object in the image coordinate system of the fisheye image.

7. The method according to claim 6, characterized in that The converting, according to the conversion relationship between the spherical coordinate system and the image coordinate system of the fisheye image, the third position information in the spherical coordinate system into the second position information of the target scene object in the image coordinate system of the fisheye image comprises: Acquire a first value range of each coordinate axis in the spherical coordinate system and a second value range of each coordinate axis in the image coordinate system; the value range of each coordinate axis in the spherical coordinate system is determined based on the observation field of view range requirement of the three-dimensional scene model; For any angular coordinate axis in the spherical coordinate system, based on the trigonometric function representation corresponding to the coordinates of the angular coordinate axis, convert the first value range into a third value range represented in radians; Determining a conversion relationship between the spherical coordinate system and the image coordinate system of the fisheye image based on a conversion relationship between the third value range represented by the radians and the second value range; The third position information is converted into the second position information according to a conversion relationship between the spherical coordinate system and the image coordinate system of the fisheye image.

8. The method according to claim 7, characterized in that The trigonometric function representation corresponding to the coordinates of the angular coordinate axis converts the first value range into a third value range represented by radians, comprising: Based on the trigonometric function representation corresponding to the coordinates of the angular coordinate axis, converting the first value range into an intermediate value range represented in radians; The intermediate value range is translated to obtain the third value range; any value in the third value range is greater than or equal to 0.

9. The method according to claim 1, characterized in that: The three-dimensional scene model also includes multiple target observation positions; The method further comprises: Determining fifth position information of each target observation position in the fisheye image according to fourth position information of each target observation position in the three-dimensional scene model; According to the fifth position information of each target observation position, a position tag of each target observation position is displayed in the fisheye image; the position tag is used to use the corresponding target observation position as a virtual camera shooting position after being triggered, so as to display the fisheye image based on the virtual camera shooting position.

10. An information display device, characterized in that: include: An acquisition module, used for acquiring a three-dimensional scene model rendered by a three-dimensional virtual engine; the three-dimensional scene model includes a plurality of target scene objects; A generating module, used for generating a fisheye image corresponding to the three-dimensional scene model; A determination module, configured to determine second position information of each target scene object in the fisheye image according to first position information of each target scene object in the three-dimensional scene model; A display module is used to display the label information of each target scene object in the fisheye image according to the second position information of each target scene object.

11. A computer device, characterized in that: include: A processor and a memory, wherein the memory stores machine-readable instructions executable by the processor, and the processor is used to execute the machine-readable instructions stored in the memory. When the machine-readable instructions are executed by the processor, the processor executes the steps of the information display method according to any one of claims 1 to 9.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program. When the computer program is executed by a computer device, the computer device executes the steps of the information display method according to any one of claims 1 to 9.

Images