Three-dimensional roaming method, device and equipment
By using three-dimensional roaming technology in the online shopping platform, obtaining three-dimensional scene information and switching roaming based on the roaming path, the problem that the existing online shopping model cannot meet the real shopping experience is solved, and more efficient and real data object processing is achieved, improving the Transaction rate and marketing benefits.
Patent Information
- Application Number
- CN201910769038.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-08-20
- Publication Date
- 2025-02-18
- Estimated Expiration
- 2039-08-20
AI Technical Summary
The existing online shopping model cannot meet consumers' real experience when shopping, especially when shopping needs are unclear, it is impossible to achieve the combination of "shopping" and "shopping", resulting in a decrease in product transaction rate and the impact of marketers' interests.
By obtaining three-dimensional scene information, including multiple data objects, determining at least one roaming path, and switching the data objects in the three-dimensional scene information based on the path, the user can realize the real experience of viewing different data objects in the three-dimensional scene.
It improves users' real experience of data objects, solves the problem that online shopping mode cannot meet the real shopping experience, and improves the efficiency and quality of data objects processing, and increases the interests of marketers.
Smart Images

Figure CN112418962B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of data processing technology, and in particular to a three-dimensional roaming method, device and equipment. Background Art
[0002] With the rapid development of science and technology, online shopping has become a popular consumption method. The current online shopping model is generally: consumers clarify a specific shopping demand, determine the goods to be purchased based on the shopping demand, and then display the goods to be purchased to consumers.
[0003] However, when consumers' shopping needs are unclear, this online shopping model cannot satisfy people's real shopping experience. For example, this online shopping model cannot achieve the psychological state of combining "shopping" and "window shopping" that consumers want. This not only reduces the transaction rate of goods, but also affects the interests of marketers. Summary of the invention
[0004] The embodiments of the present invention provide a three-dimensional roaming method, device and equipment, which effectively solve the problem of "online shopping mode cannot satisfy the real shopping experience" existing in the prior art, and improve the quality and efficiency of processing data objects.
[0005] In a first aspect, an embodiment of the present invention provides a three-dimensional roaming method, comprising:
[0006] Acquire three-dimensional scene information, wherein the three-dimensional scene information includes a plurality of data objects;
[0007] determining at least one navigation path based on the data object;
[0008] The data objects in the three-dimensional scene information are switched and roamed based on the roaming path.
[0009] In a second aspect, an embodiment of the present invention provides a three-dimensional roaming device, including:
[0010] A first acquisition module, used to acquire three-dimensional scene information, wherein the three-dimensional scene information includes a plurality of data objects;
[0011] A first determining module, configured to determine at least one roaming path based on the data object;
[0012] The first processing module is used to switch and roam the data objects in the three-dimensional scene information based on the roaming path.
[0013] In a third aspect, an embodiment of the present invention provides an electronic device, comprising: a memory, a processor; wherein the memory is used to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the three-dimensional roaming method in the above-mentioned first aspect.
[0014] In a fourth aspect, an embodiment of the present invention provides a computer storage medium for storing a computer program, wherein the computer program enables a computer to implement the three-dimensional roaming method in the first aspect when executed.
[0015] By acquiring three-dimensional scene information including multiple data objects, determining at least one roaming path based on the data objects, and then switching and roaming the data objects in the three-dimensional scene information based on the roaming path, it is effectively achieved that the user can view different data objects in the switched and roamed three-dimensional scene information, thereby improving the user's real experience of the data objects, effectively solving the problem of "online shopping mode cannot meet the real shopping experience" existing in the prior art, and also improving the efficiency and quality of processing data objects, further improving the practicability of the method, and facilitating market promotion and application.
[0016] In a fifth aspect, an embodiment of the present invention provides a three-dimensional roaming method, including:
[0017] Acquire three-dimensional scene information, wherein the three-dimensional scene information includes data objects of multiple categories;
[0018] identifying at least one target category among the plurality of categories;
[0019] determining at least one roaming path according to the target category;
[0020] The data objects of the target category are automatically switched and roamed based on the roaming path.
[0021] In a sixth aspect, an embodiment of the present invention provides a three-dimensional roaming device, including:
[0022] A second acquisition module is used to acquire three-dimensional scene information, wherein the three-dimensional scene information includes data objects of multiple categories;
[0023] A second determination module, used to determine at least one target category among multiple categories;
[0024] The second determination module is further used to determine at least one roaming path according to the target category;
[0025] The second processing module is used to automatically switch and roam the data objects of the target category based on the roaming path.
[0026] In the seventh aspect, an embodiment of the present invention provides an electronic device, comprising: a memory, a processor; wherein the memory is used to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the three-dimensional roaming method in the above-mentioned fifth aspect.
[0027] In an eighth aspect, an embodiment of the present invention provides a computer storage medium for storing a computer program, wherein the computer program enables a computer to implement the three-dimensional roaming method in the fifth aspect when executed. BRIEF DESCRIPTION OF THE DRAWINGS
[0028] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0029] Figure 1 A process of a three-dimensional roaming method provided by an embodiment of the present invention Figure 1 ;
[0030] Figure 2 A flowchart for obtaining three-dimensional scene information provided by an embodiment of the present invention;
[0031] Figure 3 A process of a three-dimensional roaming method provided by an embodiment of the present invention Figure 2 ;
[0032] Figure 4 A process of a three-dimensional roaming method provided by an embodiment of the present invention Figure 3 ;
[0033] Figure 5 A process for determining at least one roaming path based on the data object provided in an embodiment of the present invention Figure 1 ;
[0034] Figure 6 A process for determining at least one roaming path based on the data object provided in an embodiment of the present invention Figure 2 ;
[0035] Figure 7 A process of a three-dimensional roaming method provided by an embodiment of the present invention Figure 4 ;
[0036] Figure 8 A process of a three-dimensional roaming method provided by an embodiment of the present invention Figure 5 ;
[0037] Fig. 9A process of a three-dimensional roaming method provided by an embodiment of the present invention Figure 6 ;
[0038] Fig.10 A process of a three-dimensional roaming method provided by an embodiment of the present invention Figure 7 ;
[0039] Fig.11 A process of a three-dimensional roaming method provided by an embodiment of the present invention Figure 8 ;
[0040] Fig.12a A schematic diagram of a three-dimensional roaming method provided by an application embodiment of the present invention Figure 1 ;
[0041] Figure 12b A schematic diagram of a three-dimensional roaming method provided by an application embodiment of the present invention Figure 2 ;
[0042] Fig.12c A schematic diagram of a three-dimensional roaming method provided by an application embodiment of the present invention Figure 3 ;
[0043] Fig.13 A flowchart of another three-dimensional roaming method provided by an embodiment of the present invention;
[0044] Fig.14 A schematic diagram of the structure of a three-dimensional roaming device provided by an embodiment of the present invention;
[0045] Fig.15 For Fig.14 A schematic diagram of the structure of an electronic device corresponding to the three-dimensional roaming device provided in the illustrated embodiment;
[0046] Fig.16 A schematic diagram of the structure of a three-dimensional roaming device provided by an embodiment of the present invention;
[0047] Fig.17 For Fig.16 The illustrated embodiment is a schematic structural diagram of an electronic device corresponding to the three-dimensional wandering device provided by the illustrated embodiment. DETAILED DESCRIPTION
[0048] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0049] The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. The singular forms "a", "said" and "the" used in the embodiments of the present invention and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings, and "multiple" generally includes at least two, but does not exclude the inclusion of at least one.
[0050] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.
[0051] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to determining" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)", depending on the context.
[0052] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a product or system including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such a product or system. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the product or system including the elements.
[0053] In addition, the step sequence in the following method embodiments is only an example and not a strict limitation.
[0054] Figure 1 A process of a three-dimensional roaming method provided by an embodiment of the present invention Figure 1 ; Figure 2 A flowchart of obtaining three-dimensional scene information provided by an embodiment of the present invention; see attached Figure 1 -Attached Figure 2As shown, this embodiment provides a three-dimensional roaming method, which can be applied to various application scenarios such as augmented reality (AR), virtual reality (VR) or mixed reality (MR). In addition, the execution subject of the three-dimensional roaming method is a three-dimensional roaming device. It can be understood that the roaming device can be implemented as software or a combination of software and hardware. Specifically, the three-dimensional roaming method may include:
[0055] S101: Acquire three-dimensional scene information, where the three-dimensional scene information includes multiple data objects.
[0056] The data object may be any form of object in the three-dimensional scene information, and in real life, the object may correspond to a real physical object. Moreover, the data object may represent different objects according to different three-dimensional scene information. For example, when the three-dimensional scene information is the three-dimensional scene information of a library, the data object may be a virtual book in the three-dimensional scene information, and the virtual book corresponds to a real physical book; when the three-dimensional scene information is the three-dimensional scene information of a supermarket, the data object may be a virtual commodity in the three-dimensional scene information, and the virtual commodity corresponds to a real physical commodity; those skilled in the art may determine the specific meaning expressed by the data object according to different three-dimensional scene information, and will not be elaborated here.
[0057] In addition, this embodiment does not limit the specific method for obtaining the three-dimensional scene information. Those skilled in the art can set it according to the specific application scenario and application requirements. For example, three-dimensional scene point cloud data can be obtained first, and then the three-dimensional scene point cloud data can be processed using a three-dimensional scene algorithm to obtain the three-dimensional scene information. Preferably, obtaining the three-dimensional scene information in this embodiment may include:
[0058] S1011: Acquire 3D point cloud data and 3D panoramic image.
[0059] S1012: Establish a three-dimensional model based on the three-dimensional point cloud data.
[0060] S1013: Map the 3D panoramic image onto the 3D model to obtain 3D scene information.
[0061] Specifically, a camera can be used to shoot actual application scenes (such as shopping malls, supermarkets, libraries, etc.) to obtain a three-dimensional panoramic view; a laser radar can be used to scan the actual application scene to obtain three-dimensional point cloud data. For example, when the application scene is a shopping mall, a camera can be used to shoot the mall to obtain a three-dimensional panoramic view of the mall, and a laser radar can be used to perform a comprehensive scan in the mall to obtain three-dimensional point cloud data corresponding to the mall; after obtaining the three-dimensional point cloud data, a three-dimensional model can be established based on the three-dimensional point cloud data, and the three-dimensional model can 100% restore the real-scale shopping mall; then the three-dimensional panoramic view can be attached to the three-dimensional model, and the three-dimensional scene information can be obtained.
[0062] By acquiring three-dimensional point cloud data and three-dimensional panoramic images through lidar and cameras, and then using the three-dimensional point cloud data and three-dimensional panoramic images to establish three-dimensional scene information, the accuracy and reliability of the three-dimensional scene information acquisition can be effectively guaranteed, so that multiple data objects can be displayed in the three-dimensional scene information. In addition, the three-dimensional scene information obtained in the above manner can ensure that when switching and roaming the data objects in the three-dimensional scene information, the scene switching is smoother and more natural, thereby improving the user's good experience of roaming the three-dimensional scene information and further improving the user's real experience of the data objects.
[0063] S102: Determine at least one roaming path based on the data object.
[0064] Since the three-dimensional scene information may include multiple data objects, different data objects may correspond to different roaming paths or the same roaming path; and the same data object may also correspond to different roaming paths. At this time, in order to implement the operation of roaming the data objects in the three-dimensional scene information, at least one roaming path may be determined based on the data objects.
[0065] Among them, this embodiment does not limit the specific implementation method of determining the roaming path, and those skilled in the art can set it according to specific application requirements and design requirements, for example: a first mapping relationship between a data object and a first roaming path is pre-configured, and the first roaming path can be a pre-configured merchant perspective path, that is, the first roaming path can meet the merchant's needs for promoting and advertising the data object; at least one first roaming path corresponding to the data object can be determined through the first mapping relationship. Alternatively, a second mapping relationship between a data object and a second roaming path is pre-configured, and the second roaming path can be a pre-configured user perspective path, that is, the second roaming path can meet the user's needs for viewing, reading, purchasing or other processing of the data object; at least one second roaming path corresponding to the data object can be determined through the second mapping relationship.
[0066] Of course, those skilled in the art may also adopt other methods to determine at least one roaming path based on the data object, as long as the accuracy and reliability of the roaming path determination can be guaranteed, which will not be elaborated here.
[0067] S103: Switch and roam the data objects in the three-dimensional scene information based on the roaming path.
[0068] After the roaming path is acquired, the data objects in the three-dimensional scene information can be switched and navigated based on the roaming path, so that the user can view, browse or perform other operations on at least part of the data objects in the three-dimensional scene information.
[0069] The three-dimensional roaming method provided in this embodiment obtains three-dimensional scene information including multiple data objects, determines at least one roaming path based on the data objects, and then switches and roams the data objects in the three-dimensional scene information based on the roaming path. This effectively enables users to view different data objects in the switched and roamed three-dimensional scene information, improves the user's real experience of the data objects, and effectively solves the problem of "online shopping mode cannot meet the real shopping experience" existing in the prior art. On the basis of effective cost planning, it also improves the efficiency and quality of processing data objects, ensures the interests of marketers, further improves the practicality of the method, and is conducive to market promotion and application.
[0070] Figure 3 A process of a three-dimensional roaming method provided by an embodiment of the present invention Figure 2 Based on the above embodiments, continue to refer to the attached Figure 3 As shown, after acquiring the three-dimensional scene information, the method in this embodiment may further include:
[0071] S201: Identify data objects in three-dimensional scene information and data ID information corresponding to the data objects.
[0072] S202: Determine object description information corresponding to the data object based on the data ID information.
[0073] In order to enable users to obtain detailed information of data objects, after obtaining the three-dimensional scene information, object description information corresponding to the data object can be obtained. Specifically, image recognition technology can be used to identify the data object located in the three-dimensional scene information and the data ID information corresponding to the data object. The data ID information is the identity information of the data object, and each data object corresponds to unique data ID information. After obtaining the data ID information, the object description information corresponding to the data object can be determined based on the data ID information. The data description information may include at least one of the following: object category, object name, object price, object details, etc., so that the object description information corresponding to the data object can be displayed in the three-dimensional scene information.
[0074] For example, when the three-dimensional scene information is that of a supermarket and the data object is red wine, the data ID information of the red wine can be obtained by identifying the three-dimensional scene information. The object description information corresponding to the red wine can be retrieved from a preset database through the data ID information. The object description information may include: price information of the red wine, origin information of the red wine, detailed information of the red wine, etc. After obtaining the object description information, the object description information can be displayed corresponding to the data object "red wine", so that the user can view and understand the situation of the data object conveniently.
[0075] Figure 4 A process of a three-dimensional roaming method provided by an embodiment of the present invention Figure 3 Based on the above embodiments, continue to refer to the attached Figure 4 As shown, before determining at least one roaming path based on the data object, the method in this embodiment may further include:
[0076] S301: Obtaining an execution operation input by a user.
[0077] S302: Determine a display mode of the three-dimensional scene information according to the execution operation, wherein the display mode includes at least one of the following: a roaming mode for automatically roaming data objects in the three-dimensional scene information, and a free mode for manually roaming data objects in the three-dimensional scene information.
[0078] Among them, the three-dimensional scene information can have different display models, and the display model can include at least one of the following: roaming mode and free mode; the roaming mode can automatically roam the data objects in the three-dimensional scene information, and the free mode can manually roam the data objects in the three-dimensional scene information.
[0079] For different display modes of three-dimensional scene information, different methods can be used to determine at least one roaming path based on the data object. Therefore, before determining at least one roaming path based on the data object, the execution operation input by the user can be obtained, and the display mode of the three-dimensional scene information can be determined according to the execution operation. For example, a mode adjustment control for setting the display mode is pre-set, and the user can input an execution operation for the mode adjustment control, and the execution operation can be a click operation, a sliding operation, etc. After obtaining the execution operation input by the user for the mode adjustment control, the display mode of the three-dimensional scene information can be determined according to the execution operation; for example: when the user inputs a click operation for the mode adjustment control, it can be determined that the display mode of the three-dimensional scene information is the roaming mode; when the user inputs a click operation for the mode adjustment control again, it can be determined that the display mode of the three-dimensional scene information is the free mode.
[0080] Figure 5 A process for determining at least one roaming path based on a data object provided by an embodiment of the present invention Figure 1 Based on the above embodiments, continue to refer to the attached Figure 5 As shown, different display modes of the three-dimensional scene information may have different determination methods to obtain the roaming path, wherein one achievable method is that determining at least one roaming path based on the data object in this embodiment may include:
[0081] S1021: When the display mode of the three-dimensional scene information is the roaming mode, object category information of the data object is obtained.
[0082] Among them, one or more object categories may be pre-set for the data objects in the three-dimensional scene information. For example, in the three-dimensional scene information of a supermarket, the object categories of the data objects may include: life category, food category, fresh meat category, etc. When there are multiple object category information, the object category information of the data object obtained in this embodiment may include:
[0083] S10211: Obtain the execution operation input by the user for the object category information.
[0084] S10212: Determine at least one target object category from a plurality of object category information according to the execution operation.
[0085] Specifically, when the display mode of the three-dimensional scene information is the roaming mode, the object category information of the data object can be obtained and displayed. It can be understood that multiple object category information is preset, and one object category information can include multiple data objects. For example, when the three-dimensional scene information is supermarket scene information, the object category information located in the three-dimensional scene information can include alcohol, snacks, fruits and vegetables, etc. At this time, the execution operation input by the user for the object category information can be obtained, and at least one target object category can be determined from the multiple object category information through the execution operation. For example: when the user inputs an execution operation for the object category information of alcohol, the target object category can be determined to be alcohol; when the user inputs an execution operation for the object category information of alcohol and fruits and vegetables, the target object category can be determined to be alcohol and fruits and vegetables, that is, the determined target object category can be one or more.
[0086] S1022: Determine at least one roaming path according to the object category information.
[0087] After the object category information (target object category) of the data object is obtained, at least one roaming path can be determined according to the object category information (target object category). Specifically, a mapping relationship between the object category information and the roaming path is pre-configured. After the object category information is determined, the object category information and the mapping relationship can be used to determine at least one roaming path, thereby ensuring the accuracy and reliability of the roaming path determination.
[0088] Further, after determining at least one roaming path, switching and roaming the data objects in the three-dimensional scene information based on the roaming path may include:
[0089] S1031: Automatically switch and roam the data objects in the three-dimensional scene information according to the roaming path to display all data objects included in the three-dimensional scene information.
[0090] When the display mode of the three-dimensional scene information is the roaming mode, after obtaining the roaming path, the data objects in the three-dimensional scene information can be automatically switched and walked according to the roaming path, so that in the three-dimensional scene, all data objects included in the three-dimensional scene information can be automatically switched and displayed, which makes it easier for users to understand all data objects included in the three-dimensional scene information.
[0091] It is conceivable that when the display mode of the three-dimensional scene information is the roaming mode, the method in this embodiment may further include:
[0092] S401: Acquire a first timeline corresponding to a roaming mode.
[0093] S402: Displaying a first time axis in a first preset manner.
[0094] Among them, when the display mode of the three-dimensional scene information is a roaming mode, a pre-configured first timeline corresponding to the roaming mode can be obtained, and the first timeline is used to identify the progress of switching and roaming of data objects in the three-dimensional scene information. In addition, this embodiment does not limit the display style of the first timeline, and those skilled in the art can set it according to specific application requirements, which will not be repeated here. After obtaining the first timeline, the first timeline can be displayed in a first preset manner, wherein the first preset manner may include: a first preset color, a first preset brightness, etc. For example, the progress information of the first timeline is displayed in a first preset color (for example: red, green, etc.), so that the user can understand the progress of the automatic roaming in a timely manner.
[0095] In this embodiment, when the display mode of the three-dimensional scene information is the roaming mode, at least one roaming path is determined through the object category information, which effectively ensures the efficiency and accuracy of the roaming path determination; and, in the process of automatically switching and roaming the data objects in the three-dimensional scene information based on the roaming path, the first time axis corresponding to the roaming mode can also be obtained, and the first time axis is displayed in a first preset manner, so that the user can understand the progress of the automatic switching and roaming of the data objects in the roaming mode of the three-dimensional scene information through the first time axis, further ensuring a good user experience.
[0096] Figure 6 A process for determining at least one roaming path based on a data object provided by an embodiment of the present invention Figure 2 Based on the above embodiments, continue to refer to the attached Figure 6 As shown, similarly, since different display modes of the three-dimensional scene information may have different determination methods to obtain the roaming path, another achievable method is that determining at least one roaming path based on the data object in this embodiment may include:
[0097] S1023: When the display mode of the three-dimensional scene information is the free mode, obtaining at least one roaming position information input by the user for the data object.
[0098] S1024: Determine at least one roaming path according to the roaming location information.
[0099] Specifically, when the display mode of the three-dimensional scene information is a free mode, at least one roaming position information input by the user for the data object can be obtained, wherein the roaming position information can be obtained by the user performing input operations on the data object once or multiple times; after the roaming position information is obtained, at least one roaming path can be determined based on the input roaming position information.
[0100] For example, a starting point of a roaming path is pre-configured in the three-dimensional scene information (for example, the entrance of a shopping mall, the entrance of a supermarket, the entrance of a library, etc.). After obtaining a roaming location information input by a user for a data object, a roaming path can be determined according to the starting point and the roaming location information. When there are multiple roaming location information, time information corresponding to the multiple roaming location information can be obtained, and the multiple roaming location information is sorted according to the order of the time information, and then a roaming path is generated according to the starting point and the sorted multiple roaming location information. Alternatively, after obtaining multiple roaming location information input by the user for the data object, the time information corresponding to each roaming location information and the distance information between any two roaming location information can be obtained, and all first roaming location information with distance information less than or equal to a preset threshold can be obtained, and all the above-mentioned first roaming location information are sorted according to the sequence of time information, and then a roaming path is generated according to the starting point and all the sorted first roaming location information; all second roaming location information with distance information greater than the preset threshold is obtained, and then it can be sorted according to the sequence of time information, and then another roaming path is generated according to the starting point and all the sorted second roaming location information, so that multiple roaming paths can be determined.
[0101] In specific applications, when the display mode of the three-dimensional scene information is the free mode, since the display area of the three-dimensional scene information includes data objects and road information between the data objects, the user can also input at least one roaming position information for the road information, and at least one roaming path can also be determined based on the roaming position information. It can be imagined that the implementation process of this method is similar to the specific implementation method of obtaining at least one roaming position information input by the user for the data object and determining at least one roaming path based on the roaming position information, and the above-mentioned statements can be referred to, and no further description is given here.
[0102] It is conceivable that when the display mode of the three-dimensional scene information is the free mode, the method in this embodiment may further include:
[0103] S501: Acquire a second time axis corresponding to the free mode.
[0104] S502: Displaying a second time axis in a second preset manner.
[0105] Among them, when the display mode of the three-dimensional scene information is the free mode, a pre-configured second timeline corresponding to the free mode can be obtained, and the second timeline is used to identify the progress of switching and roaming of data objects in the three-dimensional scene information. In addition, this embodiment does not limit the display style of the second timeline, and those skilled in the art can set it according to specific application requirements, which will not be repeated here. After obtaining the second timeline, the second timeline can be displayed in a second preset manner, wherein the second preset manner may include: a second preset color, a second preset brightness, etc. For example, the progress information of the second timeline is displayed in a second preset color (e.g., gray, white, etc.) that is different from the first preset color, so that the user can promptly understand the progress of free roaming.
[0106] In this embodiment, when the display mode of the three-dimensional scene information is the free mode, by obtaining at least one roaming position information input by the user for the data object, and then determining at least one roaming path according to the roaming position information, the efficiency and accuracy of the roaming path determination are effectively guaranteed; and, in the process of free roaming of the data objects in the three-dimensional scene information based on the roaming path, a second timeline corresponding to the roaming mode can also be obtained, and the second timeline can be displayed in a second preset manner, so that the user can understand the progress of the three-dimensional scene information in switching and roaming the data objects in the free mode through the second timeline, further ensuring a good user experience.
[0107] Figure 7 A process of a three-dimensional roaming method provided by an embodiment of the present invention Figure 4 Based on the above embodiments, continue to refer to the attached Figure 7 As shown, in order to improve the practicability of the method, the method in this embodiment may further include:
[0108] S601: Obtaining a switching operation input by a user for a display mode.
[0109] S602: Changing the display mode of the current three-dimensional scene information according to the switching operation.
[0110] Since the display modes of the three-dimensional scene information include a roaming mode and a free mode, in order to meet the different display requirements of users for different three-dimensional scene information, the method can also freely switch the display mode of the three-dimensional scene information. Specifically, when the display mode of the three-dimensional scene information needs to be switched, a switching operation input by the user for the display mode can be obtained, and the switching operation can be a point selection operation, a sliding operation, or an input command operation. After the switching operation is obtained, the display mode of the current three-dimensional scene information can be changed according to the switching operation.
[0111] For example: a mode adjustment control for adjusting the display mode of the 3D scene information is pre-configured. When the display mode of the 3D scene information is the free mode, the user can input a switching operation to the mode adjustment control, and the free mode of the current 3D scene information can be changed to the roaming mode through the switching operation. Alternatively, when the display mode of the 3D scene information is the roaming mode, the user can input a switching operation to the mode adjustment control, and the roaming mode in the current 3D scene information can be changed to the free mode through the switching operation.
[0112] By obtaining the switching operation input by the user for the display mode and changing the display mode of the current three-dimensional scene information according to the switching operation, the free switching operation of the display mode of the three-dimensional scene information is effectively realized, thereby meeting the user's demand for automatic switching of the display mode and further improving the flexibility and reliability of the use of this method.
[0113] Figure 8 A process of a three-dimensional roaming method provided by an embodiment of the present invention Figure 5 Based on the above embodiments, continue to refer to the attached Figure 8 As shown, in order to improve the practicability of the method, the method in this embodiment may further include:
[0114] S701: Obtain a switching instruction input by a user for a roaming path.
[0115] S702: Changing the current roaming path according to the switching instruction.
[0116] Since there may be one or more roaming paths corresponding to a data object, when there are multiple roaming paths, in order to meet the roaming needs of the user, the user can freely switch between multiple different roaming paths. Specifically, when it is necessary to switch the roaming path, a switching instruction input by the user for the roaming path can be obtained, and the switching instruction can be a point selection operation, a sliding operation, or an input instruction operation. After the switching instruction is obtained, the roaming path for roaming in the current three-dimensional scene information can be changed according to the switching instruction.
[0117] For example: a path adjustment control for adjusting the roaming path in the three-dimensional scene information is pre-configured. First, the data objects in the three-dimensional scene information can be roamed based on the first roaming path. When the user is not interested in or has no processing requirements for the data objects on the current first roaming path, the user can input a switching instruction to the path adjustment control to switch the first roaming path in the current three-dimensional scene information to other roaming paths through the switching instruction. The other roaming path can be a preset second roaming path or a third roaming path, etc. In addition, when the user wants to review the data objects on a certain roaming path, the user can input a switching instruction to the path adjustment control to switch the current roaming path back to the original roaming path, thereby realizing the process of personalized switching back to the original path.
[0118] By obtaining the switching instructions input by the user for the roaming path and changing the current roaming path according to the switching instructions, the roaming path for roaming in the three-dimensional scene information can be freely switched, which meets the user's processing requirements for data objects and roaming experience, and further improves the flexibility and reliability of the method.
[0119] Fig. 9 A process of a three-dimensional roaming method provided by an embodiment of the present invention Figure 6 Based on the above embodiments, continue to refer to the attached Fig. 9 As shown, in order to improve the practicability of the method, the method in this embodiment may further include:
[0120] S801: Acquire marketing information corresponding to the data object.
[0121] S802: Displaying marketing information in the three-dimensional scene information.
[0122] Among them, marketing information can refer to any type of information used to promote the data object, and the marketing information can include at least one of the following types: marketing videos, 3D objects, shopping coupons, marketing activity information (for example: red envelopes, vouchers, discount coupons, etc.), etc., and the marketing information can be set at any position in the three-dimensional scene, for example: marketing videos can be next to the data object, 3D objects can be on the ground or in the air; red envelopes can be displayed on the ground or in the form of red envelope rain, etc.; the marketing information can be information corresponding to the data object pre-configured by the marketer. After obtaining the data object, the data ID information of the data object can be used to obtain the marketing information corresponding to the data object. After obtaining the marketing information, the marketing information can be displayed in the three-dimensional scene information, so that users can timely and quickly understand the marketing activities related to the data object, which is convenient for improving the quality and efficiency of processing the data object.
[0123] Fig.10 A process of a three-dimensional roaming method provided by an embodiment of the present invention Figure 7 Based on the above embodiments, continue to refer to the attached Fig.10 As shown, when switching and roaming the data objects in the three-dimensional scene information based on the roaming path, the method in this embodiment may further include:
[0124] S901: Obtaining an execution operation input by a user for a data object.
[0125] S902: Stop wandering according to the execution operation and process the data object accordingly.
[0126] Specifically, when switching and roaming data objects in three-dimensional scene information based on the roaming path, the above-mentioned switching and roaming includes switching and roaming data objects in roaming mode and switching and roaming data objects in free mode. When the user encounters a data object of interest or a data object to be processed, the user can input an execution operation for the data object. After obtaining the execution operation, the switching and roaming operation of the data object can be stopped according to the execution operation, and the data object can be processed accordingly.
[0127] For example: when switching and roaming the data object "goods" in the three-dimensional scene information of the supermarket, when the user encounters a product that he wants to buy or wants to view the details of the product, the user can enter an execution operation for the product, and the execution operation can be a view details operation, an add to cart operation, etc. When the execution operation is obtained, the switching and roaming operation on the data object can be stopped, and the data object can be processed accordingly according to the execution operation, for example, according to the view corresponding operation, the detailed information corresponding to the data object is retrieved and displayed for the user to view. Alternatively, according to the add to cart operation, the data object is added to the preset processing process to realize the processing operation of the data object to be purchased.
[0128] Fig.11 A process of a three-dimensional roaming method provided by an embodiment of the present invention Figure 8 Based on the above embodiments, continue to refer to the attached Fig.11 As shown, before acquiring the three-dimensional scene information, the method in this embodiment may further include:
[0129] S1001: Obtain the user's location information.
[0130] S1002: Determine recommended information according to the position information, where the recommended information includes scene description information of at least one three-dimensional scene information.
[0131] Specifically, the location information of the user can be obtained through the GPS positioning device. After the location information is obtained, the recommended information can be determined based on the location information, and the recommended information can include scene description information of at least one three-dimensional scene information. For example: the location information of user A is location one, and the recommended information of all three-dimensional scene information located around location one can be detected. Assume that the recommended information of the three-dimensional scene information obtained includes: recommended information of scene one, scene two, scene three and scene four, and the above-mentioned scene one, scene two, scene three and scene four have different distances from the location information of the user. Therefore, based on the location information of the user, the scene description information corresponding to the above-mentioned different scenes can be displayed from near to far, so that the user can select a target scene according to the scene description information, and can perform operations that meet the required information in the three-dimensional scene information corresponding to the target scene.
[0132] Another achievable method is: obtaining the user's location information through a GPS positioning device, and obtaining the user's demand information based on the user's execution operation. After obtaining the location information and demand information, the recommended information corresponding to the demand information can be determined based on the location information, and the recommended information can include scene description information of at least one three-dimensional scene information. For example: the location information of user A is location 1, and the demand information is to buy alcohol. At this time, the recommended information of all three-dimensional scene information related to the alcohol in the demand information located around location 1 can be detected. Assume that the recommended information of the three-dimensional scene information obtained includes: recommended information of scene 1, scene 2, scene 3 and scene 4, and the above-mentioned scene 1, scene 2, scene 3 and scene 4 have different distances from the user's location information. Therefore, based on the location information of the user, the scene description information corresponding to the above-mentioned different scenes can be displayed from near to far, so that the user can select a target scene according to the scene description information, and can perform operations that meet the demand information in the three-dimensional scene information corresponding to the target scene.
[0133] Based on any one of the above embodiments, switching and roaming the data objects in the three-dimensional scene information based on the roaming path in this embodiment may also include:
[0134] S1032: Determine a playback speed corresponding to the roaming path.
[0135] Different roaming paths may correspond to different playback speeds. For example, the playback speed of a roaming path where a data object with a larger volume is located may be faster, and the playback speed of a roaming path where a data object with a smaller volume is located may be slower, thereby improving the roaming speed and efficiency while ensuring that the user can clearly see the data object. Specifically, determining the playback speed corresponding to the roaming path may include:
[0136] S10321: Obtain object category information of data objects located on the roaming path.
[0137] S10322: Determine a playback speed corresponding to the roaming path according to the object category information.
[0138] Specifically, image information of the data object can be obtained, and object category information of the data object can be determined through the image information. Since data objects belonging to the same category or data objects of similar categories are often in the same area, this can facilitate users to view the data objects. In addition, a mapping relationship between object category information and playback speed is pre-stored. Therefore, after obtaining the data object information, the playback speed corresponding to the roaming path can be determined according to the data object information, and the speeds of all roaming paths in the area can be determined according to the category information of the data object.
[0139] For example: the object category information of the data objects on the first roaming path is snacks, and the object category information of the data objects on the second roaming path is red wine. Since the price of data objects of the snack category is often lower than that of data objects of the red wine category, a first playback speed corresponding to data objects of the snack category and a second playback speed corresponding to data objects of the red wine category are pre-configured, wherein the first playback speed is greater than the second playback speed. Then, the playback speed of the first roaming path can be determined to be the first playback speed, and the playback speed of the second roaming path can be determined to be the second playback speed, so that users can quickly browse data objects of the snack category and slowly browse data objects of the red wine category, thereby satisfying the user's personalized needs and actual purchasing psychology and improving the roaming efficiency for data objects.
[0140] S1033: Switch and roam the data objects in the three-dimensional scene information according to the play speed and the roaming path.
[0141] After determining the roaming path and the playback speed corresponding to the roaming path, the data objects in the three-dimensional scene information can be switched and roamed according to the playback speed and the roaming path. It can be imagined that the three-dimensional scene information may include multiple roaming paths, and the playback speeds between different roaming paths can be the same or different, further improving the quality and efficiency of switching and roaming data objects.
[0142] It can be imagined that the wandering mode of the three-dimensional scene information in this embodiment includes a roaming mode and a free mode. When the three-dimensional scene information is in different wandering modes, different playback speeds may correspond to it. For example, when the wandering mode of the three-dimensional scene information is the roaming mode, multiple roaming paths may correspond to the same or different roaming playback speeds; when the wandering mode of the three-dimensional scene information is the free mode, the roaming path may correspond to a free playback speed that is different from the roaming playback speed.
[0143] Optionally, based on the above embodiment, in order to improve the practicability of the method, the method in this embodiment may further include:
[0144] S1034: Obtaining an adjustment instruction input by the user for the playback speed.
[0145] S1035: Adjust the playback speed according to the adjustment instruction.
[0146] Specifically, when the data objects in the three-dimensional scene information are switched and roamed according to the playback speed and the roaming path, if the user is not comfortable with the playback speed of the current roaming path, the playback speed of the current roaming path can be manually adjusted. For example, a speed adjustment control is pre-set, and the user can input an adjustment instruction for the playback speed through the speed adjustment control. After obtaining the adjustment instruction, the playback speed can be adjusted according to the adjustment instruction. Specifically, the playback speed can be accelerated or decelerated according to the adjustment instruction, so that the adjusted playback speed can meet the user's personalized needs, further improving the convenience, flexibility and reliability of the method.
[0147] Take the mall application scenario in the e-commerce field as an example. In this case, the data object may refer to the goods in the mall application scenario. Figure 12a-12c As shown, this application embodiment provides a three-dimensional roaming method, which may include the following steps:
[0148] step101: Scan the mall with a laser radar to obtain 3D point cloud data, and scan the mall with a camera to obtain a 3D panoramic image; obtain 3D scene information based on the 3D point cloud data and the 3D panoramic image.
[0149] Specifically, after obtaining the 3D point cloud data and the 3D panorama, the 3D point cloud data can be uploaded to the cloud, so as to facilitate obtaining the 3D point cloud data from the cloud and analyzing and processing the 3D point cloud data. Specifically, the 3D model is reconstructed and displayed through the 3D scene algorithm (for example: deep learning algorithm) and the 3D point cloud data. Then the 3D panorama is attached to the 3D model to generate the 3D scene information, realizing 100% restoration of the real-scale 3D scene.
[0150] Step 102: Use image recognition technology to identify the three-dimensional scene information and identify the data object "product" and the product ID information corresponding to the product.
[0151] Step 103: Use the product ID information to search for product description information corresponding to the product on the Internet or in a preset database.
[0152] Specifically, the product ID information can be used to search for product description information corresponding to the product in a preset database. The product description information may include at least one of the following: product name information, product price information, product details information, etc.; thereby realizing the combination of online and offline products. After obtaining the product description information, the product description information can be displayed on a PC, mobile terminal, AR shopping terminal, etc. for users to browse.
[0153] Step 104: Determine at least one roaming path based on the data object, and switch and roam the data objects in the three-dimensional scene information based on the roaming path.
[0154] The wandering mode of the three-dimensional scene information includes a roaming mode and a free mode. When the three-dimensional scene information is in the roaming mode, at least one roaming path can be determined according to the category information of the data object, such as Figure 12a-12b As shown, at least one roaming path may include roaming path 1 and roaming path 2, wherein the data objects on roaming path 1 are different from the data objects on roaming path 2, but the object category information of the data objects on roaming path 1 and the object category information of the data objects on roaming path 2 may be the same or different. In addition, the determined roaming path may be a roaming path from the perspective of a merchant, or may be a roaming path from the perspective of a user; based on at least one roaming path, all data objects in the three-dimensional scene information may be automatically switched and walked. When the three-dimensional scene information is in free mode, at least one roaming position information input by the user for the data object may be obtained; and at least one roaming path may be determined based on the roaming position information, and based on the roaming path, at least some of the data objects in the three-dimensional scene information may be freely switched and walked.
[0155] In addition, when the 3D scene information is in roaming mode and there are multiple roaming paths, the user can switch the roaming paths freely. Figure 12a-12bAs shown, when the 3D scene information is switching and wandering along roaming path 1, if the user is not interested in the goods on roaming path 1, the roaming path can be switched from roaming path 1 to roaming path 2, so that the goods in the 3D scene information can be switched and wandered based on roaming path 2. In addition, the user can automatically change the wandering mode of the 3D scene information according to demand, that is, when the 3D scene information is in roaming mode, the user can switch the roaming mode to free mode according to the preset control; or, when the 3D scene information is in free mode, the user can switch the free mode to roaming mode according to the preset control.
[0156] It should be noted that in the process of browsing the products, marketing information corresponding to the products can also be displayed, such as: promotional videos, discount promotion information, shopping coupons, etc., so as to promote the products, attract users' attention, and improve the market competitiveness of the products.
[0157] Furthermore, the method provided by this application embodiment can also identify shopping malls, specialty stores, supermarkets and other stores around the current location and push them to the user according to the specific location of the user's city. The user can select merchants and browse products according to his or her preferences. Specifically, the method provided by this application embodiment can also include the following steps:
[0158] Step 1: Obtain user location information and shopping needs.
[0159] Step 2: Based on the location information, multiple shopping mall description information that is located around the user and meets the shopping needs is displayed, wherein each shopping mall description information may correspond to a three-dimensional scene information of a shopping mall.
[0160] Step 3: Detect the execution operation input by the user for the mall description information, and determine a target description information from multiple mall description information according to the execution operation.
[0161] Step 4: Determine the corresponding target three-dimensional scene information according to the target description information, and display the three-dimensional target scene information.
[0162] Specifically, Fig.12cAs shown, the method can display the recommendation information of surrounding products or the recommendation information of big data products; the user can rotate and view the entire scene information through a single point on the display interface at the location. When determining a certain target scene information, the method steps in the above embodiment can be followed, such as: the user can pre-configure the display mode of the three-dimensional scene information. When the three-dimensional scene information is in free mode, the user can select the appropriate product according to the needs and perform corresponding operations on the product, such as: viewing the product details. If the product details do not meet the expected needs, you can return to the display process of the product in the three-dimensional scene information. When the product details meet the expected needs, you can perform an immediate purchase or add to the shopping cart operation. After the add to the shopping cart operation, you can enter the corresponding settlement page to realize the purchase operation of the product.
[0163] When the three-dimensional scene information is in roaming mode, the user can select the category of the product for roaming, that is, determine the roaming path according to the category of the product, and switch and walk the selected product based on the roaming path. During the roaming process, the three-dimensional scene information can display marketing activities such as roaming to receive coupons, video content display, advertising placement, red envelope coupons, etc.; or, switch to select different categories of goods, and enter the product information belonging to the corresponding category based on the product category. In addition, in the process of automatically switching and walking the goods, the user can select the appropriate goods according to the needs, and can perform corresponding operations on the goods, for example: view the details of the goods. If the details of the goods do not meet the expected needs, you can continue to automatically switch and walk the goods; when the details of the goods meet the expected needs, you can perform the purchase immediately or add to the shopping cart operation. After adding to the shopping cart, you can continue to automatically switch and walk the goods, or you can enter the corresponding settlement page to realize the purchase operation of the goods.
[0164] The 3D roaming method provided by this application embodiment generates 3D point cloud data and 3D panorama through laser radar and camera scanning, and the 3D point cloud data and 3D panorama can be used to restore the 3D scene with real proportions 100%; specifically, the point cloud data can be converted into a 3D model, and then the 3D panorama can be attached to the 3D model, so that the camera can be used to freely roam and switch in the 3D scene information, and the cost of 3D roaming can be effectively saved. After obtaining the 3D roaming scene information, the product code corresponding to the product can be identified through object recognition technology, and the product information can be retrieved based on the product code and attached to the 3D roaming scene information, ensuring the complete integration of 3D reconstructed products, online products, and offline shopping malls, thereby achieving the combination of online and offline.
[0165] In addition, the method can also upload all 3D point cloud data and 3D panoramas to the cloud, so that the data can be edited and downloaded at any time, and all devices and content are cloud-based, thereby ensuring the quality and efficiency of data processing. In addition, the method can also identify the scene description information of the 3D scene information of shopping malls, specialty stores, supermarkets, etc. around the current location according to the specific location of the user's city, and push it to the user. The user can select the 3D scene information according to his or her preferences to browse the corresponding data objects (for example: goods); and in the roaming process, a variety of interactions can be carried out, such as: merchants can put some coupons for goods in the scene, 3D cartoon images of such goods, advertisements, product introductions and other marketing activities, and can achieve online and offline integration. It effectively improves the practicality of the method and is conducive to market promotion and application.
[0166] Fig.13 A flowchart of another three-dimensional roaming method provided by an embodiment of the present invention; Fig.13 As shown, this embodiment provides another 3D roaming method. The execution subject of the processing method is a 3D roaming device. It can be understood that the roaming device can be implemented as software or a combination of software and hardware. Specifically, the 3D roaming method may include:
[0167] S1101: Acquire three-dimensional scene information, where the three-dimensional scene information includes data objects of multiple categories;
[0168] S1102: Determine at least one target category among multiple categories;
[0169] S1103: Determine at least one roaming path according to the target category;
[0170] S1104: Automatically switch and roam the data objects of the target category based on the roaming path.
[0171] Among them, the specific implementation method of the above steps in this embodiment is similar to the implementation process of steps S101-S103 and S1021-S1022 in the above embodiment. Please refer to the above statements for details, and no further details will be given here.
[0172] It is conceivable that the method in this embodiment may also include the above Figure 2-12a -12b, for the part not described in detail in this embodiment, please refer to Figure 2-12a -12b. The implementation process and technical effects of this technical solution refer to Figure 2-12a The description in the embodiment shown in FIG. 12b will not be repeated here.
[0173] Fig.14 A schematic diagram of the structure of a three-dimensional roaming device provided by an embodiment of the present invention; Fig.14 As shown, this embodiment provides a three-dimensional roaming device, which can execute the above three-dimensional roaming method. Specifically, the device may include: a first acquisition module 11, a first determination module 12 and a first processing module 13.
[0174] A first acquisition module 11 is used to acquire three-dimensional scene information, where the three-dimensional scene information includes multiple data objects;
[0175] A first determining module 12, configured to determine at least one roaming path based on the data object;
[0176] The first processing module 13 is used to switch and roam the data objects in the three-dimensional scene information based on the roaming path.
[0177] Optionally, when the first acquisition module 11 acquires three-dimensional scene information, the first acquisition module 11 can be used to execute: acquiring three-dimensional point cloud data and a three-dimensional panoramic image; establishing a three-dimensional model based on the three-dimensional point cloud data; mapping the three-dimensional panoramic image onto the three-dimensional model to acquire three-dimensional scene information.
[0178] Optionally, after acquiring the three-dimensional scene information, the first processing module 13 in this embodiment can also be used to perform: identifying data objects located in the three-dimensional scene information and data ID information corresponding to the data objects; determining object description information corresponding to the data objects based on the data ID information.
[0179] Optionally, before determining at least one roaming path based on the data object, the first processing module 13 in this embodiment can also be used to perform: obtaining an execution operation input by the user; determining a display mode of the three-dimensional scene information based on the execution operation, wherein the display mode includes at least one of the following: a roaming mode for automatically roaming the data objects in the three-dimensional scene information, and a free mode for manually roaming the data objects in the three-dimensional scene information.
[0180] Optionally, when the first determination module 12 determines at least one roaming path based on the data object, the first determination module 12 can be used to execute: when the display mode of the three-dimensional scene information is the roaming mode, obtain object category information of the data object; determine at least one roaming path according to the object category information.
[0181] Optionally, the first processing module 13 in this embodiment may also be used to execute: acquiring a first time axis corresponding to the roaming mode; and displaying the first time axis in a first preset manner.
[0182] Optionally, when there are multiple object category information, when the first determination module 12 obtains the object category information of the data object, the first determination module 12 can be used to perform: obtaining an execution operation input by the user for the object category information; and determining at least one target object category from the multiple object category information according to the execution operation.
[0183] Optionally, when the first determination module 12 determines at least one roaming path based on the data object, the first determination module 12 can be used to execute: when the display mode of the three-dimensional scene information is a free mode, obtaining at least one roaming position information input by the user for the data object; and determining at least one roaming path based on the roaming position information.
[0184] Optionally, the first processing module 13 in this embodiment may also be used to execute: acquiring a second time axis corresponding to the free mode; and displaying the second time axis in a second preset manner.
[0185] Optionally, the first processing module 13 in this embodiment may also be used to execute: obtaining a switching operation input by a user for a display mode; and changing the display mode of the current three-dimensional scene information according to the switching operation.
[0186] Optionally, when the first processing module 13 switches and wanders the data objects in the three-dimensional scene information based on the roaming path, the first processing module 13 can be used to execute: automatically switching and wandering the data objects in the three-dimensional scene information according to the roaming path to display all data objects included in the three-dimensional scene information.
[0187] Optionally, the first processing module 13 in this embodiment may also be used to execute: obtaining a switching instruction input by a user for a roaming path; and changing the current roaming path according to the switching instruction.
[0188] Optionally, the first processing module 13 in this embodiment may also be used to execute: obtaining marketing information corresponding to the data object; and displaying the marketing information in the three-dimensional scene information.
[0189] Optionally, when switching and roaming data objects in the three-dimensional scene information based on the roaming path, the first processing module 13 in this embodiment can also be used to execute: obtaining the execution operation input by the user for the data object; stopping roaming according to the execution operation, and performing corresponding processing on the data object.
[0190] Optionally, before acquiring the three-dimensional scene information, the first processing module 13 in this embodiment can also be used to execute: acquiring the location information of the user; determining recommendation information according to the location information, wherein the recommendation information includes scene description information of at least one three-dimensional scene information.
[0191] Optionally, when the first processing module 13 switches and roams the data objects within the three-dimensional scene information based on the roaming path, the first processing module 13 can be used to execute: determining a playback speed corresponding to the roaming path; switching and roaming the data objects within the three-dimensional scene information according to the playback speed and the roaming path.
[0192] Optionally, when the first processing module 13 determines the playback speed corresponding to the roaming path, the first processing module 13 can be used to execute: obtaining object category information of data objects located on the roaming path; and determining the playback speed corresponding to the roaming path according to the object category information.
[0193] Optionally, the first processing module 13 in this embodiment may also be used to execute: obtaining an adjustment instruction input by a user for the play speed; and adjusting the play speed according to the adjustment instruction.
[0194] Fig.14 The device shown can perform Figure 1-Figure 12a -12b, for the part not described in detail in this embodiment, please refer to Figure 1-Figure 12a -12b. The implementation process and technical effects of this technical solution refer to Figure 1-Figure 12a The description in the embodiment shown in FIG. 12b will not be repeated here.
[0195] In one possible design, Fig.14 The structure of the three-dimensional roaming device shown can be implemented as an electronic device, which can be a mobile phone, a tablet computer, a server, or other devices. Fig.15 As shown, the electronic device may include: a first processor 21 and a first memory 22. The first memory 22 is used to store the electronic device to perform the above Figure 1-Figure 12a -12b shows a program of a three-dimensional roaming method provided in the embodiment shown in FIG. 12b. The first processor 21 is configured to execute the program stored in the first memory 22.
[0196] The program includes one or more computer instructions, wherein when the one or more computer instructions are executed by the first processor 21, the following steps can be implemented:
[0197] Acquire three-dimensional scene information, where the three-dimensional scene information includes multiple data objects;
[0198] determining at least one navigation path based on the data object;
[0199] The data objects in the three-dimensional scene information are switched and roamed based on the roaming path.
[0200] Furthermore, the first processor 21 is also used to execute the aforementioned Figure 1-Figure 12a -12b All or part of the steps in the embodiment shown.
[0201] The structure of the electronic device may further include a first communication interface 23 for the electronic device to communicate with other devices or a communication network.
[0202] In addition, an embodiment of the present invention provides a computer storage medium for storing computer software instructions used by electronic devices, which includes instructions for executing the above Figure 1-Figure 12a -12b is the procedure involved in the three-dimensional roaming method in the method embodiment shown in FIG.
[0203] Fig.16 A schematic diagram of the structure of a three-dimensional roaming device provided by an embodiment of the present invention; Fig.16 As shown, this embodiment provides a three-dimensional roaming device, which can execute the above three-dimensional roaming method. Specifically, the device may include: a second acquisition module 31, a second determination module 32, and a second processing module 33.
[0204] A second acquisition module 31 is used to acquire three-dimensional scene information, where the three-dimensional scene information includes data objects of multiple categories;
[0205] A second determination module 32, configured to determine at least one target category among the multiple categories;
[0206] The second determination module 32 is further used to determine at least one roaming path according to the target category;
[0207] The second processing module 33 is used to automatically switch and roam the data objects of the target category based on the roaming path.
[0208] Fig.16 The device shown can perform Figure 12a-12b - Fig.13 For the method of the embodiment shown in the figure, the part not described in detail in this embodiment can be referred to Figure 12a-12b - Fig.13 The implementation process and technical effects of this technical solution refer to Figure 12a-12b - Fig.13 The description in the illustrated embodiment will not be repeated here.
[0209] In one possible design, Fig.16 The structure of the three-dimensional roaming device shown can be implemented as an electronic device, which can be a mobile phone, a tablet computer, a server, or other devices. Fig.17 As shown, the electronic device may include: a second processor 41 and a second memory 42. The second memory 42 is used to store the information that supports the electronic device to execute the above Figure 12a-12b - Fig.13The program of the three-dimensional wandering method provided in the illustrated embodiment, the second processor 41 is configured to execute the program stored in the second memory 42 .
[0210] The program includes one or more computer instructions, wherein when the one or more computer instructions are executed by the second processor 41, the following steps can be implemented:
[0211] Acquire three-dimensional scene information, where the three-dimensional scene information includes data objects of multiple categories;
[0212] identifying at least one target category among the plurality of categories;
[0213] determining at least one roaming path according to the target category;
[0214] Automatically switch and roam the data objects of the target category based on the roaming path.
[0215] The structure of the electronic device may further include a second communication interface 43 for the electronic device to communicate with other devices or a communication network.
[0216] In addition, an embodiment of the present invention provides a computer storage medium for storing computer software instructions used by electronic devices, which includes instructions for executing the above Figure 12a-12b - Fig.13 The procedures involved in the three-dimensional roaming method in the method embodiment shown.
[0217] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.
[0218] Through the description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by adding a necessary general hardware platform, and of course can also be implemented by combining hardware and software. Based on such an understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a computer product, and the present invention can be in the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
[0219] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable device to produce a machine, so that the instructions executed by the processor of the computer or other programmable device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0220] These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable device to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0221] These computer program instructions may also be loaded onto a computer or other programmable device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.
[0222] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.
[0223] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.
[0224] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.
[0225] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims
1. A three-dimensional roaming method, characterized in that: include: Acquire three-dimensional scene information, wherein the three-dimensional scene information includes a plurality of data objects; determining at least one navigation path based on the data object; Switching and roaming the data objects in the three-dimensional scene information based on the roaming path; The method further comprises: Obtain the user's location information and shopping needs; Displaying a plurality of scene description information located around the user and meeting the shopping needs according to the location information, wherein each scene description information corresponds to a three-dimensional scene information; The target description information is determined from the plurality of scene description information, and a target three-dimensional scene corresponding to the target description information is displayed.
2. The method according to claim 1, characterized in that Get 3D scene information, including: Obtain 3D point cloud data and 3D panoramic images; Establishing a three-dimensional model based on the three-dimensional point cloud data; The three-dimensional panoramic image is mapped onto the three-dimensional model to obtain the three-dimensional scene information.
3. The method according to claim 2, characterized in that After acquiring the three-dimensional scene information, the method further includes: Identifying a data object in the three-dimensional scene information and data ID information corresponding to the data object; Object description information corresponding to the data object is determined based on the data ID information.
4. The method according to claim 1, characterized in that Before determining at least one navigation path based on the data object, the method further comprises: Get the execution operation of user input; Determine a display mode of the three-dimensional scene information according to the execution operation, wherein the display mode includes at least one of the following: a roaming mode for automatically roaming data objects in the three-dimensional scene information, and a free mode for manually roaming data objects in the three-dimensional scene information.
5. The method according to claim 4, characterized in that Determining at least one navigation path based on the data object includes: When the display mode of the three-dimensional scene information is a roaming mode, obtaining object category information of the data object; At least one navigation path is determined according to the object category information.
6. The method according to claim 5, characterized in that The method further comprises: Acquire a first time axis corresponding to the roaming mode; The first time axis is displayed in a first preset manner.
7. The method according to claim 5, characterized in that When there are multiple pieces of object category information, obtaining the object category information of the data object includes: Acquire an execution operation input by a user for the object category information; At least one target object category is determined from a plurality of object category information according to the execution operation.
8. The method according to claim 4, characterized in that Determining at least one navigation path based on the data object includes: When the display mode of the three-dimensional scene information is a free mode, obtaining at least one roaming position information input by the user for the data object; At least one roaming path is determined according to the roaming location information.
9. The method according to claim 8, characterized in that The method further comprises: Acquire a second timeline corresponding to the free mode; The second time axis is displayed in a second preset manner.
10. The method according to claim 4, characterized in that The method further comprises: Acquire a switching operation input by a user for the display mode; The display mode of the current three-dimensional scene information is changed according to the switching operation.
11. The method according to claim 5, characterized in that Switching and roaming the data objects in the three-dimensional scene information based on the roaming path includes: The data objects in the three-dimensional scene information are automatically switched and wandered according to the wandering path to display all the data objects included in the three-dimensional scene information.
12. The method according to any one of claims 1 to 11, characterized in that: The method further comprises: Acquiring a switching instruction input by a user for the roaming path; The current roaming path is changed according to the switching instruction.
13. The method according to any one of claims 1 to 11, characterized in that: The method further comprises: Obtaining marketing information corresponding to the data subject; The marketing information is displayed in the three-dimensional scene information.
14. The method according to any one of claims 1 to 11, characterized in that: When switching and roaming the data objects in the three-dimensional scene information based on the roaming path, the method further includes: Obtaining an execution operation input by a user for the data object; The wandering is stopped according to the execution operation, and the data object is processed accordingly.
15. The method according to any one of claims 1 to 11, characterized in that: Switching and roaming the data objects in the three-dimensional scene information based on the roaming path includes: determining a playback speed corresponding to the roaming path; The data objects in the three-dimensional scene information are switched and roamed according to the play speed and the roaming path.
16. The method according to claim 15, characterized in that Determining a playback speed corresponding to the navigation path includes: Acquire object category information of data objects located on the roaming path; A play speed corresponding to the roaming path is determined according to the object category information.
17. The method according to claim 15, characterized in that The method further comprises: Obtaining an adjustment instruction input by a user for the playback speed; The playback speed is adjusted according to the adjustment instruction.
18. A three-dimensional roaming method, characterized in that: include: Acquire three-dimensional scene information, wherein the three-dimensional scene information includes data objects of multiple categories; identifying at least one target category among the plurality of categories; determining at least one roaming path according to the target category; Automatically switching and roaming the data objects of the target category based on the roaming path; The method further comprises: Obtain the user's location information and shopping needs; Displaying a plurality of scene description information located around the user and meeting the shopping needs according to the location information, wherein each scene description information corresponds to a three-dimensional scene information; The target description information is determined from the plurality of scene description information, and a target three-dimensional scene corresponding to the target description information is displayed.
19. A three-dimensional roaming device, characterized in that: include: A first acquisition module, used to acquire three-dimensional scene information, wherein the three-dimensional scene information includes a plurality of data objects; A first determining module, configured to determine at least one roaming path based on the data object; A first processing module, configured to switch and navigate the data objects in the three-dimensional scene information based on the roaming path; The first processing module is further used to obtain the location information and shopping needs of the user; and display multiple scene description information located around the user and meeting the shopping needs according to the location information, wherein each scene description information corresponds to a three-dimensional scene information; The target description information is determined from the plurality of scene description information, and a target three-dimensional scene corresponding to the target description information is displayed.
20. An electronic device, characterized in that: include: A memory, a processor; wherein the memory is used to store one or more computer instructions, wherein when the one or more computer instructions are executed by the processor, the three-dimensional roaming method as described in any one of claims 1 to 17 is implemented.
21. A three-dimensional roaming device, characterized in that: include: A second acquisition module is used to acquire three-dimensional scene information, wherein the three-dimensional scene information includes data objects of multiple categories; A second determination module, used to determine at least one target category among multiple categories; The second determination module is further used to determine at least one roaming path according to the target category; A second processing module, configured to automatically switch and roam the data objects of the target category based on the roaming path; The second processing module is further used to obtain the location information and shopping needs of the user; and display multiple scene description information located around the user and meeting the shopping needs according to the location information, wherein each scene description information corresponds to a three-dimensional scene information; The target description information is determined from the plurality of scene description information, and a target three-dimensional scene corresponding to the target description information is displayed.
22. An electronic device, characterized in that: include: A memory, a processor; wherein the memory is used to store one or more computer instructions, wherein the one or more computer instructions, when executed by the processor, implement the three-dimensional roaming method as described in claim 18.
Citation Information
Patent Citations
Method for cooperation display of three-dimensional shopping platform and geographic positioning apparatus
CN103475995A
Novel query shopping system in combination with traditional panoramic realistic shopping mode and online shopping
CN104103001A
Three-dimensional roaming method and three-dimensional roaming device
CN106548516A
Method and apparatus for providing data object information
CN108734538A