Scene simulation method and system and readable storage medium
By generating virtual design masks in real spatial coordinates and fusing them with physical environment masks, the problem of unsatisfactory simulation application effects in the existing technology is solved, and a natural fusion of high-precision and low-cost virtual design and real environment is achieved.
Patent Information
- Application Number
- CN202510393351.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-03-31
- Publication Date
- 2025-07-18
AI Technical Summary
In the prior art, the application methods for product design and advertising design are not effective, there are color aberrations and limitations, and the online synthesis display cost is high, and the effect is not real.
By obtaining the design draft and environment depth map, anchoring the design elements generate virtual design masks in real spatial coordinates, combining the occlusion relationship decision tree with the entity environment mask to optimize edge accuracy and add transparency gradient transitions to generate simulation application effect templates.
It realizes correct processing of virtual and real occlusion, retains the natural integration of real scenes, improves recognition accuracy and flexibility, reduces costs, and adapts to a wide range of application scenarios.
Smart Images
Figure CN120337740A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of computer simulation, and particularly to a scene simulation method, system and readable storage medium. Background Art
[0002] The existing product design and advertising design simulation application methods are mainly based on design proofing display, online synthesis effect display, etc. Although they can achieve a certain degree of display of design application effects, their limitations and deficiencies are also very obvious.
[0003] Design proofing is simple and easy to implement, but there is a color difference in the actual presentation between digital printing and four-color printing effects, and it can only be used as a reference for one application effect, resulting in limitations such as small application scope.
[0004] Online synthesis effect display requires high modeling costs, equipment costs, and labor costs; moreover, the displayed design application pictures cannot be close to the real application environment, and the effects are not ideal. Summary of the Invention
[0005] In view of the deficiencies in the prior art, the present invention provides a scene simulation method, system and readable storage medium, which solve the problem that the existing product design and advertising design simulation application methods have unsatisfactory effects.
[0006] At least one embodiment of the present invention provides a scene simulation method, including:
[0007] Obtaining a design draft and an environmental depth map corresponding to a target scene;
[0008] Anchoring the design elements in the design draft to real space coordinates, and generating a virtual design mask corresponding to the design draft in the real space coordinates based on the transparency channel of the design elements;
[0009] Generating a geometric feature model corresponding to the target scene according to the environmental depth map, and using the geometric feature model as an entity environment mask;
[0010] Establishing an occlusion relationship decision tree based on the front-back relationship between the design draft and the target scene;
[0011] Combining the occlusion relationship decision tree, fusing the virtual design mask and the entity environment template to obtain a simulation application effect template of the target scene, and the simulation application effect template is used to characterize the presentation state of the design elements in the design draft of the target scene and the real environment.
[0012] The technical solutions publicly provided by the present invention have at least the following beneficial effects:
[0013] Through the fusion processing of the virtual design mask and the physical environment template, the correct processing rate of virtual-real occlusion can be achieved, and the original image is not permanently changed. That is, the real scene can be maximally retained, making the design draft and the application scene more natural, with better effects, stronger flexibility, and a wider application range.
[0014] In a scene simulation method provided in one embodiment of the present invention, combining the occlusion relationship decision tree to fuse the virtual design mask and the physical environment template to obtain a simulation application effect template of the target scene includes:
[0015] Optimizing the edge accuracy of the virtual design mask using a fractal subdivision algorithm;
[0016] Combining the occlusion relationship decision tree to fuse the physical environment template and the optimized virtual design mask;
[0017] Performing bilateral filtering on the occlusion boundary region between the fused virtual design mask and the physical environment template, and adding a transparency gradient transition band to obtain a simulation application effect template of the target scene.
[0018] The technical solution provided by the present invention at least has the following beneficial effects:
[0019] Through the processing of the edge accuracy of the virtual design mask using a fractal subdivision algorithm, the recognition accuracy of complex images can be improved, and the final simulation application effect can be enhanced. By performing bilateral filtering on the occlusion boundary and adding a transparency gradient transition band, the fusion effect of the virtual design mask and the physical environment mask at the occlusion boundary can be improved.
[0020] In a scene simulation method provided in one embodiment of the present invention, generating a geometric feature model corresponding to the target scene according to the environmental depth map and using the geometric feature model as a physical environment mask includes:
[0021] Combining the environmental depth map and the SLAM algorithm to generate three-dimensional point cloud data of the target scene;
[0022] Extracting the contour of the physical object in the target scene based on the three-dimensional point cloud data;
[0023] Constructing a geometric feature model corresponding to the target scene according to the contour of the physical object, and using the geometric feature model as the physical environment mask.
[0024] The technical solution provided by the present invention at least has the following beneficial effects:
[0025] Using the above method, the physical environment mask can be quickly constructed while ensuring the modeling accuracy, improving the work effect.
[0026] In a scene simulation method provided by one embodiment of the present invention, obtaining the environmental depth map of the target scene includes:
[0027] Receiving scan data, where the scan data is data obtained by performing an environmental scan on the target scene;
[0028] Generating the environmental depth map of the target scene according to the scan data.
[0029] In a scene simulation method provided by one embodiment of the present invention, it further includes:
[0030] Responding to preset input information sent by an input port to control the orientation or size of the design draft in the target scene, where the preset input information includes voice information, gesture information, or instruction information.
[0031] The technical solution provided by the present invention at least has the following beneficial effects:
[0032] By setting multiple different input methods to control the orientation or size of the design draft in the application scene, it is convenient for staff to perform operation adjustments.
[0033] In a scene simulation method provided by one embodiment of the present invention, the target scene is one or more of the following scenes:
[0034] In-vehicle human-computer interaction scene, autonomous driving scene, remote driving scene, vehicle-road collaborative interaction scene.
[0035] At least one embodiment of the present invention further provides a scene simulation system, including a scene simulation device, and the scene simulation device includes:
[0036] An input module for obtaining the design draft and the environmental depth map corresponding to the target scene;
[0037] A virtual design mask generation module for anchoring the design elements in the design draft to real space coordinates and generating a virtual design mask corresponding to the design draft in the real space coordinates based on the transparency channel of the design elements;
[0038] A physical environment mask generation module for generating a geometric feature model corresponding to the target scene according to the environmental depth map and using the geometric feature model as a physical environment mask;
[0039] An occlusion relationship decision module for establishing an occlusion relationship decision tree based on the front-back relationship between the design draft and the target scene;
[0040] A fusion module, in combination with the occlusion relationship decision tree, fuses the virtual design mask and the physical environment template to obtain a simulation application effect sample of the target scene, where the simulation application effect sample is used to characterize the presentation state of the design elements of the target scene in the design draft and the real environment.
[0041] In a scene simulation system provided by an embodiment of the present invention, the system further includes:
[0042] An orientation adjustment module, connected to the scene simulation device, for identifying preset input information and controlling the orientation or size of the design draft in the target scene, where the preset input information includes voice input, gesture input, or instruction input.
[0043] In a scene simulation system provided by an embodiment of the present invention, the system further includes:
[0044] An output module, communicatively connected to the scene simulation device, for converting the design simulation application effect sample into a flat image file format or an AR three-dimensional file format for output.
[0045] The technical solution provided by the present invention at least has the following beneficial effects:
[0046] The flat image file format and the AR three-dimensional file format converted by the output module can also meet different display requirements, which is more convenient and faster.
[0047] The present invention also provides a computer-readable storage medium, in which instructions are stored. When the instructions are run on a terminal device, the terminal device is caused to execute the steps of a scene simulation method as described above.
[0048] The present invention also provides an electronic device, including a memory, a processor, and a program stored on the memory and running on the processor. When the processor executes the program, the steps of a scene simulation method as described above are implemented. Description of the Drawings
[0049] Figure 1 It is a flowchart of a scene simulation method according to the present invention;
[0050] Figure 2 It is a schematic diagram of the overall steps of a scene simulation method according to the present invention;
[0051] Figure 3 It is a schematic diagram of the structure of a scene simulation system according to the present invention;
[0052] Figure 4This is a schematic structural diagram of a scene simulation device according to the present invention;
[0053] Figure 5 This is a schematic structural diagram of an electronic device provided by the present invention.
[0054] In the accompanying drawings, the list of components represented by each reference numeral is as follows:
[0055] 100, scene simulation system; 200, scene simulation device; 300, azimuth adjustment module; 400, output module;
[0056] 201, input module; 202, virtual design mask generation module; 203, physical environment mask generation module; 204, occlusion relationship decision module; 205, fusion module;
[0057] 10, electronic device; 11, processor; 12, read-only memory (ROM); 13, random access memory (RAM); 14, bus; 15, input / output (I / O) interface; 16, input unit; 17, output unit; 18, storage unit; 19, communication unit. Detailed implementation manners
[0058] The principles and features of the embodiments of the present disclosure are described below. The examples given are only used to explain the embodiments of the present disclosure and are not intended to limit the scope of the embodiments of the present disclosure.
[0059] The present disclosure provides a scene simulation method. Please refer to Figure 1 as shown, including:
[0060] S1. Obtain a design draft and an environmental depth map corresponding to the target scene;
[0061] S2. Anchor the design elements in the design draft to real space coordinates, and generate a virtual design mask corresponding to the design draft in the real space coordinates based on the transparency channel of the design elements;
[0062] S3. Generate a geometric feature model corresponding to the target scene according to the environmental depth map, and use the geometric feature model as a physical environment mask;
[0063] S4. Establish an occlusion relationship decision tree based on the front-back relationship between the design draft and the target scene;
[0064] S5. Combine the occlusion relationship decision tree, and fuse the virtual design mask and the physical environment template to obtain a simulation application effect template of the target scene. The simulation application effect template is used to represent the presentation state of the design elements in the design draft of the target scene and the real environment.
[0065] Through the fusion processing of the virtual design mask and the physical environment template, the correct processing rate of virtual-real occlusion can be achieved, and the original image is not permanently changed. That is, the real scene can be maximally retained, making the design draft and the application scenario more natural, with better effects, stronger flexibility, and a wider application range.
[0066] In a more specific embodiment provided by the present disclosure, please refer here Figure 2 as shown, including:
[0067] S1. Obtain the design draft and the environmental depth map corresponding to the target scene, where the target scene is one or more of in-vehicle human-computer interaction scenarios, autonomous driving scenarios, remote driving scenarios, and vehicle-road collaborative interaction scenarios. Specifically, it includes steps S1.1, S1.2, S1.3, and S1.4, where
[0068] S1.1: The user uploads the design draft corresponding to the target scene that needs to be actually applied, and the system automatically records and uploads it to the cloud.
[0069] S1.2: The AI analysis system identifies the color and material (such as metal, acrylic, etc.) of the already rendered design draft (such as billboards, product designs, etc.) and performs further effect processing to improve the accuracy of subsequent applications.
[0070] S1.3: The millimeter-wave radar automatically measures the physical space, and the user can directly scan the environment with a mobile phone to identify the physical plane (wall / tabletop / screen), thereby obtaining corresponding scan data such as dimensions and lighting, and confirming and uploading the scan data.
[0071] Or, use a camera to take a 360° photo of the object to be applied and upload the scan data.
[0072] S1.4: Generate the environmental depth map of the target scene according to the scan data.
[0073] The specific steps of obtaining the environmental depth map can be:
[0074] First: Monocular depth estimation:
[0075] Preprocess the scan data (normalize, de-distort), then use the input model to generate the depth map, and then perform post-processing (such as filtering, edge enhancement).
[0076] Or, second: SLAM (real-time dynamic scene)
[0077] Real-time track the camera pose (visual + IMU data), construct a sparse / semi-dense map, and generate the depth map through multi-frame information interpolation.
[0078] Or, third: Hardware-assisted solution:
[0079] ToF (Time-of-Flight): Directly measure depth through infrared light (such as the iPhone Pro series), and then calculate depth using binocular parallax.
[0080] S2. Through the augmented reality extension ability of ARCore, anchor the design elements in the design draft to the real space coordinates and automatically select the default application size. Based on the transparency channel of the design elements, generate an 8-bit virtual design mask corresponding to the design draft in the real space coordinates.
[0081] S3. Generate a geometric feature model corresponding to the target scene based on the environmental depth map, and use the geometric feature model as the physical environment mask. Specifically:
[0082] Combine the environmental depth map and the SLAM algorithm to generate the three-dimensional point cloud data of the target scene;
[0083] Extract the physical object contours of the target scene based on the three-dimensional point cloud data;
[0084] Construct a geometric feature model corresponding to the target scene according to the physical object contours, and use the geometric feature model as the physical environment mask.
[0085] S4. Based on the front-back relationship between the design draft and the target scene, establish an occlusion relationship decision tree. Among them, the thresholds in the occlusion relationship decision tree can be dynamically adjusted according to the reflectivity of the materials of the objects corresponding to the design elements in the design draft. For example, the threshold for metal materials is reduced by 30% transparency.
[0086] S5. Combine the occlusion relationship decision tree to fuse the virtual design mask and the physical environment template to obtain a simulated application effect sample of the target scene. The simulated application effect sample is used to characterize the presentation state of the design elements in the design draft of the target scene in the real environment.
[0087] In another embodiment provided by the present disclosure, the difference from the above embodiment is that it further includes step S5.1;
[0088] Step S5.1: Optimize the edge accuracy of the virtual design mask through a fracturing subdivision algorithm, thereby improving the recognition accuracy of complex images and improving the final simulated application effect.
[0089] More preferably, after optimizing the edge accuracy of the virtual design mask, in order to improve the fusion effect of the virtual design mask and the physical environment mask at the occlusion boundary, this embodiment further includes step S5.2;
[0090] Step S5.2: Perform bilateral filtering on the occluded boundary region between the virtual design mask and the physical environment template, and add a transparency gradient transition zone to obtain the final processed design simulation application effect template.
[0091] S6. Localize privacy processing to ensure the security of user location data. Finally, generate the application in real time through GPT-4 + Stable Diffusion, and at the same time, combined with LBS, the user can select the actual location to be generated.
[0092] S7. In response to the preset input information sent by the input port, control the orientation or size of the design draft in the target scene, where the preset input information includes voice information, gesture information, or instruction information. That is, the embodiments of the present disclosure process the final design simulation application effect template through multimodal fusion, and realize orientation-aware voice communication in the AR environment through the mobile phone microphone, such as gestures, voice, and input instructions. The pressure sensing application can switch the layer operation mode.
[0093] S8. Output the processed final design simulation application effect template in a planar or AR three-dimensional form.
[0094] The present disclosure also provides a scene simulation system 100, please refer to Figure 4 as shown, which includes a scene simulation device 200. The scene simulation device 200 includes:
[0095] An input module 201, which acquires the design draft and the environmental depth map corresponding to the target scene;
[0096] A virtual design mask generation module 202, which anchors the design elements in the design draft in the real space coordinates, and generates a virtual design mask corresponding to the design draft in the real space coordinates based on the transparency channel of the design elements;
[0097] A physical environment mask generation module 203, which generates a geometric feature model corresponding to the target scene according to the environmental depth map, and uses the geometric feature model as the physical environment mask;
[0098] An occlusion relationship decision module 204, which establishes an occlusion relationship decision tree based on the front-back relationship between the design draft and the target scene;
[0099] A fusion module 205, which combines the occlusion relationship decision tree, fuses the virtual design mask and the physical environment template, and obtains a simulation application effect template of the target scene. The simulation application effect template is used to characterize the presentation state of the design elements in the design draft of the target scene and the real environment.
[0100] Furthermore, please refer to Figure 3 as shown, this system also includes an orientation adjustment module 300;
[0101] The orientation adjustment module 300 is connected to the scene simulation device 200, and is used to identify preset input information and control the orientation or size of the design draft in the target scene. The preset input information includes voice input, gesture input or command input.
[0102] Specifically, the orientation adjustment module 300 includes:
[0103] 1. Hierarchical adjustment mechanism.
[0104] Global parameter control layer (voice-dominated). Local detail adjustment layer (gesture-dominated). Pressure sensing enhancement layer.
[0105] 2. Conflict resolution mechanism.
[0106] Priority weight assignment. Establish an operation rollback mechanism. Save the operation status of the last 1-10 times; when there is a multimodal instruction conflict, trigger a secondary confirmation dialog box.
[0107] 3. Pressure sensing application, pressing the screen hard can switch the layer operation mode.
[0108] By setting a variety of different input methods, the orientation or size of the design draft in the application scene can be controlled, which is convenient for the staff to perform operation adjustments.
[0109] Furthermore, the system further includes: an output module 400;
[0110] The output module 400 is communicatively connected to the scene simulation device 200, and is used to convert the design simulation application effect sample into a flat image file format or an AR three-dimensional file format for output. The output module 400 can also select the output file quality based on different display requirements. The larger the file, the higher the precision, which is better than the smaller file.
[0111] Furthermore, the scene simulation device 200 further includes:
[0112] The first optimization module optimizes the edge accuracy of the virtual design mask using a fractal subdivision algorithm;
[0113] And in combination with an occlusion relationship decision tree, the entity environment template and the optimized virtual design mask are fused;
[0114] Perform bilateral filtering on the occluded boundary region between the fused virtual design mask and the entity environment template, and add a transparency gradient transition band to obtain the simulation application effect sample of the target scene.
[0115] Furthermore, the entity environment mask generation module 203 specifically includes:
[0116] A point cloud data generation unit for generating three-dimensional point cloud data of a target scene by combining an environmental depth map and a SLAM algorithm;
[0117] A contour extraction unit for extracting the contour of an entity object in the target scene based on the three-dimensional point cloud data;
[0118] A geometric feature modeling unit for constructing a geometric feature model corresponding to the target scene according to the contour of the entity object and using the geometric feature model as an entity environment mask.
[0119] Furthermore, the scene simulation device 200 further includes:
[0120] An environmental depth map acquisition module that receives scan data, where the scan data is data obtained by performing an environmental scan on the target scene, and generates an environmental depth map of the target scene according to the scan data.
[0121] In summary, the present disclosure has the following beneficial effects:
[0122] 1. Strong environmental perception and fusion ability: Using a millimeter-wave radar to achieve millimeter-level spatial modeling (wall surface error < 0.5 mm), the two-way mask technology achieves a high correct processing rate of virtual-real occlusion without permanently changing the original image, maximizing the retention of the real scene and making the design draft and the background blend more naturally.
[0123] 2. High flexibility: It can meet the application requirements of design drafts in different venues and is convenient and fast.
[0124] 3. Strong authenticity: By combining with the real-time environment, the real application effect of the design draft is demonstrated.
[0125] 4. Low application cost: The full process cost is reduced from the design draft to the application, such as equipment, modeling, labor, proofing, etc.
[0126] It should be noted that in the present disclosure, all actions of obtaining signals, information, or data are carried out on the basis of strictly following the relevant data protection regulations and policies of the country where it is located and with the authorization of the corresponding device owner. The owners mainly include:
[0127] (1) Automobile manufacturers: As vehicle hardware and system developers, they control the vehicle's underlying hardware and software platforms and have management and control rights over the data generated by vehicle operation, such as driving and fault data.
[0128] (2) Component suppliers: Provide key components for automobiles and have certain ownership of the data collected and processed by the components for product optimization and after-sales, such as data generated by sensors and chips.
[0129] (3) Vehicle owner or user: The actual user of the vehicle, who has the right to decide on the usage method and scope of vehicle data. For example, whether to share data such as driving trajectories and driving habits, and has the need and right to protect the privacy of their own relevant data.
[0130] (4) Service provider: Provides services such as software and data analysis, and has the right to use and manage the acquired and processed data within the framework of the agreement, but the ownership usually belongs to other entities.
[0131] The present invention also provides a computer-readable storage medium, in which instructions are stored. When the instructions run on a terminal device, the terminal device is caused to execute the steps of a scenario simulation method as described above.
[0132] The present invention also provides an electronic device, including a memory, a processor, and a program stored on the memory and running on the processor. When the processor executes the program, it implements the steps of a scenario simulation method as described above.
[0133] Figure 5 The structural schematic diagram of an electronic device 10 that can be used to implement the embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processors, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the embodiments of the present disclosure described and / or required herein.
[0134] As Figure 5 shown, the electronic device 10 includes at least one processor 11, and a memory communicatively connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc. Among them, the memory stores a computer program executable by the at least one processor. The processor 11 can execute various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 into the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. The input / output (I / O) interface 15 is also connected to the bus 14.
[0135] Multiple components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disc, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.
[0136] The processor 11 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The processor 11 executes the various methods and processes described above, such as a scenario simulation method.
[0137] In some embodiments, a scenario simulation method can be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as the storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed onto the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the scenario simulation method described above can be executed. Alternatively, in other embodiments, the processor 11 can be configured to execute a scenario simulation method by any other suitable means (e.g., by means of firmware).
[0138] The various embodiments of the systems and technologies described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include: being implemented in one or more computer programs, which can be executed and / or interpreted on a programmable system including at least one programmable processor, the programmable processor can be a special or general-purpose programmable processor, can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit the data and instructions to the storage system, the at least one input device, and the at least one output device.
[0139] The computer program for implementing the method of the embodiments of the present disclosure can be written in any combination of one or more programming languages. These computer programs can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when executed by the processor, the computer programs cause the functions / operations specified in the flowchart and / or block diagram to be implemented. The computer programs can be executed entirely on the machine, partially on the machine, as a stand-alone software package partially on the machine and partially on a remote machine, or entirely on a remote machine or server.
[0140] In the context of the embodiments of the present disclosure, a computer-readable storage medium can be a tangible medium that can contain or store a computer program for use by or in connection with an instruction execution system, apparatus, or device. The computer-readable storage medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. Alternatively, the computer-readable storage medium can be a machine-readable signal medium. More specific examples of the machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0141] In order to provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or an LCD (liquid crystal display)); and a keyboard and a pointing device (e.g., a mouse or a trackball), by which the user can provide input to the electronic device. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and the input from the user can be received in any form (including acoustic input, speech input, or tactile input).
[0142] The systems and techniques described herein can be implemented in a computing system including backend components (e.g., as a data server), or a computing system including middleware components (e.g., an application server), or a computing system including frontend components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described herein), or a computing system including any combination of such backend components, middleware components, or frontend components. The components of the system can be interconnected with each other by digital data communication in any form or medium (e.g., a communication network). Examples of communication networks include: local area network (LAN), wide area network (WAN), blockchain network, and the Internet.
[0143] A computing system can include a client and a server. The client and the server are generally remote from each other and typically interact via a communication network. The client-server relationship is created by computer programs running on respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or a cloud host, which is a host product in the cloud computing service system and solves the defects of difficult management and weak business scalability existing in traditional physical hosts and VPS services.
[0144] In the embodiments of the present disclosure, unless otherwise clearly specified and limited, terms such as "install", "connect", "couple", "fix", etc. shall be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or integrated; it can be a mechanical connection or an electrical connection; it can be directly connected or indirectly connected through an intermediate medium, and it can be the communication inside two elements or the interaction relationship between two elements, unless otherwise clearly limited. For those of ordinary skill in the art, the specific meanings of the above terms in the embodiments of the present disclosure can be understood according to specific circumstances.
[0145] In the description of this specification, the descriptions referring to terms such as "one embodiment", "some embodiments", "example", "specific example", or "some examples", etc. mean that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present disclosure. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described can be combined in any one or more embodiments or examples in a suitable manner. In addition, without conflict, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of different embodiments or examples.
[0146] Although the embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and should not be construed as limiting the present invention. Those of ordinary skill in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present invention.
Claims
1. A scenario simulation method, characterized in that, Including: Obtain the design draft and the environmental depth map corresponding to the target scene; Anchor the design elements in the design draft in the real space coordinates, and generate a virtual design mask corresponding to the design draft in the real space coordinates based on the transparency channel of the design elements; Generate a geometric feature model corresponding to the target scene according to the environmental depth map, and use the geometric feature model as the entity environmental mask; Establish an occlusion relationship decision tree based on the front-back relationship between the design draft and the target scene; Combine the occlusion relationship decision tree, fuse the virtual design mask and the entity environmental template, and obtain a simulation application effect template of the target scene, where the simulation application effect template is used to characterize the presentation state of the design elements in the design draft of the target scene and the real environment.
2. The scenario simulation method according to claim 1, wherein The combining the occlusion relationship decision tree, fusing the virtual design mask and the entity environmental template, and obtaining the simulation application effect template of the target scene includes: Optimize the edge accuracy of the virtual design mask by using a fractal subdivision algorithm; Combine the occlusion relationship decision tree, and fuse the entity environmental template and the optimized virtual design mask; Perform bilateral filtering on the occluded boundary region between the fused virtual design mask and the entity environmental template, and add a transparency gradient transition band to obtain the simulation application effect template of the target scene.
3. The scenario simulation method according to claim 1, wherein The generating a geometric feature model corresponding to the target scene according to the environmental depth map, and using the geometric feature model as the entity environmental mask includes: Generate the three-dimensional point cloud data of the target scene by combining the environmental depth map and the SLAM algorithm; Extract the entity object contour of the target scene based on the three-dimensional point cloud data; Construct a geometric feature model corresponding to the target scene according to the entity object contour, and use the geometric feature model as the entity environmental mask.
4. A scenario simulation method according to claim 1, characterized in that Obtain the environmental depth map of the target scene, including: Receive scan data, where the scan data is data obtained by performing an environmental scan on the target scene; Generate the environmental depth map of the target scene according to the scan data.
5. A scenario simulation method according to claim 1, characterized in that Also including: Respond to the preset input information sent by the input port, and control the orientation or size of the design draft in the target scene, where the preset input information includes voice information, gesture information or instruction information.
6. A scene simulation method according to any one of claims 1 to 5, characterized in that The target scene is one or more of the following scenes: In-vehicle human-computer interaction scene, autonomous driving scene, remote driving scene, vehicle-road collaborative interaction scene.
7. A scenario simulation system, characterized in that, Including a scene simulation device, the scene simulation device includes: An input module, which obtains the design draft and the environmental depth map corresponding to the target scene; A virtual design mask generation module, which anchors the design elements in the design draft in the real space coordinates, and generates a virtual design mask corresponding to the design draft in the real space coordinates based on the transparency channel of the design elements; An entity environmental mask generation module, which generates a geometric feature model corresponding to the target scene according to the environmental depth map, and uses the geometric feature model as the entity environmental mask; Occlusion relationship decision module, based on the front-back relationship between the design draft and the target scene, establish an occlusion relationship decision tree; Fusion module, in combination with the occlusion relationship decision tree, fuse the virtual design mask and the physical environment template to obtain a simulated application effect sample of the target scene, and the simulated application effect sample is used to characterize the presentation state of the design elements of the target scene in the design draft and the real environment.
8. A scenario simulation system according to claim 7, characterized in that, The system further includes: Azimuth adjustment module, the azimuth adjustment module is connected to the scene simulation device, and is used to identify preset input information and control the azimuth or size of the design draft in the target scene, where the preset input information includes voice input, gesture input or command input.
9. A scenario simulation system according to claim 7, wherein The system further includes: Output module, the output module is communicatively connected to the scene simulation device, and is used to convert the design simulation application effect sample into a planar image file format or an AR three-dimensional file format for output.
10. A computer-readable storage medium, characterized in that, Instructions are stored in the computer-readable storage medium, and when the instructions are run on the terminal device, the terminal device is caused to execute the steps of a scene simulation method according to any one of claims 1 to 6.