Intelligent cabin scene arrangement simulation method and system based on virtual-real combination and application

Abstract

The invention belongs to the technical field of intelligent cabins, and provides an intelligent cabin scene arrangement simulation method and system based on virtuality and reality combination and application, and the method comprises the steps: building a physical layer which comprises a real vehicle body, parts of a cabin and an operation mechanism; establishing a signal conversion layer, wherein the signal conversion layer comprises a hardware-in-the-loop test cabinet; and a virtual feedback layer is established, the electric signal and the action signal output by the physical layer are converted into a dynamic visual effect signal, and a signal conversion layer receives the dynamic visual effect signal, completes analogue simulation of intelligent cabin scene arrangement and feeds back a virtual instruction. According to the invention, the physical simulation rack is combined with the virtual simulation technology, the convenience of a development carrier is solved, the computer simulation technology and the Ethernet communication technology are introduced, and a digital tool is introduced into the development and research process, so that the carrier development difficulty of the scene arrangement and research of the intelligent cabin of the automobile can be reduced, and the use convenience is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of intelligent cockpit, in particular to an intelligent cockpit scene arrangement simulation method and system based on virtual-real combination and application thereof. BACKGROUND

[0002] With the rapid development of automobile intelligence and networking technology, automobile cockpit technology is undergoing an unprecedented wave of revolution. As the core carrier of human-vehicle interaction, the user experience quality of intelligent cockpit has become a key factor in determining the market competitiveness of products. Under this background, cockpit development engineers are facing the dual challenges of how to accelerate the verification and integration of new technologies while ensuring quality.

[0003] Current automobile intelligent cockpit technology is showing a trend of diversification and integration. The new generation of cockpit systems integrates artificial intelligence, augmented reality, multi-modal interaction, scene perception and other cutting-edge technologies, forming a complex technology ecosystem. From the fusion of heads-up display (HUD) and augmented reality navigation (AR Navigation) to personalized cockpit environment adaptation based on biometric recognition, and the implementation of emotional human-computer interaction systems, these innovative technologies have greatly enriched the user travel experience, but also brought unprecedented verification complexity and integration difficulty. In the early stage of new technology application, the core contradictions faced by the development team are reflected in three aspects: the contradiction between the surge of verification needs and the limitation of resources, the contradiction between the speed of technology iteration and the development cycle, and the contradiction between user experience expectations and technology maturity. According to statistics, as of now, the intelligent cockpit failure rate has ranked first among new energy vehicle user complaints, exposing the weakness of traditional testing mode under agile development and complex systems. The root cause of these problems lies in the inherent limitations of traditional real vehicle verification methods, such as high cost, long cycle, limited scene coverage, etc., which are difficult to meet the requirements of rapid iteration and continuous optimization in the era of software-defined vehicles.

[0004] To solve the above problems, there are basically two routes for the development and research of cockpit function scenes at present. One is to modify the actual vehicle to develop and research cockpit scene arrangement; the other is to develop cockpit large screen content through computer pure virtual environment. However, it is difficult to modify the actual vehicle, the customization demand is huge, the cycle is too long, the development and research cycle is uncontrollable, and it is difficult to use more digital development tools; through computer pure virtual environment, the limitation is large, and the developer is difficult to immerse in it to evaluate the advantages and disadvantages of the scheme.

[0005] Therefore, relevant technical personnel continuously develop various automobile intelligent cockpit simulation methods. For example, a patent application file with publication number CN117826638A discloses an intelligent cockpit simulation system, a simulation experiment architecture, a method, and a storage medium. The simulation system includes a model generation module for simulating different electronic control unit models of different functional electronic control units of a vehicle corresponding to an intelligent cockpit; a first data processing module for generating first control instructions and first data through different electronic control unit models when the simulation system is used as an upper computer, and sending the first control instructions and the first data to the intelligent cockpit for response; and a second data processing module for receiving second control instructions and second data sent by the intelligent cockpit when the simulation system is used as a lower computer, and responding to the second control instructions and the second data through different electronic control unit models. This scheme can fully and realistically restore the scene function of the real vehicle intelligent cockpit, cover all scenes of the real vehicle intelligent cockpit, and improve the quality of the intelligent cockpit. However, this scheme realizes function simulation through a software model and does not depend on or only needs a small amount of entity hardware support. This pure virtual environment cannot accurately simulate the tactile feedback and mechanical resistance in human-computer interaction, the wear and aging effect of real components, the compatibility and reliability of physical interfaces, and the influence of environmental factors (temperature, vibration, etc.) on hardware performance.

[0006] For example, a patent application file with publication number CN118796681A discloses a vehicle scene arrangement simulation method and device, a storage medium, and electronic equipment. The method includes obtaining a scene arrangement file to be simulated and a scene execution condition; in response to the scene execution condition, triggering a preset scene engine to control a 3D model corresponding to a vehicle to be simulated to execute a scene corresponding to the scene arrangement file to be simulated; and triggering the scene engine to control the 3D model to switch to a perspective picture for browsing the result after the scene corresponding to the scene arrangement file to be simulated is executed. This method uses a 3D vehicle model to replace a real vehicle and simulate in cooperation with a scene engine, avoiding the waste of communication cost, time cost, and resource cost between a cloud and a vehicle in traditional scene arrangement simulation with a real vehicle, so that a scene developer can obtain scene execution experience feedback in the development stage and adjust scene arrangement logic in the development and test stage, thereby improving scene development quality and saving test cost. However, this method is based on pure virtual simulation and cooperates a 3D vehicle model with a scene engine to complete scene arrangement and testing in a digital environment, and cannot simulate physical effects such as mechanical wear and electromagnetic interference, lacking verification of real human-computer interaction experience. SUMMARY

[0007] In view of the above-mentioned shortcomings of the prior art, the present application provides a virtual-real combined intelligent cockpit scene arrangement simulation method, system and application, which combines virtual simulation technology with a physical simulation bench to solve the development carrier convenience while introducing computer simulation technology and Ethernet communication technology, thereby introducing digital tools into the development research process, reducing the carrier development difficulty of the intelligent cockpit scene arrangement research, and improving the use convenience.

[0008] To achieve the above object and related objects, the present application adopts the following technical solutions:

[0009] The present application provides a virtual-real combined intelligent cockpit scene arrangement simulation method in the first aspect, comprising the following steps:

[0010] A physical layer is established, which includes real vehicle body and cockpit components and operating mechanisms;

[0011] A signal conversion layer is established, which includes a hardware-in-the-loop test cabinet;

[0012] A virtual feedback layer is established to convert the electrical signals and action signals output by the physical layer into dynamic visual effect signals, the signal conversion layer receives the dynamic visual effect signals, completes the simulation of the intelligent cockpit scene arrangement, and feeds back virtual instructions.

[0013] Further, the physical layer includes front and rear seats, rearview mirrors, seat belt modules, steering wheels and combination switches, brake and accelerator pedals, MP5 hosts, central control large screens, and instrument screens.

[0014] Further, the hardware-in-the-loop test cabinet includes a simulation computer, an extended CAN, a LIN bus board card, an AD simulation board card, and a program-controlled power supply.

[0015] Further, the method further comprises: before outputting the electrical signals and action signals, detecting the power supply state and functional validity of the physical layer, the communication validity of the signal conversion layer, and verifying that the virtual feedback layer can synchronously feed back virtual instructions.

[0016] Further, the method further comprises: establishing a middleware layer, which converts the user instruction signals obtained by the physical layer into control signals of the physical layer, and realizes the signal interaction between the physical layer and the signal conversion layer through protocol encapsulation.

[0017] Further, the protocol defines the standard UDP communication format of the physical layer and the signal conversion layer, including protocol fixed identification, function instruction code and parameter value, to support discrete switch instruction and continuous adjustment signal control mode.

[0018] Further, the method further comprises: integrating an AI engine layer, which generalizes the arrangement scene, completes protocol optimization and scene statistical analysis through the AI engine layer.

[0019] The second aspect of the present application provides a virtual-real combined intelligent cockpit scene arrangement simulation system, comprising:

[0020] A first model construction module is configured to establish a physical layer, wherein the physical layer comprises real vehicle body and parts and operating mechanisms of the cockpit;

[0021] A second model construction module is configured to establish a signal conversion layer, wherein the signal conversion layer comprises a hardware-in-the-loop test cabinet;

[0022] A third model construction module is configured to establish a virtual feedback layer, wherein the virtual feedback layer is configured to convert the electrical signals and action signals output by the physical layer into dynamic visual effect signals, the signal conversion layer is configured to receive the dynamic visual effect signals, complete simulation of the intelligent cockpit scene arrangement, and feed back virtual instructions.

[0023] The third aspect of the present application provides a computer readable storage medium having computer readable instructions stored thereon, wherein the computer readable instructions, when executed by a processor of a computer, cause the computer to perform the intelligent cockpit scene arrangement simulation method based on virtual-real combination.

[0024] The fourth aspect of the present application provides a computer device, comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the intelligent cockpit scene arrangement simulation method based on virtual-real combination.

[0025] The beneficial technical effects of the present application are as follows:

[0026] The present application provides a very convenient and programmable development and verification platform for the pre-development and pre-research of various functional scenes of the current intelligent cockpit of the automobile, the effective verification of the newly added and expanded scene functions of the vehicle in the later stage before being pushed to the customer vehicle.

[0027] The method and the system suitable for the method have good transformability, low cost and agility, and can be replicated to serve the development.

[0028] The present application provides real physical feedback by using the physical components of the physical layer, realizes rapid scene switching by using the signal conversion layer and the virtual feedback layer, and improves the development efficiency and the use convenience of the intelligent cockpit while ensuring the reliability of the functions by means of the standardized protocol design and the virtual-real combined verification system.

[0029] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present application. BRIEF DESCRIPTION OF DRAWINGS

[0030] The accompanying drawings, which are incorporated herein and constitute part of the specification, illustrate embodiments consistent with the application and, together with the description, further serve to explain the principles of the application. It is to be understood that the drawings are only schematic, and that they do not necessarily represent a limiting case of the application. In the drawings:

[0031] Figure 1 A flow chart of the simulation method of the intelligent cockpit scene arrangement based on virtual-real combination of the application;

[0032] Figure 2 A simulation schematic diagram of the scene arrangement device suitable for the method of the application;

[0033] Figure 3 A system framework diagram of the simulation system of the intelligent cockpit scene arrangement based on virtual-real combination of the application;

[0034] Figure 4 A structural schematic diagram of a computer system of a computer device suitable for the embodiments of the application is shown. DETAILED DESCRIPTION

[0035] Unless otherwise defined, all technical and / or scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the application pertains. It will be apparent to those skilled in the art that certain features of the application (described in the context of separate embodiments) can be provided in a single embodiment and vice versa. Conversely, various features of the application (described in the context of a single embodiment) can be provided separately or in any suitable combination or in any suitable method. Certain features described in the context of various embodiments are not to be considered essential features of those embodiments, unless the embodiments are inoperative without those elements. The application is further defined by the following Examples. It should be noted that the particularised process conditions and results set forth in the Examples described herein are not to be construed as limiting the scope of the application, but merely as providing specific examples of the application. All equivalent changes and modifications in the spirit and scope of the application are included in the scope of the application.

[0036] First of all, it needs to be pointed out that the extended CAN is a communication data frame with 29-bit identifier. Compared with the 11-bit identifier of the standard CAN frame, its identifier space is expanded from 2048 to 537 million, which can support more complex network systems and more node addressing requirements.

[0037] LIN bus board card is a special communication interface integrated in test equipment or development tools, used to connect LIN bus network with host system, realize LIN protocol physical layer and data link layer functions, it is usually used as a component of hardware-in-the-loop test system or development platform.

[0038] AD analog board card is a hardware module designed based on analog-to-digital converter (ADC) chip, usually as a computer expansion card or embedded system component, it connects with host through specific bus interface (such as PCI, USB, PXI, etc.), realizes analog signal digitization acquisition.

[0039] Please refer to Figure 1 , the flow chart of the intelligent cockpit scene simulation method based on virtual and real combination of the present application is as follows:

[0040] Step S100, establish the physical layer, the physical layer includes real vehicle body and cockpit parts and operating mechanisms.

[0041] Specifically, please refer to Figure 2 , the physical layer of the present application is a cockpit-vehicle body bench, which carries vehicle body and cockpit core components, including front and rear seats, rearview mirror, seat belt module, steering wheel and combination switch, brake and accelerator pedal, MP5 host, central control large screen and instrument screen. The present application integrates real vehicle components such as seats, pedals and steering wheel, etc., to build a real physical environment close to mass production vehicles, providing real mechanical feedback and operation feel for function verification; and the electrical signals generated by the physical components, such as pedal travel voltage, steering wheel angle, etc., and the action signals generated by the physical components, such as pedal position signal, seat adjustment signal, etc., provide raw data input for the subsequent signal conversion layer, ensuring the authenticity of the simulation test data. At the same time, the physical layer of the present application supports developers to operate and evaluate the intelligent cockpit system in real driving posture.

[0042] Step S200, establish the signal conversion layer, the signal conversion layer includes hardware-in-the-loop test cabinet.

[0043] Specifically, please refer to Figure 2 , the hardware-in-the-loop test cabinet of the present application includes simulation computer, extended CAN, LIN bus board card, AD analog board card and program-controlled power supply. The simulation computer of the present application is used to run vehicle dynamics model and fault injection algorithm; the extended CAN, LIN bus board card is used to realize UDP-CAN protocol conversion and simulate bus load; the AD analog board card is used to collect pedal / steering wheel analog signal (0-5V) and convert it to 12bit digital quantity; the program-controlled power supply is used to simulate vehicle power supply working condition (such as 12V voltage fluctuation ±20%) and support instantaneous power failure test.

[0044] More specifically, the signal conversion layer composed of the AD simulation board card and the CAN / LIN bus board card of the application allows the test to be carried out in advance through virtual signals when the ECU hardware is not ready, so that the software development cycle is shortened. The single hardware-in-the-loop test cabinet of the application can replace 5-8 prototype vehicle road tests, greatly reducing the cost, and the hardware reuse rate of the AD board card is high. The UDP-CAN protocol conversion capability of the application supports heterogeneous network interaction testing of intelligent cockpit and chassis systems.

[0045] Step S300, a virtual feedback layer is established to convert the electrical signals and action signals output by the physical layer into dynamic visual effect signals, the signal conversion layer receives the dynamic visual effect signals, completes the simulation simulation of the intelligent cockpit scene arrangement, and feeds back virtual instructions.

[0046] Specifically, the application virtually simulates the dynamic visual effect of the cockpit system in the simulation computer (i.e. the virtual feedback layer). The signal source of the dynamic visual effect includes the electrical signals converted from the physical output of the brake pedal, accelerator pedal, combination switch, etc. in the cockpit-body part real object bench and the action signals of some actuator devices triggered. The virtual instructions of the application include visual rendering instructions, logic control instructions, and cross-collaboration instructions, etc. The virtual feedback layer can include display terminals such as display large screens, graphics processing units, video synthesizers, timing controllers, tactile feedback systems, acoustic feedback systems, scene arrangement engines, digital twin interfaces, bus gateways, and real-time control units, etc.

[0047] Specifically, before the output of the electrical signals and the action signals, the power supply state and the function validity of the physical layer, the communication validity of the signal conversion layer are detected respectively, and it is verified that the virtual feedback layer can synchronously feed back the virtual instructions. The application carries out three-level verification of the physical layer, the signal conversion layer and the virtual feedback layer, constructs a complete quality protection chain, prevents the failure of the whole simulation method caused by a single link, verifies the power supply state (such as 12V power supply fluctuation ±5%) and function validity (such as pedal stroke sensor calibration) of the physical layer, ensures that the collected signals truly reflect the real vehicle working condition, and avoids the GIGO problem; by synchronously checking the response of the virtual feedback layer, the end-to-end link delay from physical operation to visual feedback is confirmed, a complete closed loop of "operation-conversion-feedback" is formed, so as to ensure the reliability of the intelligent cockpit function.

[0048] More specifically, the application provides an actual application scenario of the intelligent cockpit scene arrangement simulation method based on virtual-real combination, including developing a scene of commanding the vehicle to open the sunroof through a voice instruction (the whole message information is identified as Protocol id), such as Figure 2As shown, before the implementation of the function, the developer ensures that the component controller and microphone on the cabin-body part physical bench are working properly, the controller is powered by the program-controlled power supply of the simulation cabinet, the physical switches such as brake pedal, accelerator pedal, steering wheel switch, combination switch, etc. in the bench are powered on and effective, and the CAN and LIN communication modules with bus can normally interact with the simulation board of the simulation cabinet; the display large screen showing the virtual cabin visual effect can dynamically display the vehicle state signals output by the simulation cabinet.

[0049] More specifically, the method of the application further comprises: establishing a middleware layer, which converts the user instruction signal obtained by the physical layer into a control signal of the physical layer, and realizes signal interaction between the physical layer and the signal conversion layer through protocol encapsulation. The application defines the standard UDP communication format of the physical layer and the signal conversion layer, including protocol fixed identifier, function instruction code and parameter value, to support discrete switch instruction and continuous adjustment signal control mode. In combination Figure 3 , the developer sits in the main driving position according to driving habits, issues a "open sunroof" voice instruction (cmd id) through a wake-up voice, the cabin controller drives the microphone to receive and process the voice instruction, the voice signal is converted through the cabin middleware (i.e. the middleware layer, which realizes the cooperative work between different system components through standardized interface and service abstraction), the voice semantic is recognized through algorithm at the chip level and is converted into a part interface for calling through the cabin middleware, the instruction information is transmitted to the simulation cabinet (payload) through the handshake protocol through Ethernet drive, the simulation cabinet issues a sunroof opening bus signal according to the opening sunroof function of the vehicle design, the signal drives the virtual cabin visual effect module (i.e. the virtual feedback layer) to execute the sunroof opening action, and the dynamic visual effect of the sunroof opening is played in real time on the display large screen, completing the full-link simulation of the entire sunroof opening function scene.

[0050] More specifically, the application defines the Ethernet UDP message protocol between the car machine and the simulation cabinet, as shown in the following table 1:

[0051] Table 1 Protocol

[0052]

[0053] More specifically, the application implants a middleware layer between the physical layer and the signal conversion layer, opens the solidified scene control channel, so that the instruction input and the instruction conversion into the interface service of each part are opened, and the interaction channel between the physical layer and the signal conversion layer is established through the handshake protocol established by the form of Ethernet; the virtual feedback layer can realize the demonstration and signal confirmation of various development scenes through its strong plasticity characteristics.

[0054] Specifically, the method of the application further comprises: an integrated AI engine layer, through which a generalization orchestration scenario is generated, protocol optimization is completed, and scenario statistical analysis is performed. The AI engine layer of the application refers to an artificial intelligence computing hub deployed in an intelligent cockpit system, which integrates large model technology, an agent engine, and data analysis capabilities. The generalization orchestration scenario is dynamically generated based on user behavior and environmental data to simulate a scenario. The protocol optimization continuously improves the performance and reliability of the communication protocol. The scenario statistical analysis deeply mines and visually presents the data set used for simulation. More specifically, the large model technology of the application supports flexible deployment of models on the vehicle side and the cloud side, integrates multi-dimensional input data such as voice and vision, and realizes low-latency response based on high-performance cockpit chips. The agent engine automatically decomposes complex operation processes, dynamically combines atomized services, and continuously improves the control strategy based on reinforcement learning.

[0055] Specifically, the method of the application combines physical simulation benches with virtual simulation technology to solve the convenience of the development carrier. At the same time, computer simulation technology and Ethernet communication technology are introduced, and digital tools are introduced into the development and research process, which can reduce the difficulty of carrier development for automotive intelligent cockpit scenario orchestration research and improve the convenience of use.

[0056] Referring to Figure 4 The framework diagram of the intelligent cockpit scenario orchestration simulation system 300 based on virtual-real combination of the application comprises:

[0057] The first model construction module 310 is configured to establish a physical layer, and the physical layer includes real vehicle bodies and parts and operating mechanisms of the cockpit.

[0058] The second model construction module 320 is configured to establish a signal conversion layer, and the signal conversion layer includes a hardware-in-the-loop test cabinet.

[0059] The third model construction module 330 is configured to establish a virtual feedback layer, which converts the electrical signals and action signals output by the physical layer into dynamic visual effect signals. The signal conversion layer receives the dynamic visual effect signals, completes the simulation and simulation of the intelligent cockpit scenario orchestration, and feeds back virtual instructions.

[0060] It should be noted that the intelligent cockpit scenario orchestration simulation system based on virtual-real combination provided in the above embodiments and the intelligent cockpit scenario orchestration simulation method based on virtual-real combination provided in the above embodiments belong to the same concept, and the specific manner in which each module and unit performs operations has been described in detail in the method embodiments, which will not be described here. The intelligent cockpit scenario orchestration simulation system based on virtual-real combination provided in the above embodiments can allocate the above functions to different functional modules according to the actual application, that is, the internal structure of the system is divided into different functional modules to complete all or part of the functions described above, and this is not limited herein.

[0061] Embodiments of the present application also provide a computer device, comprising: one or more processors; a storage device for storing one or more programs, which, when executed by the one or more processors, cause the computer device to implement the virtual-real combined based intelligent cockpit scene arrangement simulation method provided in each of the above embodiments.

[0062] Figure 4 The structural schematic diagram of a computer system of a computer device suitable for embodiments of the present application is shown. It should be noted that, Figure 4 The computer system 400 of the electronic device shown is only an example and should not impose any limitation on the functions and use range of embodiments of the present application.

[0063] As Figure 4 shown, the computer system 400 includes a central processing unit (CPU) 401, which can perform various appropriate actions and processes according to programs stored in a read-only memory (ROM) 402 or programs loaded from a storage portion 408 into a random access memory (RAM) 403, such as performing the methods described in the above embodiments. In the RAM 403, various programs and data required for system operation are also stored. The CPU 401, the ROM 402, and the RAM 403 are connected to each other through a bus 404. An input / output (I / O) interface 405 is also connected to the bus 404. The following components are connected to the I / O interface 405: an input portion 406 including a keyboard, a mouse, and the like; an output portion 407 including a display such as a cathode ray tube (CRT), a liquid crystal display (LCD), and the like, and a speaker, and the like; a storage portion 408 including a hard disk, and the like; and a communication portion 409 including a network interface card such as a LAN (local area network) card, a modem, and the like. The communication portion 409 performs communication processing via a network such as the Internet. A drive 410 is also connected to the I / O interface 405 as necessary. A removable media 411 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, and the like is mounted on the drive 410 as necessary, so that a computer program read therefrom is installed in the storage portion 408 as necessary.

[0064] In particular, according to embodiments of the present application, the processes described above with reference to the flowcharts can be implemented as a computer tool program. For example, embodiments of the present application include a computer program product comprising a computer program carried on a computer readable medium, which computer program contains a computer program for executing the method shown in the flowchart. In such embodiments, the computer program can be downloaded and installed from a network via the communication portion 409, and / or installed from the removable media 411. When the computer program is executed by the central processing unit (CPU) 401, various functions defined in the system of the present application are performed.

[0065] Note that the computer readable medium in the embodiments of the present application can be a computer readable signal medium or a computer readable storage medium or any combination thereof. The computer readable storage medium may, for example, be an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any suitable combination thereof. More specific examples of the computer readable storage medium can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory, a read-only memory, an erasable programmable read-only memory, a flash memory, an optical fiber, a portable compact disc read-only memory, an optical storage device, a magnetic storage device, or any suitable combination thereof. In this application, the computer readable signal medium can include a data signal propagated in a baseband or propagated as a carrier wave in a propagated data signal, in which the computer readable computer program is carried. Such a propagated data signal can take on many forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination thereof. The computer readable signal medium can also be any computer readable medium other than the computer readable storage medium, which can send, propagate, or transmit the program for use by or in connection with an instruction execution system, apparatus, or device. The computer program contained in the computer readable medium can be transmitted by any suitable medium, including but not limited to wireless, wired, or the like, or any suitable combination thereof.

[0066] The flowcharts and block diagrams in the drawings illustrate the possible implementation architectures, functions, and operations of the systems, methods, and computer program products according to various embodiments of the present application. In the flowcharts or block diagrams, each block can represent a module, a program segment, or a part of code, which contains one or more executable instructions for implementing the specified logical functions. It should also be noted that in some alternative implementations, the functions noted in the blocks can occur in different orders from those shown in the drawings. For example, two blocks that are shown in succession can actually be executed substantially in parallel, and they can also be executed in reverse order, depending on the functions involved. It should also be noted that each block in the flowcharts or block diagrams, and the combination of blocks in the flowcharts or block diagrams, can be implemented by a dedicated hardware-based system that performs the specified functions or operations, or can be implemented by a combination of dedicated hardware and computer instructions.

[0067] The units described in the embodiments of the present application can be implemented in the form of tools, or can be implemented in the form of hardware, and the described units can also be arranged in a processor. In some cases, the names of these units do not constitute a limitation on the units themselves.

[0068] Another aspect of the present application also provides a computer readable storage medium, which stores a computer program. The computer program is executed by a processor of a computer, so that the computer executes the simulation method of scene arrangement of intelligent cockpit based on virtual-real combination as described above. The computer readable storage medium can be included in the computer device described in the above embodiments, or can exist separately without being assembled into the computer device.

[0069] Another aspect of the present application also provides a computer program product or computer program, which includes computer instructions stored in a computer readable storage medium. A processor of a computer device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions, so that the computer device executes the simulation method of scene arrangement of intelligent cockpit based on virtual-real combination provided in each of the above embodiments.

[0070] The above embodiments only illustrate the principles and effects of the present application, but are not used to limit the present application. Any person skilled in the art can modify or change the above embodiments without departing from the spirit and scope of the present application. Therefore, all equivalent modifications or changes made by those skilled in the art without departing from the spirit and technical ideas disclosed by the present application should be covered by the claims of the present application.

Claims

1. A method for simulating and orchestrating intelligent cockpit scenes based on a combination of virtual and real elements, characterized in that, Includes the following steps: Establish a physical layer, which includes the components and operating mechanisms of the actual vehicle body and cockpit; Establish a signal conversion layer, which includes a hardware-in-the-loop test cabinet; A virtual feedback layer is established to convert the electrical and motion signals output by the physical layer into dynamic visual effects signals. The signal conversion layer receives the dynamic visual effects signals, completes the simulation of the intelligent cockpit scene arrangement, and feeds back virtual commands.

2. The method according to claim 1, characterized in that, The physical layer includes front and rear seats, rearview mirrors, seat belt modules, steering wheel and combination switches, brake and accelerator pedals, MP5 host, central control screen and instrument panel screen.

3. The method according to claim 2, characterized in that, The hardware-in-the-loop test cabinet includes a simulation computer, extended CAN and LIN bus boards, AD analog boards, and a programmable power supply.

4. The method according to claim 3, characterized in that, The method further includes: before outputting the electrical signal and the action signal, detecting the power supply status and functional validity of the physical layer, the communication validity of the signal conversion layer, and verifying that the virtual feedback layer can synchronously feed back the virtual command.

5. The method according to claim 4, characterized in that, The method further includes: establishing a middleware layer, which converts the user instruction signals acquired by the physical layer into control signals of the physical layer, and realizes signal interaction between the physical layer and the signal conversion layer through protocol encapsulation.

6. The method according to claim 5, characterized in that, The protocol defines a standard UDP communication format for the physical layer and the signal conversion layer, including a fixed protocol identifier, function instruction code, and parameter values ​​to support discrete switching instructions and continuous adjustment signal control modes.

7. The method according to claim 6, characterized in that, The method also includes: integrating an AI engine layer, through which generalized orchestration scenarios, protocol optimization, and scenario statistical analysis are performed.

8. A virtual-real integrated intelligent cockpit scene arrangement simulation system, characterized in that, include: The first model construction module is used to establish the physical layer, which includes the components and operating mechanisms of the real vehicle body and cockpit. The second model building module is used to establish a signal conversion layer, which includes a hardware-in-the-loop test cabinet. The third model construction module is used to establish a virtual feedback layer, which converts the electrical and motion signals output by the physical layer into dynamic visual effects signals. The signal conversion layer receives the dynamic visual effects signals, completes the simulation of the intelligent cockpit scene arrangement, and feeds back virtual commands.

9. A computer-readable storage medium, characterized in that, It stores computer-readable instructions, which, when executed by the computer's processor, cause the computer to perform the intelligent cockpit scene arrangement simulation method based on virtual-real combination as described in any one of claims 1 to 7.

10. A computer device, comprising: A memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, when the processor executes the computer program, it implements the steps of the intelligent cockpit scene arrangement simulation method based on virtual-real combination as described in any one of claims 1 to 7.

Images