Intelligent digital twinning control method and system for vehicle and residence

Abstract

The method comprises the steps that a high-precision digital model is preset according to a physical entity of vehicle-mounted information equipment carrying a communication protocol, and a user activates the vehicle-mounted information equipment and is automatically connected with a vehicle-mounted information digital twinning cloud platform in a non-inductive mode; a space environment digital model is generated according to the physical environment and the high-precision digital model, corresponding behavior data is matched to generate a digital twin model, user operation data is uploaded to the vehicle-mounted digital twin cloud platform and converted into an instruction to be sent to the vehicle-mounted equipment, and the vehicle-mounted equipment receives the instruction and completes equipment operation; and the equipment operation data is returned to the vehicle-mounted digital twin cloud platform, and the vehicle-mounted digital twin cloud platform recommends use suggestions according to the user operation data. According to the method, the digital twinborn model of the vehicle-mounted residential space environment with a high reduction degree can be automatically generated, so that a user can efficiently and intuitively check and control the vehicle-mounted residential equipment as in an actual physical space when using the vehicle-mounted Internet of Things equipment, and intelligent suggestion is further realized.

Description

Technical Field

[0001] The present invention relates to the field of automobile Internet of Things intelligent control technology, and specifically to an intelligent car-home digital twin control method and system thereof. Background Art

[0002] Digital twin refers to the simulation process of reflecting physical entities, processes or systems through digital models. Digital twin models can simulate, predict and optimize the behavior of physical entities. At present, digital twin technology is mostly used in the industrial field, which can optimize production line efficiency, improve equipment maintenance plans and improve product quality. With the development of technology and the integration of industries, digital twin technology has gradually entered the fields of urban planning, construction, medical care and home life. Car-living refers to a kind of living or living style in a vehicle, which is the basis of the third space in the vehicle. Therefore, the application of digital twin technology to car-living equipment has gradually received widespread attention. Car users can intuitively view, monitor and control the corresponding car-living equipment through digital twin models to realize the intelligent third space in the vehicle.

[0003] In the prior art, the types of devices covered by the in-vehicle Internet of Things are relatively small, and the interfaces of the current in-vehicle Internet of Things devices mostly adopt the traditional user interface design, that is, describing the product status through text and controls. This results in the traditional in-vehicle Internet of Things devices often having a relatively low level of intelligence, and users cannot find the required products or monitor product changes as intuitively and efficiently as in the real physical space.

[0004] Therefore, how to automatically generate a digital twin model of the vehicle-living space environment with a high degree of restoration, so that car users can use the on-board IoT devices as if they were in the actual physical space, and then efficiently and intuitively view and control the corresponding vehicle-living devices, and realize intelligent service suggestions and recommendations through big data algorithms, has become a problem that needs to be solved urgently. Summary of the invention

[0005] In order to solve the above problems, the present invention proposes an intelligent vehicle-home digital twin control method and system, which can realize intuitive and efficient vehicle-home equipment interconnection, automatically generate a digital twin model of the vehicle-home space environment with a high degree of restoration, and allow car users to efficiently and intuitively view and control the corresponding vehicle-home equipment. At the same time, through big data algorithms, intelligent service suggestions and recommendations are realized, bringing convenient and personalized vehicle-home experience to car users, and through real-time vehicle-home environment monitoring and remote control functions, the intelligence level of the car and the user experience are improved.

[0006] In order to achieve the above object, the present invention is implemented by the following technical solutions:

[0007] A smart car-home digital twin control method of the present invention includes:

[0008] After the vehicle-housing device is equipped with the communication protocol, a high-precision digital model is preset according to the physical entity of the vehicle-housing device and stored in the vehicle-housing digital twin cloud platform;

[0009] The user activates the vehicle-home device, and the vehicle-home device is automatically connected to the vehicle-home digital twin cloud platform without any sense;

[0010] Generate a spatial environment digital model according to the physical environment of the vehicle-dwelling device and the corresponding high-precision digital model, match the spatial environment digital model and the behavior data of the vehicle-dwelling device through the communication protocol, generate a digital twin model and store it in the vehicle-dwelling digital twin cloud platform;

[0011] The digital twin model is displayed to the user through the vehicle-machine interface, the user operation data of the vehicle-machine interface is uploaded to the vehicle-residence digital twin cloud platform, the user operation data is converted into instructions through the communication protocol, and the instructions are sent to the vehicle-residence device;

[0012] The vehicle-housing device receives the instruction and completes the corresponding device operation, and returns the device operation data to the vehicle-housing digital twin cloud platform and displays it synchronously on the vehicle-machine interface;

[0013] The car-home digital twin cloud platform recommends corresponding usage suggestions based on the user operation data.

[0014] A further improvement of the present invention is that the equipment models of the vehicle-housing equipment are the same, the corresponding high-precision digital models are the same, and the corresponding high-precision digital model codes are the same.

[0015] A further improvement of the present invention is that the physical environment is obtained by scanning the surrounding space environment of the vehicle-residence device through cameras inside and outside the vehicle, and the physical environment is uploaded to the vehicle-residence digital twin cloud platform.

[0016] A further improvement of the present invention is that the communication protocol sends the field information of the vehicle-house device to the vehicle-house digital twin cloud platform, and the vehicle-house digital twin cloud platform automatically matches the high-precision digital model corresponding to the vehicle-house device according to the field information.

[0017] A further improvement of the present invention is that: the digital model of the space environment is generated according to the physical environment of the vehicle-dwelling device and the corresponding high-precision digital model, the digital model of the space environment is matched with the behavior data of the vehicle-dwelling device through the communication protocol, and a digital twin model is generated and stored in the vehicle-dwelling digital twin cloud platform, specifically including:

[0018] Obtaining spatial environment data of the vehicle-dwelling device according to the physical environment of the vehicle-dwelling device and the corresponding high-precision digital model;

[0019] Based on the radial basis function, an interpolation surface at each data point in the spatial environment data is determined:

[0020]

[0021] Where s(x) represents the value of the interpolation surface at the current data point x; n represents the number of adjacent data points of the current data point; δ represents the three-dimensional interpolation coefficient; φ represents the radial basis function; x represents the current data point; x j Represents the jth adjacent data point of the current data point; ||xx j || represents the distance between the current data point and the jth adjacent data point; p(x) represents the interpolation stability coefficient at the current data point x; Σ represents the summation symbol;

[0022] Determine the interpolation surfaces at all data points in the spatial environment data, and construct a digital model of the spatial environment of the vehicle-dwelling equipment;

[0023] After obtaining the digital model of the space environment, the digital model of the space environment is optimized by adjusting the position of each data point based on a network optimization algorithm to generate a plurality of optimized data points, wherein the expression of the optimized data point is:

[0024]

[0025] In the formula, x' represents the optimized data point; x represents the current data point; α represents the smoothing strength coefficient; n represents the number of adjacent data points of the current data point; x j represents the jth adjacent data point of the current data point; Σ represents the summation symbol;

[0026] Optimizing the digital model of the space environment accordingly based on the optimized data points;

[0027] The digital model of the spatial environment and the behavioral data of the vehicle-residence equipment are matched through the communication protocol to generate a digital twin model and store it in the vehicle-residence digital twin cloud platform.

[0028] A further improvement of the present invention is that the vehicle-machine interface is a three-dimensional visual user interface, and the user can view the use status of the vehicle-dwelling equipment and automatically control the working status of the vehicle-dwelling equipment through the vehicle-machine interface.

[0029] A further improvement of the present invention is that the car-home digital twin cloud platform identifies and recommends usage suggestions for the car-home equipment based on the user operation data through a big data algorithm, and triggers an alarm device when an abnormality occurs in the car-home equipment, specifically including:

[0030] Performing a cleaning operation on the user operation data to remove noise and abnormal values ​​in the user operation data and generate target operation data;

[0031] Extracting operation features from the target operation data and constructing a usage suggestion recognition model;

[0032] Based on the usage suggestion identification model, identifying usage suggestions for the vehicle-housing device according to the operation characteristics:

[0033] y t =f(F t ,θ)

[0034] In the formula, y t represents the usage suggestion of the t-th identified vehicle-housing device; f represents the usage suggestion identification function; F t represents the tth operational feature; θ represents the model parameters identified using the proposal;

[0035] Determine a loss function corresponding to the usage suggestion recognition model, adjust the usage suggestion recognition model parameters based on an optimization algorithm, minimize the loss function, and determine the optimal usage suggestion recognition model parameters:

[0036]

[0037] In the formula, θ * Indicates the optimal usage recommendation recognition model parameters; arg min θ It represents the value of θ output when the expression takes the minimum value; N represents the total number of operation features; represents the standard usage recommendation label corresponding to the t-th operation feature; y t represents the usage suggestion of the t-th identified vehicle-housing equipment; L represents the loss function; Σ represents the summation symbol;

[0038] The use suggestions of the vehicle-dwelling equipment are identified and recommended according to the user operation data, and an alarm device is triggered when an abnormality occurs in the vehicle-dwelling equipment.

[0039] An intelligent car-home digital twin control system of the present invention comprises:

[0040] A data management and storage module is used to collect, manage and store the required digital twin data, and to store, index, back up and restore the digital twin data;

[0041] A model creation and update module is used to create and update a digital twin model based on the physical entity of the vehicle-housing equipment, and to perform parameter configuration, training and optimization on the digital twin model;

[0042] A data analysis and optimization module is used to analyze and optimize the digital twin data, analyze the digital twin data through machine learning algorithms and optimization algorithms, identify potential problems and provide decision-making suggestions for users;

[0043] An identity security verification module is used to protect the security of the car-home digital twin platform, verify user identity and control access, and perform data encryption and security audit on the digital twin data;

[0044] Integration module, which is used to provide integration interface with external systems and applications, and to exchange and share data with other systems.

[0045] A further improvement of the present invention is that the system also includes a vehicle-machine display module for three-dimensionally visualizing the digital twin model, vehicle-home equipment connections, digital twin data, and analysis and optimization results thereof.

[0046] The beneficial effects of the present invention are as follows: the present invention proposes an intelligent vehicle-residence digital twin control method and system thereof, after the vehicle-residence device is equipped with a communication protocol, a high-precision digital model is preset according to the physical entity of the vehicle-residence device and stored in the vehicle-residence digital twin cloud platform; the user activates the vehicle-residence device, and the vehicle-residence device and the vehicle-residence digital twin cloud platform are automatically connected without feeling; a spatial environment digital model is generated according to the physical environment of the vehicle-residence device and the corresponding high-precision digital model, and the spatial environment digital model and the behavior data of the vehicle-residence device are matched through the communication protocol to generate a digital twin model and store it in the vehicle-residence digital twin cloud platform; the user operation data of the user in the vehicle-machine interface is uploaded to the vehicle-residence digital twin cloud platform, and the user operation data is converted into instructions through the communication protocol, and the instructions are sent to the vehicle-residence device; the vehicle-residence device receives the instructions and completes the corresponding device operation, and returns the device operation data to the vehicle-residence digital twin cloud platform, and in the vehicle-machine interface The digital twin cloud platform for cars and homes recommends corresponding usage suggestions based on user operation data, thereby realizing intuitive and efficient car-home device interconnection, and using the three-dimensional space model screen as the user operation interface on the car system, which is intuitive, easy to operate, and more similar to people's feelings in the real physical space. It can automatically generate a digital twin model of the car-living space environment with a high degree of restoration, allowing car users to use the on-board Internet of Things devices as if they were in the actual physical space, and then efficiently and intuitively view and control the corresponding car-living devices, with lower requirements for overall computing power, and easier to implement in actual car-mounted scenarios, and realize intelligent service suggestions and recommendations through big data algorithms, creating an intelligent on-board third space, bringing convenient and personalized car-living experience to car users, and improving the level of car intelligence and user experience through real-time car-living environment monitoring and remote control functions. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1A schematic diagram of a flow chart of a smart car-home digital twin control method provided by an embodiment of the present invention;

[0048] Figure 2 A schematic diagram of the structure of a smart car-home digital twin control system provided by an embodiment of the present invention;

[0049] Figure 3 A schematic diagram of the hardware structure of an electronic device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0050] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0051] See also Figure 1 , is a flow chart of a smart car-home digital twin control method provided by an embodiment of the present invention, Figure 1 The execution subject of the method shown may be a software and / or hardware device. The execution subject of the present application may include but is not limited to at least one of the following: user equipment, network equipment, etc. Among them, the user equipment may include but is not limited to computers, smart phones, personal digital assistants (Personal Digital Assistant, referred to as: PDA) and the electronic devices mentioned above. The network equipment may include but is not limited to a single network server, a server group consisting of multiple network servers, or a cloud based on cloud computing consisting of a large number of computers or network servers, wherein cloud computing is a type of distributed computing, a super virtual computer composed of a group of loosely coupled computers. This embodiment does not limit this. It includes steps S1 to S6, as follows:

[0052] S1, after the vehicle-housing equipment is equipped with the communication protocol, a high-precision digital model is preset according to the physical entity of the vehicle-housing equipment and stored in the vehicle-housing digital twin cloud platform;

[0053] S2, the user activates the car-home device, and the car-home device is automatically connected to the car-home digital twin cloud platform without any sense;

[0054] S3, generating a digital model of the space environment according to the physical environment of the vehicle-housing equipment and the corresponding high-precision digital model, matching the digital model of the space environment and the behavior data of the vehicle-housing equipment through the communication protocol, generating a digital twin model and storing it in the vehicle-housing digital twin cloud platform;

[0055] S4, the digital twin model is displayed to the user through the vehicle-machine interface, the user operation data of the vehicle-machine interface is uploaded to the vehicle-home digital twin cloud platform, the user operation data is converted into instructions through the communication protocol, and the instructions are sent to the vehicle-home device;

[0056] S5, the vehicle-home device receives the instruction and completes the corresponding device operation, and returns the device operation data to the vehicle-home digital twin cloud platform and displays it synchronously on the vehicle-machine interface;

[0057] S6, the car-home digital twin cloud platform recommends corresponding usage suggestions based on user operation data.

[0058] It can be understood that the present invention provides an intelligent vehicle-home digital twin control method, which quickly creates a digital model of the physical entity of the equipment through a vehicle-mounted camera and a vehicle-home digital twin cloud platform, and at the same time collects the behavior data of the equipment through a self-developed communication protocol and injects it into the digital model to generate a digital twin model. Therefore, the corresponding vehicle-home equipment can be intuitively monitored and controlled through the vehicle-home digital twin cloud platform, which is more in line with the user's intuitive feeling in the real space.

[0059] It should be noted that users can freely choose devices that are equipped with specified communication protocols. A self-developed communication protocol refers to a protocol designed and developed by itself to realize communication between devices or systems. The self-developed communication protocol defines communication rules, data formats, transmission methods, and interaction processes, etc., to ensure effective exchange of information and mutual operation between different devices or systems. And the self-developed communication protocol has the advantages of customization, high optimization, security and flexibility. The present invention aims to propose a self-developed communication protocol with encrypted communication means and an identity authentication mechanism, which is used to realize mutual communication between devices in a safe and stable manner.

[0060] Among them, encrypted communication refers to the use of a secure encryption algorithm to protect the confidentiality of communication data. The secure encryption algorithm can be the Advanced Encryption Standard (AES), which can ensure that the data will not be read by unauthorized people or devices during transmission. Authentication refers to confirming the authorization authenticity of the device through an authentication mechanism in the communication protocol. The authentication can use digital certificates, keys or tokens, etc.

[0061] Among them, the equipment models of the vehicle-housing equipment are the same, the corresponding high-precision digital models are the same, and the corresponding high-precision digital model codes are the same.

[0062] In actual applications, after the car-home device is installed with the specified communication protocol, users can monitor and control the vehicle-mounted electrical equipment, such as refrigerators, TVs, washing machines, etc. in the RV without feeling. Since the car-home device is equipped with the specified communication protocol, when the car side opens the control permission and allows the control permission and transmission field information to be called through the specified communication protocol, these field information can be identity authentication information, device type information, security credentials, network parameters, control instructions, etc., so that the device control can be realized through the car-home digital twin cloud platform.

[0063] It should be noted that vehicle-housing devices equipped with specified communication protocols can be divided according to product models. The physical entities of these vehicle-housing devices will be scanned in advance before leaving the factory, and corresponding high-precision digital models will be generated in the modeling software based on these physical entities and stored synchronously in the vehicle-housing digital twin cloud platform. The high-precision digital models corresponding to vehicle-housing devices of the same device model are the same, and the corresponding high-precision digital model codes are the same.

[0064] The physical environment is obtained by scanning the surrounding space environment of the vehicle-housing device through the cameras inside and outside the vehicle, and then uploaded to the digital twin cloud platform of the vehicle-housing device. The communication protocol sends the field information of the vehicle-housing device to the digital twin cloud platform of the vehicle-housing device, and the digital twin cloud platform of the vehicle-housing device automatically matches the high-precision digital model corresponding to the vehicle-housing device according to the field information.

[0065] It is understandable that after the user activates the car-dwelling device equipped with the specified communication protocol, the car-dwelling device and the car-dwelling digital twin cloud platform can be connected automatically without feeling. The communication protocol can send the identity authentication information, device type information, security credentials, network parameters, control instructions and other field information corresponding to the car-dwelling device to the car-dwelling digital twin cloud platform. The car-dwelling digital twin cloud platform can automatically match the high-precision digital model corresponding to the car-dwelling device, and at the same time call the cameras inside and outside the car to scan the spatial environment where the car-dwelling device is located to generate the corresponding physical environment. Combined with the high-precision digital model, the corresponding spatial environment digital model is generated through an automated modeling program and stored in the car-dwelling digital twin cloud platform. Combined with the device behavior data in the car-dwelling digital twin cloud platform, and automatically matched through the communication protocol, the corresponding digital twin model can be generated. It should be noted that the device behavior data and the digital twin model are stored in the data management and storage module of the intelligent car-dwelling digital twin control system.

[0066] Among them, the digital model of the space environment is generated according to the physical environment of the vehicle-housing equipment and the corresponding high-precision digital model, and the behavior data of the digital model of the space environment and the vehicle-housing equipment are matched through the communication protocol to generate a digital twin model and store it in the vehicle-housing digital twin cloud platform, which specifically includes:

[0067] According to the physical environment of the vehicle-dwelling equipment and the corresponding high-precision digital model, the spatial environment data of the vehicle-dwelling equipment is obtained;

[0068] Based on the radial basis function, the interpolation surface at each data point in the spatial environment data is determined:

[0069]

[0070] Where s(x) represents the value of the interpolation surface at the current data point x; n represents the number of adjacent data points of the current data point; δ represents the three-dimensional interpolation coefficient; φ represents the radial basis function; x represents the current data point; x j Represents the jth adjacent data point of the current data point; ||xx j || represents the distance between the current data point and the jth adjacent data point; p(x) represents the interpolation stability coefficient at the current data point x; Σ represents the summation symbol;

[0071] Determine the interpolation surface at all data points in the spatial environment data and construct a digital model of the spatial environment of the vehicle-dwelling equipment;

[0072] After obtaining the digital model of the space environment, the digital model of the space environment is optimized by adjusting the position of each data point based on the network optimization algorithm to generate multiple optimized data points. The expression of the optimized data point is:

[0073]

[0074] In the formula, x' represents the optimized data point; x represents the current data point; α represents the smoothing strength coefficient; n represents the number of adjacent data points of the current data point; x j represents the jth adjacent data point of the current data point; Σ represents the summation symbol;

[0075] Optimize the digital model of the space environment accordingly based on the optimized data points;

[0076] By matching the digital model of the spatial environment and the behavioral data of vehicle-residence equipment through communication protocols, a digital twin model is generated and stored in the vehicle-residence digital twin cloud platform.

[0077] Among them, the car-machine interface is a three-dimensional visual user interface, through which users can view the usage status of the car-residence equipment and automatically control the working status of the car-residence equipment.

[0078] In actual applications, users can enter the digital twin cloud platform of Car and Home through the car interface, and view the use status and control status of the added equipment through the three-dimensional visual user interface, such as the opening, closing, and timing of the equipment; they can also set it through the automation program of the digital twin cloud platform of Car and Home, such as opening a certain device at a specified time and closing a certain device at the same time. All user operation data will be uploaded to the digital twin cloud platform of Car and Home, and converted into instructions that can be understood by the equipment through the specified communication protocol. The car and home equipment receives these instructions and completes the corresponding equipment operations.

[0079] Furthermore, the equipment operation data is displayed through the vehicle system or the user interface of the mobile terminal, and the user can intuitively complete the remote monitoring and control of the equipment through the three-dimensional user interface according to personal needs.

[0080] Among them, the car-home digital twin cloud platform uses big data algorithms to identify and recommend usage suggestions for car-home equipment based on user operation data, and triggers an alarm device when an abnormality occurs in the car-home equipment, specifically including:

[0081] Clean the user operation data to remove noise and outliers in the user operation data and generate target operation data;

[0082] Extract the operation features from the target operation data and build a usage suggestion recognition model;

[0083] Based on the usage suggestion recognition model, the usage suggestions of the vehicle and home equipment are identified according to the operation characteristics:

[0084] y t =f(F t ,θ)

[0085] In the formula, y t represents the usage suggestion of the t-th identified vehicle-housing device; f represents the usage suggestion identification function; F t represents the tth operational feature; θ represents the model parameters identified using the proposal;

[0086] Determine the loss function corresponding to the usage suggestion recognition model, adjust the usage suggestion recognition model parameters based on the optimization algorithm, minimize the loss function, and determine the optimal usage suggestion recognition model parameters:

[0087]

[0088] In the formula, θ * Indicates the optimal usage recommendation recognition model parameters; arg min θ It represents the value of θ output when the expression takes the minimum value; N represents the total number of operation features; represents the standard usage recommendation label corresponding to the t-th operation feature; y trepresents the usage suggestion of the t-th identified vehicle-housing equipment; L represents the loss function; Σ represents the summation symbol;

[0089] Identify and recommend usage suggestions for vehicle-housing equipment based on user operation data, and trigger an alarm device when an abnormality occurs in the vehicle-housing equipment.

[0090] It is understandable that based on the collected user operation data, including the user's device viewing and setting data on the vehicle interface, the car-home digital twin cloud platform can use big data algorithms to identify potential problems and provide users with targeted decision-making suggestions, such as providing intelligent car-home control suggestions; at the same time, the car-home digital twin cloud platform can also customize the setting of early warning values. When the car-home equipment has an abnormality or reaches the preset threshold, the system can trigger the alarm and notification function.

[0091] See also Figure 2 , is a structural diagram of a smart car-house digital twin control system provided by an embodiment of the present invention, and the smart car-house digital twin control system includes:

[0092] The data management and storage module is used to collect, manage and store the required digital twin data, and to store, index, back up and restore the digital twin data;

[0093] The model creation and update module is used to create and update the digital twin model based on the physical entity of the vehicle-housing equipment, and to configure, train and optimize the parameters of the digital twin model;

[0094] Data analysis and optimization module, which is used to analyze and optimize digital twin data. It analyzes digital twin data through machine learning algorithms and optimization algorithms, identifies potential problems, and provides decision-making suggestions for users.

[0095] Identity security verification module, used to protect the security of the car-home digital twin platform, verify user identity and control access, and perform data encryption and security audit on digital twin data;

[0096] Integration module, which is used to provide integration interface with external systems and applications, and to exchange and share data with other systems.

[0097] It is understandable that the smart car-home digital twin control system includes multiple modules, and each module has responsiveness. The data management and storage module is used to collect, manage and store the data required for the digital twin, which includes device information, device data, model data, etc. The module has functions such as data storage, data indexing, data backup and data recovery; the model creation and update module is used to create and update the digital twin model to reflect the physical system or equipment in the real world. The module has functions such as modeling tools, model parameter configuration, model training and optimization; the data analysis and optimization module is used to analyze and optimize the digital twin data, identify potential problems and provide decision-making suggestions for users, such as providing smart home control suggestions. The module has data analysis tools, machine learning algorithms, optimization algorithms and decision support tools; the identity security verification module is used to protect the security of the data and functions of the digital twin platform, and has functions such as user identity authentication, access control, data encryption, and security auditing; the integration module is used to provide an integrated interface with external systems and applications, and then exchange and share data with other systems. Multiple modules together form the smart car-home digital twin control system, which can realize device communication, automated creation and optimization of models, cloud storage and computing, data security and external interfaces.

[0098] Among them, the intelligent car-home digital twin control system of the present invention also includes a vehicle-machine display module, which is used to perform three-dimensional visual display of the digital twin model, car-home equipment connections, digital twin data and their analysis and optimization results.

[0099] In actual applications, compared with existing car-home interaction products, the present invention provides customized functions. Through self-built communication protocols and customized car-machine user interfaces, it can meet the needs of specific applications and achieve a wider range of device access. At the same time, it has high integration. Through self-built communication protocols, it can achieve deep integration and seamless communication with smart devices. Users can directly control and monitor devices on the car-machine system, providing a more convenient and integrated user experience.

[0100] Figure 2 The apparatus of the embodiment shown can be used to perform Figure 1 The implementation principles and technical effects of the steps in the method embodiment shown are similar and will not be repeated here.

[0101] See also Figure 3 , is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present invention, the electronic device 30 includes: a processor 31, a memory 32 and a computer program; wherein

[0102] The memory 32 is used to store the computer program, and the memory may also be a flash memory. The computer program is, for example, an application program, a functional module, etc. for implementing the above method.

[0103] The processor 31 is used to execute the computer program stored in the memory to implement each step performed by the device in the above method. For details, please refer to the relevant description in the above method embodiment.

[0104] Optionally, the memory 32 may be independent or integrated with the processor 31 .

[0105] When the memory 32 is a device independent of the processor 31, the device may further include:

[0106] The bus 33 is used to connect the memory 32 and the processor 31 .

[0107] The present invention also provides a readable storage medium, in which a computer program is stored. When the computer program is executed by a processor, it is used to implement the methods provided by the various embodiments described above.

[0108] Among them, the readable storage medium can be a computer storage medium or a communication medium. The communication medium includes any medium that facilitates the transmission of a computer program from one place to another. The computer storage medium can be any available medium that can be accessed by a general-purpose or special-purpose computer. For example, a readable storage medium is coupled to a processor so that the processor can read information from the readable storage medium and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can be located in an application-specific integrated circuit (Application Specific Integrated Circuits, abbreviated as: ASIC). In addition, the ASIC can be located in a user device. Of course, the processor and the readable storage medium can also exist in a communication device as discrete components. The readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device, etc.

[0109] The present invention also provides a program product, which includes an execution instruction, which is stored in a readable storage medium. At least one processor of a device can read the execution instruction from the readable storage medium, and at least one processor executes the execution instruction so that the device implements the methods provided in the above various embodiments.

[0110] In the embodiments of the above-mentioned devices, it should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in the present invention may be directly implemented as being executed by a hardware processor, or may be executed by a combination of hardware and software modules in the processor.

[0111] Through the introduction of the above embodiments, the present invention proposes an innovative car-home scenario through an intelligent car-home digital twin control method and system, and in view of various conditions of the automobile, proposes a set of optimization solutions including self-developed communication protocols and self-developed digital twin cloud platforms in the car-home scenario. At the same time, based on the algorithm computing power support of the cloud platform, intelligent equipment monitoring and service recommendations in the car-home scenario can be realized. Specifically, after the vehicle-residence device is equipped with a communication protocol, the present invention presets a high-precision digital model according to the physical entity of the vehicle-residence device and stores it in the vehicle-residence digital twin cloud platform; the user activates the vehicle-residence device, and the vehicle-residence device and the vehicle-residence digital twin cloud platform are automatically connected without feeling; a spatial environment digital model is generated according to the physical environment of the vehicle-residence device and the corresponding high-precision digital model, and the spatial environment digital model and the behavior data of the vehicle-residence device are matched through the communication protocol to generate a digital twin model and store it in the vehicle-residence digital twin cloud platform; the user operation data of the user on the vehicle-machine interface is uploaded to the vehicle-residence digital twin cloud platform, and the user operation data is converted into instructions through the communication protocol, and the instructions are sent to the vehicle-residence device; the vehicle-residence device receives the instructions and completes the corresponding device operation, and returns the device operation data to the vehicle-residence digital twin cloud platform, and displays the device operation data on the vehicle-machine interface; the vehicle-residence digital twin cloud platform The twin cloud platform recommends corresponding usage suggestions based on user operation data, thereby realizing intuitive and efficient interconnection between vehicle and home devices. In addition, the three-dimensional space model screen is used as the user operation interface on the vehicle system, which is intuitive, easy to operate, and more similar to people's feelings in the real physical space. It can automatically generate a digital twin model of the vehicle-living space environment with a high degree of restoration, allowing car users to use in-vehicle IoT devices as if they were in the actual physical space, and then efficiently and intuitively view and control the corresponding vehicle-living equipment. It has lower requirements for overall computing power and is easier to implement in actual vehicle scenarios. It also realizes intelligent service suggestions and recommendations through big data algorithms to create an intelligent in-vehicle third space, bringing convenient and personalized car-living experience to car users, and improving the level of vehicle intelligence and user experience through real-time car-living environment monitoring and remote control functions.

[0112] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A smart car-housing digital twin control method, characterized in that: include: After the vehicle-housing device is equipped with the communication protocol, a high-precision digital model is preset according to the physical entity of the vehicle-housing device and stored in the vehicle-housing digital twin cloud platform; The user activates the vehicle-home device, and the vehicle-home device is automatically connected to the vehicle-home digital twin cloud platform without any sense; Generate a spatial environment digital model according to the physical environment of the vehicle-dwelling device and the corresponding high-precision digital model, match the spatial environment digital model and the behavior data of the vehicle-dwelling device through the communication protocol, generate a digital twin model and store it in the vehicle-dwelling digital twin cloud platform; The digital twin model is displayed to the user through the vehicle-machine interface, the user operation data of the vehicle-machine interface is uploaded to the vehicle-residence digital twin cloud platform, the user operation data is converted into instructions through the communication protocol, and the instructions are sent to the vehicle-residence device; The vehicle-housing device receives the instruction and completes the corresponding device operation, and returns the device operation data to the vehicle-housing digital twin cloud platform and displays it synchronously on the vehicle-machine interface; The car-home digital twin cloud platform recommends corresponding usage suggestions based on the user operation data.

2. The intelligent vehicle-housing digital twin control method according to claim 1 is characterized in that: The vehicle-housing equipment has the same device model, the same corresponding high-precision digital model, and the same corresponding high-precision digital model code.

3. The intelligent vehicle-housing digital twin control method according to claim 1 is characterized in that: The physical environment is obtained by scanning the surrounding space environment of the vehicle-residence device through cameras inside and outside the vehicle, and the physical environment is uploaded to the vehicle-residence digital twin cloud platform.

4. The intelligent vehicle-housing digital twin control method according to claim 1 is characterized in that: The communication protocol sends the field information of the vehicle-residence device to the vehicle-residence digital twin cloud platform, and the vehicle-residence digital twin cloud platform automatically matches the high-precision digital model corresponding to the vehicle-residence device according to the field information.

5. The intelligent vehicle-housing digital twin control method according to claim 1 is characterized in that: The step of generating a spatial environment digital model according to the physical environment of the vehicle-dwelling device and the corresponding high-precision digital model, matching the spatial environment digital model with the behavior data of the vehicle-dwelling device through the communication protocol, generating a digital twin model and storing it in the vehicle-dwelling digital twin cloud platform, specifically includes: Obtaining spatial environment data of the vehicle-dwelling device according to the physical environment of the vehicle-dwelling device and the corresponding high-precision digital model; Based on the radial basis function, an interpolation surface at each data point in the spatial environment data is determined: Where s(x) represents the value of the interpolation surface at the current data point x; n represents the number of adjacent data points of the current data point; δ represents the three-dimensional interpolation coefficient; φ represents the radial basis function; x represents the current data point; x j Represents the jth adjacent data point of the current data point; ||xx j || represents the distance between the current data point and the jth adjacent data point; p(x) represents the interpolation stability coefficient at the current data point x; ∑ represents the summation symbol; Determine the interpolation surfaces at all data points in the spatial environment data, and construct a digital model of the spatial environment of the vehicle-dwelling equipment; After obtaining the digital model of the space environment, the digital model of the space environment is optimized by adjusting the position of each data point based on a network optimization algorithm to generate a plurality of optimized data points, wherein the expression of the optimized data point is: In the formula, x′ represents the optimized data point; x represents the current data point; α represents the smoothing strength coefficient; n represents the number of adjacent data points of the current data point; x j represents the jth adjacent data point of the current data point; ∑ represents the summation symbol; Optimizing the digital model of the space environment accordingly based on the optimized data points; The digital model of the spatial environment and the behavioral data of the vehicle-residence equipment are matched through the communication protocol to generate a digital twin model and store it in the vehicle-residence digital twin cloud platform.

6. The intelligent vehicle-housing digital twin control method according to claim 1, characterized in that: The vehicle-machine interface is a three-dimensional visual user interface, and the user can view the usage status of the vehicle-residence equipment and automatically control the working status of the vehicle-residence equipment through the vehicle-machine interface.

7. The intelligent vehicle-housing digital twin control method according to claim 1 is characterized in that: The vehicle-home digital twin cloud platform identifies and recommends usage suggestions for the vehicle-home equipment based on the user operation data through a big data algorithm, and triggers an alarm device when an abnormality occurs in the vehicle-home equipment, specifically including: Performing a cleaning operation on the user operation data to remove noise and abnormal values ​​in the user operation data and generate target operation data; Extracting operation features from the target operation data and constructing a usage suggestion recognition model; Based on the usage suggestion identification model, identifying usage suggestions for the vehicle-housing device according to the operation characteristics: y t =f(F t ,i) Where yt represents the usage suggestion of the t-th identified vehicle-housing device; f represents the usage suggestion identification function; F t represents the tth operational feature; θ represents the model parameters identified using the proposal; Determine a loss function corresponding to the usage suggestion recognition model, adjust the usage suggestion recognition model parameters based on an optimization algorithm, minimize the loss function, and determine the optimal usage suggestion recognition model parameters: In the formula, θ * Indicates the optimal usage recommendation recognition model parameters; arg min θ It represents the value of θ output when the expression takes the minimum value; N represents the total number of operation features; represents the standard usage recommendation label corresponding to the t-th operation feature; y t represents the usage suggestion of the t-th identified vehicle-housing equipment; L represents the loss function; ∑ represents the summation symbol; The use suggestions of the vehicle-dwelling equipment are identified and recommended according to the user operation data, and an alarm device is triggered when an abnormality occurs in the vehicle-dwelling equipment.

8. A control system for a smart vehicle-housing digital twin control method according to any one of claims 1 to 7, characterized in that: include: A data management and storage module is used to collect, manage and store the required digital twin data, and to store, index, back up and restore the digital twin data; A model creation and update module is used to create and update a digital twin model based on the physical entity of the vehicle-housing equipment, and to perform parameter configuration, training and optimization on the digital twin model; A data analysis and optimization module is used to analyze and optimize the digital twin data, analyze the digital twin data through machine learning algorithms and optimization algorithms, identify potential problems and provide decision-making suggestions for users; An identity security verification module is used to protect the security of the car-home digital twin platform, verify user identity and control access, and perform data encryption and security audit on the digital twin data; Integration module, which is used to provide integration interface with external systems and applications, and to exchange and share data with other systems.

9. The intelligent vehicle-housing digital twin control system according to claim 8, characterized in that: The system also includes a vehicle-machine display module for three-dimensionally visualizing the digital twin model, vehicle-home equipment connections, digital twin data, and analysis and optimization results thereof.

Images