Transformation device, vehicle comprising a physical control unit and method for operating a transformation device

Abstract

Transformation device (1), wherein the transformation device (1) is configured to - to assign a physical control unit (6) as a physical coupling element to a coupling pair (10), - to assign a virtual object (4) in a simulation (3) performed on a simulation device as a virtual coupling element to the coupling pair (10), - to receive physical operating data (7) from the physical control unit (6), - to convert the physical operating data (7) into virtual operating data (8) according to a predetermined transformation procedure for controlling the simulation (3) for the virtual object (4) in the simulation (3), and - to send the virtual operating data (8) to the simulation device (2), characterized in that the transformation device (1) is configured to convert the physical operating data (7) into further virtual operating data (8) for controlling a further simulation (3) for the virtual object (4) in a further simulation (3) according to at least one further predetermined transformation method and to send the virtual operating data (8) to the further simulation device (2).

Description

[0001] The invention relates to a transformation device, a vehicle comprising a physical control unit and a method for operating a transformation device.

[0002] According to the current state of the art, it is common practice to provide simulation facilities that provide virtual environments within simulations. This allows a user to log into the simulation facility with their computer and thus participate in the simulation as a virtual object. In the simulation, participants can interact with virtual objects or with each other, and thus communicate, for example.

[0003] However, the current state of the art still entails a separation between the virtual world, which is implemented in the virtual environments of simulations, and the real world. As a result, processes in the simulation and the real world run separately. This is particularly disadvantageous because the virtual world is increasingly being used by companies and service providers to provide services in the virtual world. Furthermore, the current state of the art technology enables more extensive networking of control units in reality, as well as more extensive provision of sensor data acquired by control units. This separation means that the potential that would arise from a connection between the real and virtual worlds is not being utilized.

[0004] Possibilities for connecting the real world with a state-of-the-art simulation are disclosed in the following documents.

[0005] WO 2020 / 229841 A1 discloses a data fusion system for the metaverse. The data fusion system is intended for use in a real vehicle. The vehicle contains multiple data sources that generate sensor data spatially associated with a real area. The data fusion system is configured to fuse or integrate the spatially associated sensor data with virtual data.

[0006] US 2013 / 0125113 A1 discloses coupling physical devices with virtual devices to create an immersive environment.

[0007] DE 10 2018 210 790 A1 describes a method for performing computer-aided simulations.

[0008] DE 10 2017 116 192 A1 describes the use of virtual data for testing and training parking space detection systems.

[0009] It is an object of the invention to provide a solution that enables a connection between physical control units and virtual objects.

[0010] The problem is solved by the subject matter of the independent patent claims. Advantageous developments of the invention are described by the dependent patent claims, the following description, and the figures.

[0011] The invention relates to a transformation device configured to assign a physical control unit as a physical coupling element to a coupling pair. The transformation device may comprise a microprocessor and / or a microcontroller. The physical control unit may also comprise a microprocessor and / or a microcontroller. The physical control unit may, for example, be a control device of a vehicle and / or a mobile terminal. The physical control unit is configured to communicate with the transformation device and to provide it with physical operating data and / or to receive the physical operating data from the transformation device. The terms physical operating data and physical control unit describe that these are elements of the real and thus physical world.The transformation device is configured to assign the physical control unit to the coupling pair. The transformation device is also configured to assign a virtual object in a simulation executed on a simulation device as a virtual coupling element to the coupling pair. The virtual object can, for example, describe an object simulated in the simulation. The virtual object can be a simple parameter of the simulation or a virtual replica of a real object. The simulation device can have a microprocessor and / or a microcontroller and be configured to execute the simulation. The simulation can have one or more of the virtual objects. The transformation device is configured to assign the physical control unit to a virtual object. The physical control unit and the virtual object are coupling elements of the coupling pair.The transformation device can act as an adapter or translator between the virtual world and the real world, for example to be able to map the physical control unit or an object assigned to the physical control unit in the real world in the virtual world or to adapt an operation of the physical control unit according to a simulated state of the virtual object.

[0012] The transformation device is configured to receive the physical operating data from the physical control unit. The physical operating data may, for example, include current geographical position data of the physical control unit. The transformation device is configured to convert the physical operating data into virtual operating data for controlling the simulation for the virtual object in the simulation according to a predetermined transformation method and to send the virtual operating data to the simulation device.In other words, the transformation method is provided to convert the physical operating data used to operate the physical control unit or which can describe a state of the physical control unit into virtual operating data and to provide the virtual operating data to the simulation device so that the latter can control the virtual object in the simulation according to the virtual operating data. For example, it can be provided that the physical operating data can describe the operation of a motor vehicle in the real world. The physical operating data can be transmitted by the physical control unit to the transformation device so that the latter can convert the physical operating data into the corresponding virtual operating data. The conversion can be carried out, for example, using assignment tables.The virtual operating data can be tailored to formal specifications and simulation capabilities. The virtual operating data is provided by the simulation device's transformation mechanism so that the simulation device can control and / or model the virtual object in the simulation according to the virtual operating data. This makes it possible, for example, to model a virtual vehicle's journey in the simulation according to a vehicle's journey in the real world.

[0013] The transformation device can comprise a data processing apparatus or a processor device configured to carry out an embodiment of the method according to the invention. For this purpose, the processor device can comprise at least one microprocessor and / or at least one microcontroller and / or at least one FPGA (Field Programmable Gate Array) and / or at least one DSP (Digital Signal Processor). Furthermore, the processor device can comprise program code configured to carry out the embodiment of the method according to the invention when executed by the processor device. The program code can be stored in a data memory of the processor device.

[0014] It is provided that the transformation device is configured to convert the physical operating data according to at least one further predetermined transformation method into further virtual operating data for controlling a further simulation for a virtual object in a further simulation and to send the virtual operating data to the further simulation device. In other words, the transformation device is configured to transform the physical operating data for at least one further simulation according to the further predetermined transformation method. In further other words, the transformation device is not limited to coupling the physical control unit to the virtual object of one simulation of the simulation device, but the transformation device is also configured to couple the physical control unit to the virtual object of at least one further simulation.This offers the advantage of allowing a user to link their physical control unit to different simulations. The linking of the physical control unit to the virtual object of the further simulation can be done alternatively or in parallel to the linking of the physical control unit to the virtual object of the simulation.

[0015] The invention also includes further developments which result in further advantages.

[0016] A further development of the invention provides that the transformation device is configured to convert the virtual operating data into physical operating data for controlling the physical control unit according to the predetermined transformation method and to send the physical operating data to the physical control unit. In other words, it is provided that the transformation device is configured to receive the virtual operating data used to control the virtual object in the simulation and to convert it into physical operating data according to the predetermined transformation method in order to be able to control the physical control unit according to the physical operating data. For example, it may be possible for a vehicle in the simulation to be controlled by a user or a predetermined algorithm, and for virtual operating data to be used or recorded in the process.The virtual operating data can be converted into physical operating data by the transformation device in order to be able to control the control unit of a real vehicle in the real world, which is assigned to the virtual object. For example, it can be provided that vehicle functions are configured, activated, or deactivated in the simulation, and the virtual operating data relating to the vehicle functions in the simulation are converted into physical operating data by the transformation device in order to carry out the corresponding configurations or operations accordingly in the physical control unit. The transformation method can be provided to carry out corresponding processes for transforming physical operating data into virtual operating data in an inverted manner.

[0017] A further development of the invention provides that the transformation device is configured to assign the virtual object to the coupling pair depending on a current geographical position of the physical control unit. In other words, the virtual object is assigned to the physical control unit according to a current geographical position of the physical control unit.

[0018] A further development of the invention provides that the transformation device is configured to assign the virtual object and / or the physical control unit to the coupling pair depending on a current geographical position of a further physical control unit of a further coupling pair. In other words, the coupling of the physical control unit to the virtual object can depend on a current geographical position of a physical control unit of a further coupling pair. For example, it can be provided that the further coupling pair couples a vehicle in the real world with a vehicle in the virtual world. The coupling pair can, for example, couple a charging station in the real world with a charging station as a virtual object in the simulation. It can be provided that the charging station in the real world can be configured to charge the vehicle using virtual operating data in the virtual world.It can be provided that the charging station in the virtual world is assigned to the physical charging station that is closest to the vehicle in the real world.

[0019] A further development of the invention provides that the transformation device is configured to permanently assign the physical control unit to the coupling pair as a physical coupling element and to permanently assign the virtual object to the coupling pair as a virtual coupling element. In other words, the transformation device is configured to assign the same coupling partner to the coupling pair in each session. The coupling elements can be linked to one another, for example, in an account by unique identifiers.

[0020] A further development of the invention provides that the transformation device is configured to reassign the coupling elements to the coupling pair in a respective session. In other words, it is provided that the transformation device carries out the coupling method for coupling the physical coupling element to the virtual coupling element again in a respective session. For example, it can be provided that the physical control unit is not permanently assigned to the virtual object. A permanent assignment in this context can be understood as an identical assignment in each session in the coupling pair. It can be provided that a different virtual object can be assigned to the physical control unit in a respective session of the physical control unit at least sometimes or each time.

[0021] A further development of the invention provides that the transformation device is configured to assign at least one further coupling element to the coupling pair. In other words, it is provided that the transformation device is configured to assign at least one further virtual coupling element and / or at least one further physical coupling element to the coupling pair. A coupling pair can thus comprise, for example, two physical coupling elements and / or two virtual coupling elements. Accordingly, the physical operating data can be converted by the transformation device into virtual operating data for controlling the two virtual elements in the simulation and / or virtual operating data for controlling the virtual element in the simulation can be converted into physical operating data for controlling the at least two physical control units.

[0022] A second aspect of the invention relates to a vehicle comprising a physical control unit. The physical control unit is configured to send physical operating data to a transformation device and / or receive physical operating data from the transformation device. In other words, the physical control unit is configured to transmit the physical operating data to the transformation device so that the latter can transform the provided physical operating data into virtual operating data and provide it to the simulation device. The physical control unit of the vehicle is also configured to receive physical operating data from the transformation device and operate the vehicle according to the physical operating data.

[0023] The motor vehicle according to the invention is preferably designed as a motor vehicle, in particular as a passenger car or truck, or as a passenger bus or motorcycle.

[0024] The invention also includes the physical control unit of the vehicle. The physical control unit can have a data processing device or a processor device configured to carry out an embodiment of the method according to the invention. For this purpose, the processor device can have at least one microprocessor and / or at least one microcontroller and / or at least one FPGA (Field Programmable Gate Array) and / or at least one DSP (Digital Signal Processor). Furthermore, the processor device can have program code configured to carry out the embodiment of the method according to the invention when executed by the processor device. The program code can be stored in a data memory of the processor device.

[0025] A third aspect of the invention relates to a method for operating a transformation device. It is provided that the transformation device assigns a physical control unit to a coupling pair as a physical coupling element. In other words, the transformation device defines the physical control unit as the physical coupling element of a coupling pair. The transformation device assigns a virtual object in a simulation executed on a simulation device to the coupling pair as a virtual coupling element. The transformation device receives physical operating data from the physical control unit. In other words, the physical control unit transmits the physical operating data to the transformation device.In a further step, the physical operating data is converted into virtual operating data for controlling the simulation for the virtual object in the simulation using a predetermined transformation method. The virtual operating data is sent to the simulation device by the transformation device.

[0026] The transformation device converts the physical operating data into further virtual operating data for controlling a further simulation for a virtual object in a further simulation, using at least one further predetermined transformation method. The transformation device sends the virtual operating data to the further simulation device.

[0027] For use cases or application situations that may arise during the method and which are not explicitly described here, it may be provided that, in accordance with the method, an error message and / or a request to enter user feedback is issued and / or a default setting and / or a predetermined initial state is set.

[0028] The invention also includes further developments of the vehicle according to the invention and the method according to the invention that have features already described in connection with the further developments of the transformation device according to the invention. For this reason, the corresponding further developments of the vehicle according to the invention and the method according to the invention are not described again here.

[0029] As a further solution, the invention also encompasses a computer-readable storage medium comprising instructions which, when executed by a computer or computer network, cause the computer to carry out an embodiment of the method according to the invention. The storage medium can, for example, be designed at least partially as a non-volatile data memory (e.g. as a flash memory and / or as an SSD - solid state drive) and / or at least partially as a volatile data memory (e.g. as a RAM - random access memory). The computer or computer network can provide a processor circuit with at least one microprocessor. The instructions can be provided as binary code or assembler and / or as source code of a programming language (e.g. C).

[0030] The invention also encompasses combinations of the features of the described embodiments. The invention therefore also encompasses implementations that each comprise a combination of the features of several of the described embodiments, unless the embodiments are described as mutually exclusive.

[0031] Exemplary embodiments of the invention are described below. Shown are: Fig. 1 a schematic representation of a transformation device; Fig. 2 a schematic representation of coupling pairs consisting of virtual coupling elements and physical coupling elements; and Fig. 3 a schematic representation of a sequence of a method for operating a transformation device.

[0032] The exemplary embodiments explained below are preferred embodiments of the invention. In the exemplary embodiments, the described components of the embodiments each represent individual features of the invention that can be considered independently of one another, each of which also develops the invention independently of one another. Therefore, the disclosure is intended to encompass combinations of the features of the embodiments other than those shown. Furthermore, the described embodiments can also be supplemented by further features of the invention already described.

[0033] In the figures, the same reference symbols designate elements with the same function.

[0034] Fig. 1 shows a schematic representation of a transformation device.

[0035] The transformation device 1 can be configured to communicate with a simulation device 2 on which a simulation 3 is operated. The simulation device 2 can be, for example, a server and / or a collection of servers configured to operate the simulation 3. In the simulation 3, virtual objects 4 can be controlled by the simulation device 2. The simulation 3 can, for example, recreate a virtual world 9 that is modeled on a real world 9. The task of the transformation device 1 can be to link physical control units 6, which can be arranged, for example, in a vehicle 5, with the simulation device 2. This can enable interaction between the physical control units 6 in the simulation 3.The transformation device 1 can function as an adapter between the control units 6 and the simulation device 2. In order to enable the integration of physical control units 6 into the simulation 3, it can be provided that the transformation device 1 is configured to couple the physical control units 6 to a respective virtual object 4 according to a predetermined coupling method. The coupling can form a coupling pair 10, which can have the virtual object 4 as a virtual coupling element and the control unit 6 as a physical coupling element. The virtual coupling element can be a so-called avatar of the physical control unit 6. It can be provided that the virtual object 4 and the physical control unit 6 can be permanently assigned to one another.For example, it can be provided that a control unit 6 has access to the simulation device 2 and the virtual object 4 can be uniquely assigned to the physical control unit 6 via the access. For example, it can be provided that the control unit 6 has a unique identification number that can be assigned to a uniquely identifiable virtual object 4. It can also be provided that the transformation device 1 is configured to assign the coupling pairs 10 to one of the control units 6, for example depending on a current geographical position. It can also be provided that the assignment can take place depending on geographical positions of another of the further control units 6. The coupling pairs 10 can also have multiple coupling elements.For example, it can be provided that two virtual objects 4 are assigned to a physical control unit 6 and / or several physical control units 6 are assigned to a virtual object 4. For example, it can be provided that several virtual objects 4 are assigned to a control unit 6 or several control units 6 are assigned to a virtual object 4.

[0036] To enable interaction between the virtual and real worlds 9, the transformation device 1 can be configured to receive physical operating data 7 from the control unit 6 and to transform these into virtual operating data 8 according to the predetermined transformation method, and to provide the virtual operating data 8 to the simulation device 2 for controlling the virtual object 4 in the simulation 3. Likewise, the transformation device 1 is configured to receive virtual operating data 8 from the simulation device 2 for controlling the virtual object 4, to convert them according to the predetermined transformation method, and to provide them to the assigned physical control unit 6. The transformation device 1 can thus function like a compiler.

[0037] Fig. Figure 2 shows a schematic representation of coupling pairs consisting of virtual coupling elements and physical coupling elements.

[0038] Shown is a linking of the virtual objects 4 with the physical control units 6 by the transformation device 1. The transformation device 1 can convert the virtual and physical operating data 7 into one another in order to enable control of the virtual object 4 as a function of the physical control unit 6 or control of the physical control unit 6 as a function of the virtual object 4. A coupling pair 10 can, for example, comprise a control unit 6 of a vehicle 5. This can, for example, determine current geographical positions and transmit them to the transformation device 1. The transformation device 1 can transform the physical operating data 7 and transmit them to the simulation device 2 in order to enable control of the virtual object 4 according to the virtual operating data 8 by the simulation device 2.In this case, the virtual object 4 may be a replica of the vehicle 5 in the real world 9.

[0039] A further coupling pair 10 can be assigned to a person's mobile device as a virtual object 4. For example, it can be provided that movements and / or actions performed with the mobile device are used by the simulation device 2 to recreate a person as a virtual object 4 in the simulation 3. A further coupling pair 10 can, for example, have a charging station in the simulation 3, which can be assigned to several charging stations in the real world 9. For example, it can be provided that operation of the physical charging station can be set in the simulation 3 and virtual operating data 8 is transmitted to the transformation device 1 so that this can be transformed by the transformation device 1 into physical operating data 7, which can control the operation of the real charging devices.For example, it can be provided that a vehicle 5 is connected to the physical charging device, and a user can set the amount of energy to be delivered in the simulation 3. The amount set in the simulation 3 can be transmitted to the transformation device 1 so that it transforms the virtual operating data 8 into physical transformation data and transmits it to the control unit 6 to which the vehicle 5 is connected for carrying out a charging process. The physical operating data 7 can specify the amount of energy to be delivered.

[0040] Fig. 3 shows a schematic representation of a sequence of a method for operating a transformation device.

[0041] In a step S1, a physical control unit 6 can be assigned as a physical coupling element to a coupling pair 10 by the transformation device 1.

[0042] In a second step S2, a virtual object 4 can be assigned to the coupling pair 10 as a virtual coupling element in a simulation 3 executed on a simulation device 2. The assignment can be fixed, for example, depending on identification features provided by the physical control unit 6, which are uniquely assigned to the virtual object 4, or depending on certain operating data that can be provided by the physical control unit 6. For example, it can be provided that the virtual object 4 is assigned depending on a current geographical location provided by the physical control unit 6.

[0043] In a step S3, physical operating data 7 can be generated by the physical control unit 6 and transmitted to the transformation device 1. The operating data can include, for example, a current geographical position and / or engine values, which can describe an operation of the physical control unit 6.

[0044] The transformation device 1 can receive the physical operating data 7 from the physical control unit 6 and, according to a predetermined transformation method, convert them S4 into virtual operating data 8 for controlling the simulation 3 for the virtual object 4 in the simulation 3. The conversion can be performed, for example, as a function of a table that can include commands that enable the simulation device 2 to control the virtual object 4 in order to be able to perform a corresponding function according to the physical operating data 7 by the virtual object 4.

[0045] In a further step, the virtual operating data 8 for controlling the simulation 3 for the virtual object 4 can be transmitted S5 by the transformation device 1 to the simulation device 2.

[0046] The simulation device 2 can receive the virtual operating data 8 and control the virtual object 4 in the simulation 3 according to the virtual operating data 8 S6.

[0047] All functions and online usage options of the mobility systems refer to the “real environment” or to an area of ​​a company / function on the World Wide Web.

[0048] The connection to the respective address is established via the respective IP address and the associated protocol.

[0049] Currently, the possibility of connecting a virtual space is not being considered, where the respective user is controlled as an "avatar," so to speak, as a third person in a virtual world created by IT. The needs that are fulfilled / collected there are not currently transferred / translated to a mobility system or other system (mobile phone). The action remains within the user's own action space.

[0050] An algorithm is superimposed on the vehicle system that transfers all virtual activities from the metaverse to the "real" world, including the payment function. It thus forms the connection between the virtual and real worlds.

[0051] Considering the fact that land / streets are currently being offered for sale in the Metaverse, there is also a business model behind it.

[0052] The connection can range from location / time information to communication and payment functions (purchase of goods, etc.).

[0053] For example, purchased goods can be picked up in the metaverse after payment at location XY. And so on. The possibilities are as diverse as in real life.

[0054] This is especially beneficial when purchasing services of any kind that are performed, implemented, or acquired in the real world. You don't have to connect or initiate these services twice via the Internet, and you can retain control and achieve significant savings (convenience / time / fewer interfaces, etc.).

[0055] At the same time, it offers the possibility of using the metaverse, for example, for autonomous driving areas via the higher-level interface (distraction for fun (movies), meetings, games, etc.) as a digital medium.

[0056] A separate business model for your own services / data collection, etc. can be built on this.

[0057] Overall, the invention enables a connection between a simulation and the real world.

Claims

[1] Transformation device (1), wherein the transformation device (1) is arranged to - to assign a physical control unit (6) as a physical coupling element to a coupling pair (10), - to assign a virtual object (4) in a simulation (3) executed on a simulation device as a virtual coupling element to the coupling pair (10), - to receive physical operating data (7) from the physical control unit (6), - converting the physical operating data (7) into virtual operating data (8) for controlling the simulation (3) for the virtual object (4) in the simulation (3) according to a predetermined transformation method, and - to send the virtual operating data (8) to the simulation device (2), characterized bythat the transformation device (1) is designed to convert the physical operating data (7) according to at least one further predetermined transformation method into further virtual operating data (8) for controlling a further simulation (3) for the virtual object (4) in a further simulation (3) and to send the virtual operating data (8) to the further simulation device (2). [2] Transformation device (1) according to claim 1 characterized by that the transformation device (1) is designed to convert the virtual operating data (8) into physical operating data (7) for controlling the physical control unit (6) according to the predetermined transformation method and to send the physical operating data (7) to the physical control unit (6). [3] Transformation device (1) according to claim 1 or 2, characterized bythat the transformation device (1) is configured to assign the virtual object (4) to the coupling pair (10) depending on a current geographical position of the physical control unit (6). [4] Transformation device (1) according to one of the preceding claims, characterized by that the transformation device (1) is configured to assign the virtual object (4) and / or the physical control unit (6) to the coupling pair (10) depending on a current geographical position of a further physical control unit (6) of a further coupling pair (10). [5] Transformation device (1) according to one of the preceding claims, characterized by , that the transformation device (1) is designed to permanently assign the physical control unit (6) to the coupling pair (10) as a physical coupling element, and to permanently assign the virtual object (4) to the coupling pair (10) as a virtual coupling element to the coupling pair (10). [6] Transformation device (1) according to one of the preceding claims, characterized by that the transformation device (1) is configured to reassign the coupling elements to the coupling pair (10) in a respective session. [7] Transformation device (1) according to one of the preceding claims, characterized by that the transformation device (1) is designed to assign at least one further coupling element to the coupling pair (10). [8] Method for operating a transformation device (1), wherein the transformation device (1), - a physical control unit (6) is assigned as a physical coupling element to a coupling pair (10), - a virtual object (4) is assigned to the coupling pair (10) as a virtual coupling element in a simulation (3) carried out on a simulation device, - physical operating data (7) are received from the physical control unit (6), - the physical operating data (7) are converted into virtual operating data (8) for controlling the simulation (3) for the virtual object (4) in the simulation (3) according to a predetermined transformation method, and - the virtual operating data (8) are sent to the simulation device (2). characterized by that by the transformation device (1), - the physical operating data (7) are converted into further virtual operating data (8) for controlling a further simulation (3) for the virtual object (4) in a further simulation (3) according to at least one further predetermined transformation method, and - the virtual operating data (8) are sent to the further simulation device (2).

Images