SYSTEM FOR INTERACTIVE PROTOTYPING OF PRODUCTS, OPERATION PROCEDURE AND CORRESPONDING COMPUTER PRODUCT

Description

DESCRIPTION of the industrial invention entitled: “System for interactive product prototyping, operating procedure and corresponding IT product” by: Granstudio SpA, of Italian nationality, Via Giovanni Pacini 53 - 10153 Turin - Italy Designated inventors: Klaudia WARMUS, Lukasz CZEKANOWSKI, Lowie VERMEERSCH Filed on: May 30, 2024 **** DESCRIPTION TEXT Field of invention This description relates to systems and processes for interactive product prototyping. In particular, such systems and processes can be used to prototyping the interior and / or exterior of a vehicle such as a car, but in principle they can be used to prototyping any type of product such as household appliances, industrial machinery and the like. Technological background In the field of industrial design, the goal of prototyping is to generate a prototype (e.g., a demonstration model or mock-up) of the desired product that faithfully imitates the appearance and / or functionality of the final product and that reproduces a realistic user experience in the most acceptable manner. Traditionally, physical product demonstration models (e.g., the interior or exterior of a car) have been built. However, producing physical demonstration models is a time-consuming and expensive process. Therefore, prototyping with the aid of virtual reality (VR) and / or augmented reality (AR) devices is becoming increasingly common. Such VR / AR prototyping tools can be used in combination with configurable physical demonstration models, as described in documents EP 4222728 A1 and EP 4231191 A1 of the same applicant, to provide an extended reality (XR) design system. Additionally, modern products (e.g., cars) often have human-machine interfaces (HMIs) that include displays and / or touchscreens. Currently, various design programs are available for creating 2D interfaces (e.g., designing and testing the look and feel of a touchscreen or in-vehicle display), but these do not easily allow for testing how these interfaces will function in real-world scenarios. On the other hand, there are programs that enable 3D prototyping in VR and AR environments, but designing 2D interfaces within the framework of a 3D prototyping tool is often complex or entirely impossible. Therefore, there is a need in technology to provide improved systems and processes for plug-and-play interactive prototyping of products, which facilitate the fusion of 2D-designed on-screen interfaces, 3D-designed environments, and physical (hardware) components. Summary of the invention It is a purpose of one or more embodiments to provide such improved prototyping systems. According to one or more embodiments, this aim can be achieved by means of a prototyping system having the characteristics set out in the following claims. One or more embodiments may relate to a corresponding prototyping process. One or more embodiments may relate to a corresponding computing product that can be loaded into the memory of at least one processing unit (e.g., an MCU or CPU) and includes portions of software code to execute the steps of the method when the product is operated on at least one processing unit. As used herein, a reference to such a computing product is intended to be equivalent to a reference to a computer-readable medium containing instructions for controlling the processing unit to coordinate the implementation of the method according to one or more embodiments. A reference to "at least one" processing unit is intended to highlight the possibility that one or more embodiments may be implemented in a modular and / or distributed manner. The claims are an integral part of the technical teaching provided herein with reference to the embodiments. According to one aspect of this disclosure, a system for interactive product prototyping comprises a computer configured to run a 2D design software program to design a two-dimensional on-screen interface intended to be incorporated into a product, run a 3D graphics engine to produce a three-dimensional model of the product, and incorporate the two-dimensional on-screen interface into the three-dimensional model of the product to produce a virtual representation of the product. The system includes a virtual reality or augmented reality headset coupled to the computer and wearable by a user, the headset being configured to display the virtual representation of the product.The system comprises a master device coupled to the computer via one or more serial communication interfaces for exchanging data between the 2D design software program, the 3D graphics engine, and the master device using a software plugin executed by the computer. The master device also comprises a first wireless communication interface. The system comprises at least one slave device comprising a second wireless communication interface for exchanging data with the first wireless communication interface. The at least one slave device also comprises at least one actuator device and / or at least one sensor device. Actuation data is transmitted from the 2D design software program and / or the 3D graphics engine to the at least one actuator device via the master device.Control data is transmitted from the at least one sensor device to the 2D design software program and / or 3D graphics engine via the master device. One or more implementations thus facilitate the seamless integration of virtual 2D HMI interfaces into virtual 3D product models and their merging with a physical demonstration model to improve the design verification phase. According to another aspect of this disclosure, a method of operating a system for interactive product prototyping comprises: - design, using a 2D design software program run by a computer, a two-dimensional screen interface that is intended to be incorporated into a product; - produce, with a 3D graphics engine run by the computer, a three-dimensional model of the product; - embed the two-dimensional screen interface into the three-dimensional model of the product to produce a virtual representation of the product; - display the virtual representation of the product on a virtual reality or augmented reality helmet coupled to the computer and wearable by a user; - coupling the processor to a master device via one or more serial communication interfaces to exchange data between the 2D design software program, the 3D graphics engine and the master device via a software plugin executed by the processor; - exchange data between the master device and at least one slave device via the first wireless communication interface of the master device and the second wireless communication interface of the slave device; - transmit actuation data from the 2D design software program and / or 3D graphics engine to at least one actuator device of the slave device via the master device; and - transmit control data from at least one sensor device of the slave device to the 2D design software program and / or 3D graphics engine via the master device. Brief description of the drawings The invention will now be described in detail with reference to the attached drawings, provided purely by way of non-limiting example, in which: - Figure 1 is an exemplary circuit diagram of a master device for use in a prototyping system according to the invention; - Figure 2 is an exemplary circuit diagram of a slave device for use in a prototyping system according to the invention; - Figure 3 is an exemplary circuit diagram of another slave device for use in a prototyping system according to the invention; and - Figure 4 is an exemplary block diagram of a prototyping system according to the invention. Detailed description of the invention As anticipated, this disclosure describes a system and method that have the purpose of seamlessly connecting three design environments that are traditionally separate, namely, a 2D design environment (e.g., a software environment) for designing a user interface (e.g., screens or touch screens), a 3D design environment (e.g., a software environment) for designing a 3D model of the shape and / or appearance of a product in which the 2D user interface is intended to be incorporated (e.g., the interior of a vehicle, such as the dashboard area), which can be viewed using VR / AR tools, and a physical (hardware) demonstration model or prototype that reproduces at least some of the shapes and / or at least some of the physical devices of the 3D model.By doing so, designers can effortlessly leverage a comprehensive, interactive prototyping environment that combines physical objects and digital (virtual) representations in a so-called “extended reality” (XR) prototyping system for design verification. Essentially, the design and verification process involves designing a 2D on-screen interface (e.g., including screen layouts, transitions, animations, etc.) that is intended to be incorporated into a product using a traditional 2D interface design program (e.g., ProtoPie). The design and verification process also involves designing a 3D model of the product (e.g., including templates) using a traditional 3D design program (e.g., Unreal Engine). The product may include, in addition to the 2D on-screen interface, additional physical devices with which the user can interact (e.g., buttons, knobs, and the like) and / or physical devices that can affect the user experience (e.g., LED lights). By fusing the 2D interface, the 3D model, and physical demonstration model devices (e.g.,(using a virtual reality or augmented reality headset where the outputs of the 2D and 3D design environments are fused), the behavior of the 2D interface can be simulated alongside the behavior of other devices, such as ambient lighting. For example, when verifying a vehicle design, the designer might interact with a virtual touchscreen that is reproduced by the VR / AR headset in the virtual 3D model of the vehicle interior, overlaid on the physical demonstration model, to change some interior lighting settings. The interior lighting could then be adjusted accordingly in the simulated 3D model, thus giving realistic feedback to the designer. In one use case scenario, a design system according to this description can be used in the automotive industry. A designer can perform design verification within an immersive 3D VR / AR / XR environment while sitting in the driver's seat of a virtual car interior. As the designer navigates the digital representation, they can simultaneously test form and function, visualizing the interaction between the vehicle hardware and the user experience (UX). While sitting in the 3D VR / AR / XR environment, the designer can seamlessly interact with the 2D HMI prototype for the infotainment system (e.g., a touchscreen on the center console). The digital representation mirrors the dashboard controls, touchscreens, and interactive elements with which the driver and passengers will interact.The 2D on-screen interface is embedded in the virtual 3D environment, enabling comprehensive design verification. Additionally, the testing phase also relies on the use of real (physical) controls within the car, created as physical prototypes in the vehicle demo model. These controls provide tangible feedback to the designer, facilitating realistic testing without the need for full production integration at this stage. Overlaying physical prototyping controls with the digital 3D environment, including 2D digital interfaces, provides a realistic simulation of the real-world feel and functionality of the controls within the car. This approach not only speeds up the design iteration process but also allows for verification that the HMI integrates seamlessly into the vehicle's contours. In another use case scenario, a design system according to this description can be used in the aerospace and aviation industries. Here, an HMI designer can work in a simulated 3D cockpit environment, interact with 2D avionics control panels, and test aviation-specific physical controls. The immersive 3D VR / AR / XR environment allows verification that the HMI design meets stringent aviation requirements while providing realistic interaction between virtual and physical elements. These tests involve the use of physical prototypes, allowing for realistic evaluations without the need for full production integration at this stage. In another use case scenario, a design system according to this description can be used to design IoT and home automation devices. A designer working on smart home devices can connect real IoT devices to the prototype. This allows for testing the integration of physical devices with digital interfaces, ensuring a seamless user experience as users interact with both the app and the tangible hardware. In another use case scenario, a design system according to this description could be used to design medical devices and healthcare systems. The HMI designer could navigate through an immersive 3D VR / AR / XR representation of a state-of-the-art medical facility. In the virtual space, the designer could seamlessly use 2D HMI prototypes, conducting usability tests of 2D interfaces for various medical devices, mirroring the actual interfaces healthcare professionals will interact with in real-world scenarios. Again, the inclusion of physical prototyping controls, even if not production-ready, allows for a thorough evaluation of how the HMI design aligns with healthcare providers' tactile and operational expectations.The immersive 3D VR / AR / XR environment allows you to verify that your HMI design meets the stringent usability standards expected in healthcare settings and integrates seamlessly with the physical tools used by clinicians. The inclusion of physical controls enhances the realism of the testing phase. Therefore, the system and process described here can be used to design any industrial product, from transportation vehicles to appliances, machinery, healthcare devices, and the like. For ease of explanation, the focus herein will be primarily on automotive design, and specifically on car interior design. The prototyping system according to the present invention is based on a hardware platform that functions as a bridge between the 3D environment created within the framework of an industry-standard graphics engine (or rendering engine, 3D engine, or game engine) and complex 2D HMI prototypes (e.g., functionality and screen layout) created within the framework of an industry-standard 2D HMI prototyping tool. Designers can thus leverage the benefits of both software environments (3D and 2D) without encountering constraints or compatibility issues. The bridging functionality of the hardware platform is provided by a bidirectional communication channel established between the 3D graphics engine and the 2D prototyping tool. Additionally, the hardware platform allows the mixed 3D / 2D environment to be connected to real-world hardware components (e.g., controllers).(This involves overlaying a 3D / 2D representation of the digital environment onto a physical hardware demonstration model using an augmented reality headset.) This allows designers to test integrating physical device controls into the prototyped environment. Physical controls and devices include, but are not limited to, buttons, switches, knobs, levers, and other tangible interfaces. Physical controls can be prototyping controls (i.e., not intended for full production), which still provide a realistic evaluation of the user experience. By relying on the fusion of physical prototyping controls within the digital 3D / 2D AR environment, designers can rely on an interactive design process without the need for full production integration at this stage.This feature is particularly advantageous as it offers a practical approach to refining designs based on real-world interactions, and accelerates the design iteration process while ensuring that hardware and software components seamlessly harmonize. The prototyping system according to the present invention comprises a main PCB or a master device, which functions as a master device, and one or more secondary PCBs or secondary devices, which function as slave devices. Figure 1 is an exemplary circuit diagram of one possible architecture of the master device 10. The master device 10 includes a PCB 11 that is coupled to a first serial communication module 12a (e.g., a USB module), a second serial communication module 12b (e.g., a USB module), a level shifter circuit 13, a wireless communication module 14 (e.g., a Bluetooth module), and a status LED 15. The first serial communication module 12a is coupled to a first communication channel of the PCB 11 (e.g., a transmit pin TX1 and a receive pin RX1 of the PCB 11), and is also coupled to the GND (i.e., ground) and 5V (i.e., providing a 5 V supply voltage) power pins of the PCB 11 to be powered therefrom. The second serial communication module 12b is coupled to a third communication channel of the PCB 11 (e.g., a transmit pin TX3 and a receive pin RX3 of PCB 11), and is also coupled to the GND and 5V power pins of PCB 11 to be powered therefrom. The level shifter circuit 13 has a high voltage communication channel (e.g., 5 V) coupled to a second communication channel of PCB 11 (e.g., a transmit pin TX2 and a receive pin RX2 of PCB 11), and a low voltage communication channel (e.g., 3.3 V) coupled to the communication channel of Bluetooth module 14 (e.g., a transmit pin TXD and a receive pin RXD of Bluetooth module 14). The level shifter circuit 13 is also coupled to the GND, 5V, and 3V3 power pins of PCB 11 (the latter providing a supply voltage of 3.3 V) to be powered therefrom, and is configured to translate and pass signals between the Bluetooth module 14 and the PCB 11 (i.e., between the second communication channel of the PCB 11 operating at 5 V and the communication channel of the Bluetooth module 14 operating at 3.3 V). The Bluetooth module 14 is also coupled to the GND and 3V3 power pins of the PCB 11 to be powered therefrom. The status LED 15 may be, for example, an RGB LED having a cathode terminal coupled to the GND power pin of the PCB 11, and three anode terminals (one for each LED) coupled to a respective control terminal of the PCB 11 (e.g., numbered 1, 2, 3), optionally via (discrete) resistors. The status LED 15 may provide visual feedback on the current system status, enhancing user interaction and fault-finding capabilities. Figure 2 is an exemplary circuit diagram of one possible architecture of a slave device 20. The slave device 20 includes a PCB 21 that is coupled to a level shifter circuit 23, a wireless communication module 24 (e.g., a Bluetooth module), and an LED strip 25. The level shifter circuit 23 has a high voltage communication channel (e.g., 5 V) coupled to a communication channel of the PCB 21 (e.g., a transmit pin TX1 and a receive pin RX1 of the PCB 21), and a low voltage communication channel (e.g., 3.3 V) coupled to the communication channel of the Bluetooth module 24 (e.g., a transmit pin TXD and a receive pin RXD of the Bluetooth module 24). The level shifter circuit 23 is also coupled to the GND, 5V, and 3V3 power pins of PCB 21 (which provide a ground voltage, a 5V supply voltage, and a 3V supply voltage, respectively.3 V) to be powered therefrom, and is configured to translate and pass signals between the Bluetooth module 24 and the PCB 21 (i.e., between the communication channel of the PCB 21 operating at 5 V and the communication channel of the Bluetooth module 24 operating at 3.3 V). The Bluetooth module 24 is also coupled to the GND and 3V3 power pins of the PCB 21 to be powered therefrom. The LED strip 25 has a ground terminal coupled to the GND power pin of the PCB 11 and a control terminal coupled to a respective control terminal of the PCB 21 (e.g., numbered as 1), optionally via a (discrete) resistor. Additionally, the LED strip 25 has a power terminal coupled to the positive terminal of a battery 26 or a battery pack (e.g., numbered as 1)., a 5 V battery, optionally including one or more AAA batteries or a 5 V power bank), and the ground terminal of the LED strip 25 is also coupled to the ground terminal of the battery 26. By incorporating a power source, the slave configuration ensures portability and autonomy, allowing the LED strip to operate independently of the availability of external power sources. Figure 3 is an exemplary circuit diagram of another possible architecture of a slave device 20. The slave device 20 includes a PCB 21 that is coupled to a level shifter circuit 23, a wireless communication module 24 (e.g., a Bluetooth module), a first button 27, a second button 28, and a rotary encoder 29. The level shifter circuit 23 and the Bluetooth module 24 are coupled to the PCB 21 and to each other as described previously with reference to Figure 2. The button 27 has a ground terminal coupled to the GND power pin of the PCB 21 and a positive terminal coupled to a respective sense terminal of the PCB 21 (e.g., numbered 1), optionally via a (discrete) resistor. Similarly, button 28 has a ground terminal coupled to the GND power pin of PCB 21 and a positive terminal coupled to a respective sense terminal of PCB 21 (e.g., numbered 2), optionally by means of a (discrete) resistor. The rotary encoder 29 has a ground terminal coupled to the GND power pin of PCB 21, a positive terminal coupled to the 5V power pin of PCB 21, and sense terminals coupled to three respective sense terminals of PCB 21 (e.g., numbered 3, 4, 5). From a functional and operational standpoint, the prototyping system according to the present invention may be described with reference to the block diagram of Figure 4, which exemplifies the data connections between various components of the system. The prototyping system 1 comprises a master device 10 and one or more slave devices 20 coupled to respective hardware devices 25, 27, 28, 29 (e.g., as exemplified in Figures 2 and 3). The master device 10 and the slave devices 20 use their wireless communication modules 14, 24 (e.g., Bluetooth modules) to exchange data with each other. The master device 10 uses its first serial communication module 12a (e.g., USB module) to exchange data with a processor 40 and open a first communication port (COM port) to communicate with the GE graphics engine. The master device 10 uses its second serial communication module 12b (e.g., USB module) to exchange data with a processor 40 and open a first communication port (COM port) to communicate with the GE graphics engine. The master device 10 uses its second serial communication module 12b (e.g., USB module) to exchange data with a processor 40 and open a first communication port (COM port) to communicate with the GE graphics engine., USB module) to exchange data with the processor 40 and open a second communication port (COM port) to communicate with the prototyping tool PT. In operation, the processor 40 runs both the GE graphics engine (e.g., an industry-standard game engine) and the 2D HMI prototyping tool PT (e.g., industry-standard 2D prototyping software). The GE graphics engine communicates with the master device 10 via a first software plugin PL1 that acts as a bridge between the master device 10 and the GE graphics engine. The PL1 plugin uses a library or protocol (e.g., Socket.IO) to embed communication and open a communication port (COM port) that serves as an interface to the communication module 12a of the master device 10, facilitating data exchange between two ports with a single PCB.The first software plugin PL1 also enables streaming of the 2D prototyping tool's output to the GE graphics engine as a dynamic image, which can be applied to a 3D model. In this way, real-time output from the PT 2D prototyping tool is also visible in a VR / AR headset HS coupled to the processor 40. For example, a UI designed in the PT 2D prototyping tool is visible on a 3D virtual screen in the GE graphics engine. The PT 2D HMI prototyping tool communicates with the master device 10 via a second software plugin PL2 that acts as a bridge between the master device 10 and the PT 2D HMI prototyping tool. The PL2 plugin uses a library or protocol (e.g., Socket.IO) to incorporate communication (i.e., sending and receiving messages between the PT prototyping tool and the master device 10) and to open a COM port that serves as an interface to the second communication module 12b of the master device 10. Thus, the master device 10 facilitates instant usability by connecting to the computer 40 via serial communication ports (e.g., USB), providing a seamless and convenient plug-and-play user experience. Furthermore, the computer 40 is connected to a VR / AR headset HS (or a “head-mounted display”) that receives graphics information from the GE graphics engine and / or the PT 2D HMI prototyping tool to reproduce, on the display of the headset HS, the 3D model of the vehicle interior and the appearance of a 2D HMI screen of the vehicle interior fused together. Thus, in short, while the communication ports between the master device 10 and the processor 40 are open, messages are transmitted between the two design tools (i.e., the 3D engine and the 2D tool), allowing them to communicate with each other. The implementation of wireless modules (e.g., Bluetooth) in the master and slave devices allows each slave device to send messages to and receive messages from the master, which then sends messages to and receives messages from the GE game engine and the PT 2D prototyping tool. Thus, efficient data exchange and synchronization between the software and hardware components is facilitated. Depending on the needs of the application or project, the number of slave devices 20 in system 1 may vary, and so may the number of Bluetooth modules 14 paired to the master device 10.For example, if multiple slave devices are in use, a corresponding number of Bluetooth modules will be paired with the master device to ensure efficient communication. Slave devices may not communicate directly with each other, but if necessary, they can exchange messages through the master device, which acts as an intermediary. Additionally, each slave device 20 is connected to corresponding hardware based on the application or project requirements. For example, one slave device can drive an LED strip (as exemplified in Figure 2), while another slave device can operate various buttons (as exemplified in Figure 3). The LED strip can be controlled by the master device, providing versatile functionality such as power management (on / off), color selection, and animation control. The LED strip can thus be controlled not only by signals from hardware components (such as buttons), but also by data from the 2D HMI prototype embedded in the VR / AR / XR environment and operated by the user wearing the HS headset, or data from the user's interactions with the 3D environment. Providing both sensors (e.g., buttons, knobs) and actuators (e.g., switches) allows for a more flexible and scalable solution.(LED strip) coupled to slave devices 20 thus allows interactive control over various parameters of the virtual model of the car interior. For example, during the testing phase, the brightness of the LED strip can be adjusted by the user by acting on a physical knob, or by acting on a virtual slider reproduced on a virtual screen by the HS helmet. Similarly, the effect of such a change can be reflected both in the real environment (actually adjusting the brightness of the LED strip) and in the AR / VR / XR environment, providing real-time feedback within the 2D prototype. The inclusion of physical controls thus expands the range of control possibilities, allowing for precise adjustments and intuitive interaction with both physical and digital elements. Providing a master device 10 that communicates with slave devices 20 as well as the processor 40 allows for user input to be accepted from a variety of sources, including virtual reality environments, 2D prototypes, and direct interactions with hardware. This diverse input ecosystem allows the user to interact with the prototyping system 1 in a variety of ways, offering flexibility and versatility in the prototyping process. Another example of the functionality of the prototyping system described here is the support for voice control. For example, one of the slave devices 20 can be paired with a microphone to capture the user's voice. Voice input can be activated by the user by pressing a button (either physical or virtual). Upon activation of the voice input function, system 1 processes the voice commands within the target environment, regardless of whether it is a virtual reality simulation or a 2D prototype. Obviously, the construction details and embodiments may vary significantly from what has been described and illustrated by way of example, without departing from the scope of protection of the present invention as defined in the claims that follow.

Claims

1. System (1) for interactive prototyping of products, comprising: - a computer (40) configured to run a 2D design software program (PT) to design a two-dimensional screen interface intended to be incorporated into a product, run a 3D graphics engine (GE) to produce a three-dimensional model of the product, and incorporate said two-dimensional screen interface into said three-dimensional model of the product to produce a virtual representation of the product; - a virtual reality or augmented reality headset (HS) coupled to said computer (40) and wearable by a user, the headset (HS) being configured to display said virtual representation of the product;- a master device (10) coupled to said processor (40) by one or more serial communication interfaces (12a, 12b) for exchanging data between said 2D design software program (PT), said 3D graphics engine (GE) and said master device (10) by means of a software plugin (PL1, PL2) executed by said processor (40), the master device (10) further comprising a first wireless communication interface (14); - at least one slave device (20) comprising a second wireless communication interface (24) for exchanging data with said first wireless communication interface (14), the at least one slave device (20) further comprising at least one actuator device (25) and / or at least one sensor device (27, 28, 29); wherein actuation data is transmitted from said 2D design software program (PT) and / or said 3D graphics engine (GE) to said at least one actuation device (25) via said master device (10);and wherein control data is transmitted from said at least one sensor device (27, 28, 29) to said 2D design software program (PT) and / or to said 3D graphics engine (GE) via said master device (10).; 2. Prototyping system (1) according to claim 1, wherein said one or more serial communication interfaces (12a, 12b) comprise one or more USB modules.

3. Prototyping system (1) according to claim 1 or claim 2, wherein said one or more serial communication interfaces (12a, 12b) comprise: a first serial communication interface (12a) configured to open a first communication port with said processor (40) to exchange data with said 3D graphics engine (GE); and a second serial communication interface (12b) configured to open a second communication port with said processor (40) to exchange data with said 2D design software program (PT).

4. Prototyping system (1) according to any of the preceding claims, wherein said first (14) and said second (24) wireless communication interfaces comprise a Bluetooth module.

5. Prototyping system (1) according to any of the preceding claims, wherein said at least one actuating device (25) comprises at least one of a lighting module, preferably a LED strip (25), and a speaker.

6. Prototyping system (1) according to any of the preceding claims, wherein said at least one sensor device (27, 28, 29) comprises at least one of a button, a switch, a knob, a lever, a microphone.

7. Prototyping system (1) according to any of the preceding claims, wherein said at least one slave device (20) comprises a local power source (26) configured to power said at least one actuator device (25) and / or said at least one sensor device (27, 28, 29).

8. Prototyping system (1) according to any of the preceding claims, wherein the master device (10) comprises a status LED (15), preferably an RGB status LED, configured to provide visual feedback on the current state of the system (1).

9. Method of operating a system (1) according to any of the preceding claims, the method comprising: - designing, with said 2D design software program (PT) executed by said computer (40), a two-dimensional screen interface which is intended to be incorporated into a product; - producing, with said 3D graphics engine (GE) executed by the computer (40), a three-dimensional model of the product; - incorporating said two-dimensional screen interface into said three-dimensional model of the product to produce a virtual representation of the product; - displaying said virtual representation of the product on said virtual reality or augmented reality helmet (HS) coupled to said computer (40) and wearable by a user;- coupling said processor (40) to said master device (10) by one or more serial communication interfaces (12a, 12b) to exchange data between said 2D design software program (PT), said 3D graphics engine (GE) and said master device (10) by means of a software plugin (PL1, PL2) executed by said processor (40); - exchanging data between said master device (10) and said at least one slave device (20) by means of said first wireless communication interface (14) and said second wireless communication interface (24); - transmitting actuation data from said 2D design software program (PT) and / or said 3D graphics engine (GE) to said at least one actuator device (25) by means of said master device (10); and - transmitting control data from said at least one sensor device (27, 28, 29) to said 2D design software program (PT) and / or to said 3D graphics engine (GE) via said master device (10).; 10. A computer product, loadable into the memory of at least one processing unit and comprising portions of software code which, when executed by the processing unit, cause the processing unit to perform the steps of the process according to claim 9.