SYSTEM FOR INTERACTIVE PROTOTYPING OF PRODUCTS, OPERATION PROCEDURE AND CORRESPONDING COMPUTER PRODUCT

IT202400012409B1Active Publication Date: 2026-07-07GRANSTUDIO SPA
View PDF -1 Cites 0 Cited by

Patent Information

Application Number
IT102024000012409
Authority / Receiving Office
IT · IT
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-05-30
Publication Date
2026-07-07
Estimated Expiration
2044-05-30
Patent Text Reader
Need to check novelty before this filing date? Find Prior Art

Description

DESCRIPTION of the industrial invention entitled: “System for interactive prototyping of products, operating procedure and computer product correspondents” by: Granstudio SpA, of Italian nationality, Via Giovanni Pacini 53 - 10153 Turin - Italy Designated inventors: Klaudia WARMUS, Lukasz CZEKANOWSKI, Lowie VERMEERSCH Filed on: May 30, 2024 **** DESCRIPTION TEXT Field of invention This description relates to the systems and processes for interactive product prototyping. In particular, such systems and procedures can be used for prototyping of the interior and / or of the outside of a vehicle such as a car, but in line with principle can be used for prototyping of any type of product such as household appliances, machines industrial and similar. Technological background In the field of industrial design, the aim of prototyping is to generate a prototype (e.g., a demonstration model or “mock-up”) of the desired product that faithfully imitates the appearance and / or functionality of the final product and which reproduces a user experience realistic in the most acceptable way. Traditionally, it was customary to build models physical demonstrations of the products (e.g., the inside or the exterior of a car). However, the making of models physical demonstrations is a long and expensive process. Therefore, prototyping with the help of reality devices virtual (VR, “Virtual Reality”) and / or augmented reality (AR, “Augmented Reality”) is becoming increasingly common. Such VR / AR prototyping tools can be used in combination with physical demonstration models configurable, as described in documents EP 4222728 A1 and EP 4231191 A1 of the same Applicant, in order to provide a design system for extended reality (XR, “eXtended Reality”). Furthermore, modern products (e.g., cars) often have human-machine interfaces (HMI) which include screens and / or touch screens (“touchscreen”). Currently, there are various available design programs for creating 2D interfaces (for e.g., design and testing of appearance and functionality of a touch screen or a screen within a vehicle), but these do not allow to verify easily as these interfaces can work in real-world scenarios. On the other hand, there are programs that allow 3D prototyping in VR environments and AR, but the design of 2D interfaces within the framework of a 3D prototyping tool is often complex or completely impossible. Therefore, there is a need in technology to provide systems and improved processes for interactive prototyping plug-and-play products, which facilitate the fusion of 2D designed on-screen interfaces, of designed environments in 3D and physical (hardware) components. Summary of the invention A purpose of one or more embodiments is to provide such improved prototyping systems. According to one or more forms of implementation, this purpose can be achieved by means of a prototyping system having the characteristics set out in the claims which follow. One or more forms of implementation may be related to a corresponding prototyping process. One or more forms of implementation may be related to a corresponding computer product that can be loaded into the memory of at least one processing unit (e.g., an MCU or a CPU) and including portions of software code for carry out the steps of the process when the product is made run on at least one processing unit. As used here, a reference to such a computer product means be equivalent to a reference to a machine-readable medium computer containing instructions for controlling the unit processing in order to coordinate the implementation of the procedure according to one or more forms of implementation. A reference to “at least one” processing unit means highlight the possibility that one or more forms of implementation be implemented in a modular and / or distributed form. The claims are an integral part of the technical teaching provided here with reference to the forms of implementation. According to one aspect of this description, a system for interactive product prototyping includes a processor (or computer) configured to run a 2D design software program for design a two-dimensional screen interface that intends to incorporate into a product, run an engine 3D graphics (“engine”) to produce a model three-dimensional product, and incorporate the interface on two-dimensional screen in the three-dimensional model of the product to produce a virtual representation of the product. The system includes a virtual reality helmet or for augmented reality coupled with the computer and wearable by a user, the helmet being configured to view the virtual representation of the product. system comprises a paired master device to the computer through one or more interfaces serial communication to exchange data between the program 2D design software, 3D graphics engine and master device using a software plugin run from the processor. The master device also includes a first wireless communication interface. The system comprises at least one slave device comprising a second wireless communication interface for exchanging data with the first wireless communication interface. The at least one slave device further comprises at least one actuator device and / or at least one sensor device. Implementation data is transmitted by the software program to 2D design and / or 3D graphics engine to at least one actuator device via the master device. Data control are transmitted by at least one device sensor to the 2D design software program and / or to the 3D graphics engine using the master device. One or more forms of implementation thus facilitate seamless integration of 2D HMI interfaces virtual in 3D virtual models of products and their fusion with a physical demonstration model to improve the phase of project verification. According to another aspect of this description, a operating procedure of a system for the Interactive product prototyping includes: - design, with a software program for 2D design performed by a computer, an interface on a two-dimensional screen that is intended to be incorporated into a product; - produce, with a 3D graphics engine running from the computer, a three-dimensional model of the product; - incorporate the two-dimensional screen interface in the three-dimensional model of the product to produce a virtual representation of the product; - view the virtual representation of the produced on a virtual reality or reality headset augmented coupled to the computer and wearable by a user; - pair the computer to a master device via one or more serial communication interfaces for exchange data between the design software program 2D, 3D graphics engine and master device using a software plugin run by the computer; - exchange data between the master device and at least one slave device using the first interface wireless communication of the master device and the second slave device wireless communication interface; - transmit implementation data from the software program for 2D design and / or from 3D graphics engine to at least one actuator device of the slave device by means of the master device; and - transmit control data from at least one device slave device sensor to the software program for 2D design and / or 3D graphics engine using the master device. Brief description of the drawings The invention will now be described in detail with reference to the attached drawings, provided purely for illustrative purposes for non-limiting example, in which: - Figure 1 is a circuit diagram example of a master device for use in a prototyping system according to the invention; - Figure 2 is a circuit diagram example of a slave device for use in a prototyping system according to the invention; - Figure 3 is a circuit diagram example of another slave device for use in a prototyping system according to the invention; and - Figure 4 is an example block diagram of a prototyping system according to the invention. Detailed description of the invention As anticipated, this description describes a system and a procedure which have the purpose of seamlessly connect three design environments which are traditionally separated, that is, an environment of 2D design (e.g., a software environment) for the designing a user interface (e.g., screens or touch screens), a 3D design environment (e.g., a software environment) for designing a 3D model of the shape and / or appearance of a product in where you intend to incorporate the 2D user interface (e.g., the interior of a vehicle, such as the dashboard area), which can be visualized using VR / AR tools, and a model physical (hardware) demonstration or prototype that reproduces at least some of the shapes and / or at least some of the devices physical properties of the 3D model. By doing so, designers can effortlessly leverage a prototyping environment comprehensive and interactive that combines physical objects and digital (virtual) representations in a so-called “extended reality” (XR) prototyping system for the project verification. Basically, the process of designing and verification includes designing an interface on 2D screen (e.g., including screen layouts, transitions, animations, etc.) that is meant incorporate into a product, using a program traditional 2D interface design (e.g., ProtoPie). The design and verification process It also includes the design of a 3D model of the product (e.g., including templates), using a traditional 3D design program (e.g., Unreal Engine). The product may include, in addition to the 2D on-screen interface, physical devices additional ones that the user can interact with (e.g., buttons, knobs and the like) and / or physical devices that can affect the user experience (e.g., lights LED). By merging the 2D interface, the 3D model and physical demonstration model devices (e.g., using a virtual reality or augmented reality helmet where the 2D and 3D design environment outputs are fuse), the behavior of the 2D interface can be simulated together with the behavior of other devices, for e.g., an ambient light. For example, when checking a vehicle project, the designer could interact with a virtual touch screen that is reproduced by the VR / AR helmet in the virtual 3D model of the interior of the vehicle, superimposed on the physical demonstration model, for change some interior lighting settings. The interior lighting could then be modified accordingly. consequence in the simulated 3D model, so as to give feedback realistic to the designer. In a use case scenario, a system of design according to this description may be used in the automotive industry. A designer can carry out project verification within a immersive 3D VR / AR / XR environment, sitting on the driver's seat of the virtual car interior. While the designer navigates the digital representation, has the ability to experience form and function at the same time, visualizing the interaction between the vehicle hardware and user experience (UX). While sitting in the 3D VR / AR / XR environment, the designer can interact seamlessly with the 2D HMI prototype dedicated to the infotainment system (e.g., a display screen touch on the center console). The representation digital mirrors the dashboard controls, screens touch and interactive elements with which the driver and passengers will interact. The interface on 2D screen is embedded in the virtual 3D environment, enabling a comprehensive project review. In addition, the testing phase also does reliance on the use of real (physical) controls within of the car, created as physical prototypes in the model vehicle demonstration. These checks provide a tangible feedback to the designer, facilitating carrying out realistic tests without the need for a complete production integration at this stage. The overlapping of physical prototyping controls and of the digital 3D environment including 2D interfaces digital offers a realistic simulation of the sensation tactile and real functionality of the controls inside of the car. This approach not only speeds up the process of project iteration but also allows you to verify that the HMI integrates seamlessly into the contours of the vehicle. In another use case scenario, a system of design according to this description may be used in the aerospace and aeronautical industry. Here, a HMI designer can intervene in a simulated environment in 3D that reproduces a cockpit, can interact with 2D avionics control panels and can test the specific physical controls for aeronautics. The environment of VR / AR / XR in immersive 3D allows you to verify that the HMI design meets stringent requirements of the Air Force, while providing interaction realistic between virtual and physical elements. The implementation of these tests includes the use of physical prototypes, enabling realistic assessments without the need for a full production integration at this stage. In another use case scenario, a system of design according to this description may be used for the design of IoT and home automation devices. designer working on home devices intelligent (“smart home”) can connect IoT devices real to the prototype. This allows for testing to be carried out the integration of physical devices with interfaces digital, ensuring a continuous user experience while users interact with both the app and the hardware tangible. In another use case scenario, a system of design according to this description may be used for the design of medical devices and systems for healthcare. The HMI designer could navigate through a 3D VR / AR / XR representation immersive experience of a state-of-the-art medical facility. In virtual space, the designer could make use of it without Breakdown of 2D HMI prototypes, running tests of the usability of 2D interfaces for various medical equipment, which reflects the interfaces effective with which healthcare professionals will interact in real-world scenarios. Even in this case, the inclusion of physical prototyping controls, even if not ready for production, it allows for an end evaluation of how the HMI design aligns with the tactile and operational expectations of operators Healthcare. The immersive 3D VR / AR / XR environment allows you to verify that the HMI design meets the stringent usability standards expected in healthcare settings and integrates seamlessly interruption with the physical tools used by doctors. The inclusion of physical controls enhances the realism of the testing phase. Therefore, the system and procedure described here can be used for the design of any industrial product, from means of transport to appliances, machines, devices for industry health and similar. For ease of explanation, below reference will be made mainly to the field of design in the automotive field, and in particular to car interior design. The prototyping system according to this invention is based on a hardware platform that works as a bridge that connects the 3D environment, created within the framework of a graphics engine (or rendering, 3D engine, game engine) standard in industry, and complex 2D HMI prototypes (e.g., functionality and screen layout), created within the 2D HMI prototyping tool framework industry standards. Designers can thus take advantage of the benefits of both software environments (3D and 2D) without encountering constraints or compatibility problems. The hardware platform bridging functionality is provided from a two-way communication channel established between the 3D graphics engine and the 2D prototyping tool. In addition, the hardware platform allows you to connect the mixed 3D / 2D environment with world-class hardware components real (e.g., to superimpose the representation from the 3D / 2D digital environment to the demonstration model physical hardware using an augmented reality headset). So, designers can perform integration tests of physical controls of devices within the environment prototyped. Physical controls and devices include buttons, switches, knobs, levers and other interfaces tangible, but not limited to these. Physical controls can be controls for prototyping (i.e., not intended for complete production), which provide each way a realistic evaluation of the user experience. Relying on the fusion of controls for the physical prototyping within the AR environment in 3D / 2D digital, designers can rely on a interactive design process without the need for a full production integration at this stage. This feature is particularly advantageous, in the to the extent that it offers a practical approach to refining the designs based on real-world interactions, and accelerates the design iteration process ensuring the while the hardware and software components harmonize with continuity. The prototyping system according to this The invention comprises a main PCB or a device main, which functions as a master device, and a or more secondary PCBs or secondary devices, which function as slave devices. Figure 1 is an example circuit diagram of a possible architecture of the master device 10. The master device 10 comprises a PCB 11 which is coupled to a first serial communication module 12a (e.g., a USB module), a second 12b serial communication module (e.g., a USB module), a level shifter circuit 13, a wireless communication module 14 (e.g., a Bluetooth module), and a status LED 15. The first module of serial communication 12a is coupled to a first channel of PCB 11 communication (e.g., a transmit pin TX1 and a receive pin RX1 of PCB 11), and it is also coupled to the GND (i.e., ground) power pins and 5V (i.e., providing a supply voltage of 5 V) of PCB 11 to be powered by them. The second 12b serial communication module is coupled to a third party communication channel of PCB 11 (e.g., a pin of transmission pin TX3 and a reception pin RX3 of PCB 11), and It is also coupled to the GND and 5V power pins of the PCB 11 to be powered by them. The translator circuit Level 13 has a high voltage communication channel (e.g., at 5 V) coupled to a second channel of PCB 11 communication (e.g., a transmit pin TX2 and a receive pin RX2 of PCB 11), and a channel of low voltage communication (e.g., 3.3 V) coupled to the communication channel of the Bluetooth module 14 (e.g., a transmit pin TXD and a receive pin RXD of the Bluetooth module 14). The level shifter circuit 13 It is also coupled to the GND, 5V and 3V3 power pins of PCB 11 (the latter provides a voltage of power supply equal to 3.3 V) to be powered by them, and is configured to translate and pass signals between the Bluetooth module 14 and the PCB 11 (i.e., between the second communication channel of PCB 11 which operates at 5 V and the Bluetooth module communication channel 14 that works at 3.3 V). The Bluetooth module 14 is also coupled to the pins of GND and 3V3 power supply of PCB 11 to be powered from them. The status LED 15 can be, for example, an LED RGB having a cathode terminal coupled to the pin of GND power supply of PCB 11, and three anode terminals (one for each LED) coupled to a respective terminal PCB 11 control (e.g., numbered 1, 2, 3), possibly using (discrete) resistors. The status LED 15 can provide visual feedback on the current status of the system, improving user interaction and capabilities of fault detection. Figure 2 is an example circuit diagram of a possible architecture of a slave device 20. The slave device 20 comprises a PCB 21 that is coupled to a level 23 translator circuit, a module of 24 wireless communication (e.g., a Bluetooth module) and a 25 LED strip. The 23 level shifter circuit has a high-voltage communication channel (e.g., 5 V) coupled to a communication channel of PCB 21 (for e.g., a transmit pin TX1 and a receive pin RX1 of PCB 21), and a low voltage communication channel (e.g., at 3.3 V) coupled to the communication channel of the Bluetooth module 24 (e.g., a TXD transmit pin and a RXD receive pin of the Bluetooth module 24). The circuit level 23 translator is also coupled to the pins of GND, 5V and 3V3 power supply of PCB 21 (which provide respectively a ground voltage, a voltage of 5V power supply and a supply voltage of 3.3 V) to be powered by them, and is configured to translate and pass signals between the Bluetooth module 24 and PCB 21 (i.e., between the communication channel of the PCB 21 which operates at 5V and the communication channel of the module Bluetooth 24 (which operates at 3.3 V). The Bluetooth 24 module It is also coupled to the GND and 3V3 power pins of the PCB 21 to be powered by them. The LED strip 25 has a ground terminal coupled to the power pin GND of PCB 11 and a control terminal coupled to a respective control terminal of PCB 21 (e.g., numbered as 1), possibly by means of a resistor (discreet). In addition, the 25 LED strip has a terminal power supply coupled to the positive terminal of a battery 26 or a battery pack (e.g., a 26V battery) 5 V, possibly including one or more AAA batteries or a 5V power bank), and the ground terminal of the strip LED 25 is also coupled to the ground terminal of the battery 26. Incorporating a power source, the slave configuration ensures portability and autonomy, allowing the LED strip to function regardless of the availability of sources of external power supplies. Figure 3 is an example circuit diagram of another possible architecture of a slave device 20. The slave device 20 comprises a PCB 21 which is coupled to a level 23 translator circuit, a module of wireless communication 24 (e.g., a Bluetooth module), a first button 27, a second button 28 and an encoder rotary 29. The level 23 translator circuit and the module Bluetooth 24 are paired to PCB 21 and to each other as described previously with reference to Figure 2. The button 27 has a ground terminal coupled to the pin of GND power supply of PCB 21 and a positive terminal coupled to a respective sense terminal of PCB 21 (e.g., numbered with 1), possibly by means of a resistor (discrete). Similarly, button 28 has a ground terminal coupled to the GND power pin of PCB 21 and a positive terminal coupled to a respective sense terminal of PCB 21 (e.g., numbered with 2), possibly using a (discrete) resistor. The rotary encoder 29 has a ground terminal coupled to the PCB 21 GND power pin, a positive terminal coupled to the 5V power pin of PCB 21 and detection terminals coupled to three respective sense terminals of PCB 21 (e.g., numbered as 3, 4, 5). From a functional and operational point of view, the system of prototyping according to the present invention can be described with reference to the block diagram in Figure 4, which exemplifies data connections between various components of the system. The prototyping system 1 comprises a master device 10 and one or more slave devices 20 paired with respective hardware devices 25, 27, 28, 29 (e.g., as exemplified in Figures 2 and 3). The master device 10 and slave devices 20 use their wireless communication modules 14, 24 (e.g., modules Bluetooth) to exchange data between them. The master device 10 uses its first serial communication module 12a (for e.g., USB module) to exchange data with a computer 40 and open a first communication port (COM port) for communicate with the GE graphics engine. The master device 10 uses its second serial communication module 12b (e.g., USB module) to exchange data with the computer 40 and open a second communication port (COM port) to communicate with the PT prototyping tool. During operation, the processor 40 runs both the engine GE graphics (e.g., a standard game engine in industry) is the tool for HMI prototyping in 2D PT (e.g., 2D prototyping software industry standard). The GE graphics engine communicates with the master device 10 via a first software plugin PL1 which acts as a bridge between the master device 10 and the GE graphics engine. The PL1 plugin uses a library or a protocol (e.g., Socket.IO) to incorporate a communication and open a communication port (port COM) which serves as an interface to the module communication 12a of the master device 10, facilitating the data exchange between two ports with a single PCB. The first PL1 software plugin also allows for output streaming from the 2D prototyping tool to the GE graphics engine in the form of a dynamic image, which can be applied to a 3D model. This way, the real-time output from the 2D prototyping tool PT is also visible in a VR / AR HS helmet coupled to the processor 40. Ad example, a UI designed in the tool for 2D PT prototyping is visible on a virtual screen in 3D in the GE graphics engine. The prototyping tool of HMI in 2D PT communicates with the master device 10 using a second PL2 software plugin that acts as a bridge between the master device 10 and the instrument for HMI prototyping in 2D PT. The PL2 plugin uses a library or protocol (e.g., Socket.IO) to embed a communication (i.e., sending and receiving messages between the PT prototyping tool and master device 10) and to open a COM port that serves as an interface to the second communication module 12b of the master device 10. Therefore, the master device 10 facilitates usability instantaneous thanks to a connection to the computer 40 via serial communication ports (e.g., USB), providing a seamless plug-and-play user experience interruption and convenient. Furthermore, the processor 40 is connected to a VR / AR HS helmet (or a “head-mounted display”) which receives graphic information from the engine GE graph and / or from the HMI prototyping tool in 2D PT to reproduce the model on the HS helmet display 3D of the vehicle interior and the appearance of a screen 2D HMI of the vehicle interior fused together. So, in short, while the communication ports between the master device 10 and the processor 40 are open, messages are transmitted between the two design tools (i.e., the 3D engine and the 2D tool), allowing them to communicate with each other. Implementing modules wireless (e.g., Bluetooth) in master and slave devices allows each slave device to send messages to the master and receive them from it, which then sends messages to the, and receives messages from the GE game engine and to / from 2D PT prototyping tool. Therefore, they are facilitate data exchange and synchronization efficient between software and hardware components. Depending on of the needs of the application or project, the number of 20 slave devices in system 1 may vary, and so can vary the number of Bluetooth modules 14 paired to the master device 10. For example, if more than one is in use slave devices, a corresponding number of modules Bluetooth will be paired to the master device for ensure communication efficiency. The devices slaves may not communicate directly with each other others, but, if necessary, they can exchange messages through the master device, which acts as a intermediary. In addition, each slave device 20 is connected to a matching hardware according to the requirements of the application or project. For example, a device slave can manage a LED strip (as exemplified in the Figure 2), while another slave device can operate various buttons (as exemplified in Figure 3). The LED strip can be controlled by master device, offering versatile functionality such as management power (on / off), selection of colors and animation control. The LED strip can thus be controlled not only by signals coming from the hardware components (such as buttons), but also through data from the embedded 2D HMI prototype in the VR / AR / XR environment and operated by the user who wears the HS helmet, or data from interactions of the user with the 3D environment. The fact of providing both sensors (e.g., buttons, knobs) and actuators (e.g. e.g., LED strip) paired to slave devices 20 This allows interactive control over various parameters of the virtual model of the car interior. For example, during the testing phase, the brightness of the strip LED can be adjusted by the user by acting on a knob physics, or by acting on a virtual cursor reproduced on a virtual screen from the HS helmet. Similarly, the effect of This change can be reflected both in the real environment (actually adjusting the brightness of the LED strip) both in the AR / VR / XR environment, providing feedback in real time inside the 2D prototype. The inclusion of physical controls thus expands the range of control possibilities, allowing for precise adjustments and an intuitive interaction with both physical and digital. The provision of a master device 10 that communicates with 20 slave devices as well as with the processor 40 allows you to accept user input from various sources, including virtual reality environments, 2D prototypes and direct interactions with hardware. This input ecosystem various allows the user to interact with the system prototyping 1 in multiple ways, offering flexibility and versatility in the prototyping process. Another example of the functionality of the system prototyping described here is the support of a control voice. For example, one of the slave devices 20 can be paired with a microphone to capture the user's voice. Voice input can be activated by the user by pressing a button (be it a physical or virtual one). When the voice input function is activated, the System 1 processes voice commands within the environment target, regardless of whether it is a simulation of virtual reality or a 2D prototype. Of course, the construction details and shapes of implementation may also vary significantly compared to what has been described and illustrated by way of for example, without going beyond the scope of protection of the present invention as defined in the claims which follow.

Claims

1. System (1) for interactive prototyping of products, comprising: - a computer (40) configured to run a 2D design software program (PT) to design a two-dimensional screen interface intended to be incorporated into a product, run a 3D graphics engine (GE) to produce a three-dimensional model of the product, and incorporate said two-dimensional screen interface into said three-dimensional model of the product to produce a virtual representation of the product; - a virtual reality or augmented reality headset (HS) coupled to said computer (40) and wearable by a user, the headset (HS) being configured to display said virtual representation of the product;- a master device (10) coupled to said processor (40) by one or more serial communication interfaces (12a, 12b) for exchanging data between said 2D design software program (PT), said 3D graphics engine (GE) and said master device (10) by means of a software plugin (PL1, PL2) executed by said processor (40), the master device (10) further comprising a first wireless communication interface (14); - at least one slave device (20) comprising a second wireless communication interface (24) for exchanging data with said first wireless communication interface (14), the at least one slave device (20) further comprising at least one actuator device (25) and / or at least one sensor device (27, 28, 29); wherein actuation data is transmitted from said 2D design software program (PT) and / or said 3D graphics engine (GE) to said at least one actuation device (25) via said master device (10);and wherein control data is transmitted from said at least one sensor device (27, 28, 29) to said 2D design software program (PT) and / or to said 3D graphics engine (GE) via said master device (10).; 2. Prototyping system (1) according to claim 1, wherein said one or more serial communication interfaces (12a, 12b) comprise one or more USB modules.

3. Prototyping system (1) according to claim 1 or claim 2, wherein said one or more serial communication interfaces (12a, 12b) comprise: a first serial communication interface (12a) configured to open a first communication port with said processor (40) to exchange data with said 3D graphics engine (GE); and a second serial communication interface (12b) configured to open a second communication port with said processor (40) to exchange data with said 2D design software program (PT).

4. Prototyping system (1) according to any of the preceding claims, wherein said first (14) and said second (24) wireless communication interfaces comprise a Bluetooth module.

5. Prototyping system (1) according to any of the preceding claims, wherein said at least one actuating device (25) comprises at least one of a lighting module, preferably a LED strip (25), and a speaker.

6. Prototyping system (1) according to any of the preceding claims, wherein said at least one sensor device (27, 28, 29) comprises at least one of a button, a switch, a knob, a lever, a microphone.

7. Prototyping system (1) according to any of the preceding claims, wherein said at least one slave device (20) comprises a local power source (26) configured to power said at least one actuator device (25) and / or said at least one sensor device (27, 28, 29).

8. Prototyping system (1) according to any of the preceding claims, wherein the master device (10) comprises a status LED (15), preferably an RGB status LED, configured to provide visual feedback on the current state of the system (1).

9. Method of operating a system (1) according to any of the preceding claims, the method comprising: - designing, with said 2D design software program (PT) executed by said computer (40), a two-dimensional screen interface which is intended to be incorporated into a product; - producing, with said 3D graphics engine (GE) executed by the computer (40), a three-dimensional model of the product; - incorporating said two-dimensional screen interface into said three-dimensional model of the product to produce a virtual representation of the product; - displaying said virtual representation of the product on said virtual reality or augmented reality helmet (HS) coupled to said computer (40) and wearable by a user;- coupling said processor (40) to said master device (10) by one or more serial communication interfaces (12a, 12b) to exchange data between said 2D design software program (PT), said 3D graphics engine (GE) and said master device (10) by means of a software plugin (PL1, PL2) executed by said processor (40); - exchanging data between said master device (10) and said at least one slave device (20) by means of said first wireless communication interface (14) and said second wireless communication interface (24); - transmitting actuation data from said 2D design software program (PT) and / or said 3D graphics engine (GE) to said at least one actuator device (25) by means of said master device (10); and - transmitting control data from said at least one sensor device (27, 28, 29) to said 2D design software program (PT) and / or to said 3D graphics engine (GE) via said master device (10).; 10. A computer product, loadable into the memory of at least one processing unit and comprising portions of software code which, when executed by the processing unit, cause the processing unit to perform the steps of the process according to claim 9.