Voice gesture acquisition device for virtual simulation experiment of potential difference meter

Abstract

The utility model discloses a voice gesture acquisition device for a virtual simulation experiment of a potential difference meter, and belongs to the technical field of virtual simulation. The recognition of voice gesture signals is realized, and the man-machine interaction in the experiment process is improved. The device comprises a voice module, a gesture module, a main control board and a data display screen, the voice module, the gesture module and the data display screen are respectively connected with the main control board; the main control board comprises a data receiving module and a data transmitting module, and the data receiving module receives voice signals collected by the voice module through serial port communication and receives gesture signals collected by the gesture module through iic communication; the data transmission module transmits the collected signals to other platforms through a serial port.

Description

Technical Field

[0001] The utility model belongs to the technical field of virtual simulation, and in particular relates to a voice gesture acquisition device for a virtual simulation experiment of a potential difference meter. Background Art

[0002] At present, university physics potential difference meter experiments mainly use traditional offline instrument experiments and online virtual simulation experiments. Traditional offline instrument experiments have insufficient instruments, high costs and are restricted by teaching venues. Virtual experiments that integrate human-computer interaction technology can avoid the various drawbacks of traditional experiments, improve the operability of experimental teaching, and allow users to have better interaction with experimental instruments. At present, the online virtual simulation experiment of the potential difference meter only relies on the mouse to operate the experimental steps, and the human-computer interaction is not strong. Summary of the invention

[0003] The utility model provides a voice gesture acquisition device for a virtual simulation experiment of a potential difference meter. The voice gesture acquisition device is constructed by STM32 to realize voice gesture control, thereby improving the human-computer interactivity in the virtual simulation experiment.

[0004] In order to achieve the above purpose, the utility model adopts the following technical solutions:

[0005] A voice gesture acquisition device for a potential difference meter virtual simulation experiment, comprising: a voice module, a gesture module, a main control board, a data display screen, and a self-made expansion board; the main control board comprises a data receiving module and a data transmission module, the data receiving module, i.e., the main control board, receives the voice signal collected by the voice module through serial port communication, and receives the gesture signal collected by the gesture module through IIC communication; the data transmission module transmits the collected signal to the potential difference meter virtual simulation host computer platform through the serial port;

[0006] The voice module uses the LD3320 voice recognition module; the gesture module uses the ATK-PAJ7620 gesture recognition module; the main control board uses the STM32F103ZET6; the data display screen uses a 2.8-inch TFTLCD touch screen;

[0007] The voice module 5V, RX, TX, and GND pins are connected to the main control board 5V, PA2, PA3, and GND respectively;

[0008] The gesture module VCC, GND, IIC SDA, and IIC SCL pins are connected to the main control board 5V, GND, PB11, and PB10 respectively;

[0009] The data display screen is connected to the main control board via an LCD interface reserved by the main control board.

[0010] The homemade expansion board leads out the 5V, PA2, PA3, and GND pins of the main control board to form a 1*4p female interface, wherein 5V and GND are power ports, PA2 is the sending pin of the serial port 2 of the main control board, and PA3 is the receiving pin of the serial port 2 of the main control board. They are connected with the voice module to realize serial port communication between the module and the main control board; the homemade expansion board leads out the 5V, GND, PB11, and PB10 pins to form a 1*4p female interface, wherein 5V and GND are power ports, PB10 is the SCL signal line on the i2c bus of the main control board, that is, the clock signal line, and PB11 is the SDA signal line on the i2c bus of the main control board, that is, the bidirectional data line. They are connected with the gesture module to realize i2c serial communication between the module and the main control board.

[0011] Beneficial effect: The utility model provides a voice gesture acquisition device for a virtual simulation experiment of a potential difference meter. The device is composed of a voice recognition module, a gesture recognition module and a main control board. The voice recognition module and the gesture recognition module serve as sensors, and the main control board serves as a data transmission hub between the sensor and the host computer to realize the transmission of voice gesture data. The device has low construction cost and high recognition accuracy. At present, the existing physical virtual simulation experiments only rely on the mouse for experimental operation, and the experimental interaction is not strong. The application of the voice gesture acquisition device can give users a better interactive immersion with the instrument. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1 This is a pin diagram of the main control board chip used in the voice gesture module in the embodiment of the utility model;

[0013] Figure 2 An LCD interface is reserved for the main control board in the embodiment of the utility model;

[0014] Figure 3 This is a pin diagram of the voice module in the embodiment of the utility model;

[0015] Figure 4 This is a pin diagram of the gesture module in the embodiment of the utility model;

[0016] Figure 5 This is a pin diagram of the data display screen in the embodiment of the utility model;

[0017] Figure 6 This is the pin diagram of the homemade expansion board in the embodiment of the utility model. DETAILED DESCRIPTION

[0018] The utility model is described in detail below with reference to the accompanying drawings and specific embodiments:

[0019] A voice gesture acquisition device for a potential difference meter virtual simulation experiment, comprising: a voice module, a gesture module, a main control board, a data display screen, and a self-made expansion board; the voice module uses an LD3320 voice recognition module; the gesture module uses an ATK-PAJ7620 gesture recognition module; the main control board uses an STM32F103ZET6; the data display screen uses a 2.8-inch TFTLCD touch screen;

[0020] The voice module 5V, RX, TX, and GND pins are connected to the main control board 5V, PA2, PA3, and GND respectively, where 5V and GND are power lines, RX is the module receiving data port, and TX is the module sending data port;

[0021] The gesture module VCC, GND, IIC SDA, and IIC SCL pins are connected to the main control board 5V, GND, PB11, and PB10 respectively, where VCC and GND are power lines, IIC SCL is the SCL signal line on the main control board i2c bus, that is, the clock signal line, and IICSDA is the SDA signal line on the main control board i2c bus, that is, the bidirectional data line;

[0022] The data display screen is connected to the main control board through the LCD interface reserved by the main control board, the data display screen DB0-DB15 is connected to the main control board FSMC_D0-FSMC_D15 respectively, the data display screen LCD_CS is connected to the main control board FSMC_NE4, the data display screen LCD_RS is connected to the main control board FSMC_A10, the data display screen LCD_WR is connected to the main control board FSMC_NWE, the data display screen LCD_RD is connected to the main control board FSMC_NOE, the data display screen LCD_RST is connected to the main control board RESET, the data display screen BL_VDD is connected to the main control board LCD_BL, the data display screen T_MISO is connected to the main control board T_MISO, the data display screen T_PEN is connected to the main control board T_PEN, the data display screen T_MOSI is connected to the main control board T_MOSI, and the data display screen T_CLK is connected to the main control board T_CLK. Among them, DB0-DB15 is a bidirectional data line interface for data transmission; LCD_CS is the reset signal pin of the capacitive touch screen; LCD_RS is the command / data control signal (0: command; 1: data); LCD_WR write enable signal (low level is valid); LCD_RD read enable signal (low level is valid); LCD_RST is the reset signal (low level is valid); BL_VDD is the backlight control pin (high level is valid); T_MISO pin is not used by the capacitive touch screen; T_PEN is the capacitive touch screen interrupt signal; T_MOSI is the capacitive touch screen IIC_SDA signal; T_CLK is the capacitive touch screen IIC_SCL signal; they work together to control the display of the display screen.

[0023] The self-made expansion board leads out the 5V, PA2, PA3, and GND pins of the main control board to form a 1*4p female interface, where 5V and GND are power ports, PA2 is the sending pin of the serial port 2 of the main control board, and PA3 is the receiving pin of the serial port 2 of the main control board; they are connected with the voice module to realize the serial port communication between the module and the main control board. The self-made expansion board leads out the 5V, GND, PB11, and PB10 pins to form a 1*4p female interface, where 5V and GND are power ports, PB10 is the SCL signal line on the i2c bus of the main control board, that is, the clock signal line, and PB11 is the SDA signal line on the i2c bus of the main control board, that is, the bidirectional data line. They are connected with the gesture module to realize the i2c serial communication between the module and the main control board.

[0024] When the gesture slides from right to left on the top of the device, that is, the gesture "left" is input, left will be displayed on the data display screen, and "left" will be sent to the host computer. When the gestures "right", "front", and "back" are input, "right", "up", and "down" are similarly displayed and sent to the host computer. When the voice speaks the command "power supply", "galvanometer", and "rheostat", the corresponding characters "dian yuan", "jian liu ji", and "bian zu qi" will be displayed on the display screen, and the corresponding digital logic signals "10", "11", and "12" will be sent to the host computer. The host computer controls the virtual software to make corresponding responses according to the input command signal.

[0025] The above are only preferred implementations of the utility model. The protection scope of the utility model is not limited to the above embodiments. All technical solutions under the idea of ​​the utility model belong to the protection scope of the utility model. It should be pointed out that for ordinary technicians in this technical field, some improvements and modifications without departing from the principle of the utility model should be regarded as the protection scope of the utility model.

Claims

1. A voice gesture collection device for a potential difference meter virtual simulation experiment, characterized in that: include: Voice module, gesture module, main control board, data display screen; the voice module, gesture module, data display screen are connected to the main control board respectively; the main control board includes a data receiving module and a data transmission module, the data receiving module receives the voice signal collected by the voice module through serial port communication, and receives the gesture signal collected by the gesture module through iic communication; the data transmission module transmits the collected signal to other platforms through the serial port.

2. The voice gesture acquisition device for the virtual simulation experiment of the potentiometer according to claim 1 is characterized in that: The voice module 5V, RX, TX, and GND pins are connected to the main control board 5V, PA2, PA3, and GND respectively.

3. The voice gesture acquisition device for the virtual simulation experiment of the potentiometer according to claim 1 is characterized in that: The gesture module VCC, GND, IIC SDA, and IIC SCL pins are connected to the main control board 5V, GND, PB11, and PB10 respectively.

4. The voice gesture acquisition device for the virtual simulation experiment of the potentiometer according to claim 1 is characterized in that: The data display screen is connected to the main control board via an LCD interface reserved by the main control board.

5. The voice gesture acquisition device for a virtual simulation experiment of a potential difference meter according to claim 1 or 2, characterized in that: The voice module uses the LD3320 voice recognition module.

6. The voice gesture acquisition device for a virtual simulation experiment of a potential difference meter according to claim 1 or 3, characterized in that: The gesture module uses the ATK-PAJ7620 gesture recognition module.

7. The voice gesture acquisition device for a virtual simulation experiment of a potentiometer according to claim 1 or 4, characterized in that: The data display screen uses a 2.8-inch TFTLCD touch screen.

8. The voice gesture collection device for the virtual simulation experiment of the potentiometer according to claim 1 is characterized in that: The main control board is STM32F103ZET6.

9. The voice gesture collection device for the virtual simulation experiment of the potentiometer according to claim 1 is characterized in that: The device adopts a self-made expansion board, which leads out the required pins to form an interface, so as to facilitate module connection.

Images