Audio and video data acquisition system based on NAO robot

A technology of data acquisition system and robot, which is applied to the components of TV system, TV, color TV, etc., and can solve the problems that audio and video collection systems cannot be transferred and used with each other

Inactive Publication Date: 2019-06-14
TIANJIN UNIV
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The programming interfaces of various types of robots are different, and the audio and video collection systems of other robots cannot

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Audio and video data acquisition system based on NAO robot
  • Audio and video data acquisition system based on NAO robot
  • Audio and video data acquisition system based on NAO robot

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0023] A graphic interface audio and video data collection system based on NAO robot, see figure 1 , the system consists of the following parts:

[0024] Audio collection module: control the robot to collect audio data, select the sound channel, and transmit the collected data to the PC side of the running system for optional path storage.

[0025] Video collection module: control the robot to collect video data, display the camera image in real time and transmit the collected data to the PC side of the running system for optional path storage.

[0026] Audio and video collection module: control the robot to collect audio and video data at the same time, select the sound channel, display the image of the camera in real time, and transmit the collected data to the PC side of the running system for optional storage.

[0027] Audio playback module: select the recorded and saved audio files to play for users to view.

[0028] Video playback module: select the recorded and saved...

Embodiment 2

[0041] Combined with the specific operation steps below, Figure 2-Figure 4 The scheme in Example 1 is further introduced, see the following description for details:

[0042] Step S0101: collect audio data, select a channel, and transmit the collected data to the PC running the system for saving in an optional path, and the recorded time can be displayed during the collection process.

[0043] The robot connection principle is to use the ALAudioRecorderProxy interface in the NAOqi API (known to those skilled in the art, the embodiment of the present invention will not repeat this), create this class, and the parameters are the robot IP address and port;

[0044] The principle of controlling the robot to record audio data is to call the ALAudioRecorderProxy interface in NAOqiAPI;

[0045] The FtpWebRequest and FtpWebResponse interfaces of FTP transmission are used to store the data to the PC (known to those skilled in the art, and the embodiment of the present invention will n...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an audio and video data acquisition system based on an NAO robot. A binocular camera and a microphone of the NAO robot are controlled to collect audio and video data. The system comprises an audio collection module used for controlling the robot to collect the audio data, select a sound channel and transmit the collected data to a PC terminal to store a selectable path; a video collection module used for controlling the robot to collect video data, displaying camera images in real time and transmitting the collected data to the PC end to store optional paths; an audio and video collection module used for controlling the robot to simultaneously collect audio and video data, select a sound channel, display an image of the camera in real time, and transmit the collected data to the PC end to store a selectable path; an audio playing module used for selecting and playing the recorded and stored audio file for a user to check; and a video playing module used for selecting the recorded and stored video file and playing the video file for a user to view.

Description

technical field [0001] The invention belongs to the technical fields of human-computer interaction, software development and communication, and relates to NAO (humanoid intelligence) robot audio and video collection technology and data end-to-end transmission technology, in particular to an audio and video data collection system based on NAO robot. Background technique [0002] At present, in terms of the robot audio and video data collection system, in China, Shandong University is based on the audio and video data collection of underground detection robots, and this collection system cannot be migrated to the audio and video data collection of NAO robots, and the modularization and engineering of the system There are still deficiencies in chemistry. Southeast University is based on the audio and video data collection of micro-reconnaissance robots, and the system cannot be migrated to the platform of NAO robots. [0003] In foreign countries, the audio and video collectio...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N5/232H04N5/91H04N5/92G06F3/16
Inventor 罗韬魏一凡赵满坤高洁于健喻梅于瑞国应翔高钟烨
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products