Multifunctional integrated system-on-chip for old people nursing

A system-on-chip, multi-functional technology, applied in the field of multi-functional integrated system-on-chip, which can solve the problems of low accuracy, high cost, and scattered functions

Pending Publication Date: 2021-02-09
BEIJING INSTITUTE OF TECHNOLOGYGY
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to solve the problems of limited application occasions, expensive, difficult to maintain, low real-time performance, low degree of intelligence, low accuracy and fragmented functions faced by the current large and small elderly care systems, and proposes a system for elderly care Multifunctional All-in-One System-on-Chip

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multifunctional integrated system-on-chip for old people nursing
  • Multifunctional integrated system-on-chip for old people nursing
  • Multifunctional integrated system-on-chip for old people nursing

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0116] This embodiment describes the composition, connection relationship, working process and advantages of the system of the present invention. The terms used are explained in Table 1 below:

[0117] Explanation of terms in the multifunctional integrated system-on-chip for elderly care described in Table 1

[0118]

[0119]

[0120] During specific implementation, the embedded system on chip is a PYNQ-Z2 development board; the external hardware module is an FPGA external hardware module; the schematic diagram of each module is as follows figure 1 , the hardware connection relationship such as Figure 5 . gesture recognition systems such as figure 2 Shown; when the support vector memory is implemented, by figure 2 The implementation of SV ROMn in the bias memory is implemented by figure 2 Bias ROM implementation in .

[0121] The implementation process of gesture recognition is as follows:

[0122] 1) Take pictures of the 10 gestures of the numbers "1" - "10"...

Embodiment 2

[0140] During specific implementation, the embedded system-on-chip is a PYNQ-Z2 development board; the external hardware module is an FPGA external hardware module, and the vegetable feeding system is as follows: image 3 shown. The implementation process of the vegetable feeding system is as follows:

[0141] (1) Write a python crawler code, and read 200 pictures of 4 types of dishes that need to be classified from Baidu pictures;

[0142] (2) Write an image processing function to compress the images of the four types of dishes that need to be classified into 32*32 images, and then generate a csv file. The csv file contains the storage address and label of each image;

[0143] (3) Use the pytorch official neural network programming template to import the data to be trained from the csv file, define the neural network according to the network definition method in the above invention content, and call the visdom function library to write the accuracy observation program;

[...

Embodiment 3

[0152] During specific implementation, the embedded system-on-chip is a PYNQ-Z2 development board; the external hardware module is an FPGA external hardware module; the fall rescue system is as follows: Figure 4 As shown, in the specific implementation, the binocular stereo matching operation is allocated to the PL end, which is 2 times faster than the PS end implementation. The implementation process of the fall rescue system is as follows:

[0153] a. Hold a binocular camera and shoot 21 sets of left and right synchronized images from all angles of the calibration chessboard. Use the calibration toolbox stereoCameraCalibrator in MATLAB to perform stereo calibration on the left and right cameras to obtain the external and internal parameters of the camera, and the calibration error Controlled at 0.18;

[0154] b. Use the parameters obtained by camera calibration to correct, so that the distortion caused by the reprojection of the left and right images is the smallest, and t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a multifunctional integrated system-on-chip for old people nursing, which belongs to the technical field of SOC embedded development, deep learning and computer vision. According to the system, through circuit design and control of an AliCloud server in a block debug of vivado, gesture recognition, food clamping and feeding and tumble rescue are achieved in a ZYNQ series development board, and the system specifically comprises three parts: 1) through image preprocessing and SVM prediction, gesture recognition is achieved; 2) through voice recognition, dish target candidate box extraction and face recognition, dish CNN classification prediction is carried out, and then dish clamping and feeding are realized; through fall detection and trolley control, binocular vision distance measurement is completed, and fall rescue is achieved. According to the system, the circuit design flexibility is improved, the storage resources are reduced, the calculation resources arereduced, the correctness is ensured, the speed is increased, comprehensive road condition information is provided for a user, meanwhile, the real-time performance is good, the actual use requirementis met, the occupied volume of a product is reduced, and the cost is low.

Description

technical field [0001] The invention relates to a multifunctional integrated system-on-chip for elderly care, belonging to the technical fields of SOC embedded development, deep learning, and computer vision. Background technique [0002] Population aging has become a basic national condition of our country. The "China Development Report 2020: Development Trends and Policies of China's Population Aging" issued by the China Development Foundation pointed out that since China entered an aging society in 2000, the degree of population aging in my country has continued to deepen. By around 2022, China's population over 65 years old will account for 14% of the total population, realizing the transition to an aging society. Therefore, the pension issue has become an increasingly important topic in our society. [0003] As far as the disclosed elderly care products or inventions are concerned, they are mainly divided into two types: large-scale elderly care systems and small-scal...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F15/78G06F3/01G06F8/20G06F30/39G06K9/62G06N3/04G06N3/08G06T7/73G06T7/80
CPCG06F15/7807G06F3/017G06N3/08G06F8/24G06T7/80G06F30/39G06T7/73G06T2207/20081G06T2207/20084G06T2207/30201G06T2207/30196G06N3/045G06F18/2411
Inventor 张延军黄百铖卢继华蔺彦儒林少越
Owner BEIJING INSTITUTE OF TECHNOLOGYGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products