Systems and methods for performing matrix multiplication with a plurality of processing elements

Abstract

In a system with control logic and a processing element array, two modes of operation may be provided. In the first mode of operation, the control logic may configure the system to perform matrix multiplication or 1x1 convolution. In the second mode of operation, the control logic may configure the system to perform 3x3 convolution. The processing element array may include an array of processing elements. Each of the processing elements may be configured to compute the dot product of two vectors in a single clock cycle, and further may accumulate the dot products that are sequentially computed over time.

Description

[0001]. .. . ,, , - , . , . , . , , . , , . . , . . ., , ,, .aen caon . , ., , . ., , ., , . , . . . , . . , , . . , , , , . , , . aen caon . , , . .. . . ,. , . . , ^^ ^^ ^^ ^^ ^ ^^^ ^^ aen caon , ^ ^^ ^ ^^ ^ ^^ , ^ ^^^ ^^ ^^ ^^ . . . , ^^,^^,^^,^^,^^^^,,^^^^,,^^^^,,^^^^,,'.^ ^ ^^^^,,,^ ^ ^^^^,,,^ ^ ^^^^,,,aen caon ^ ^ ^^^^,,,^ ^ ^^^^,,,^ ^ ^^^^,,,. . , . , , . , ,,, , , , , , , , , , , , , , , aen caon , , , , . ,. , , , ,, , ^ ^^^ ^ ^^^ ^ ^^ ^ ^^ , , , , ^ ^^^ ^ ^^^ ^^ , , ^ ^^^ ^ ^^ ^ ^^ , , aen caon , , , , , ^^,^^,^^,^^,^^,^^,^^,^^ ,^^,,^^, ^^, ^^,,'^ ^ ^^^^,,,^ ^ ^^^^,,,^ ^ ^^^^,,,, , ^ ^ ^^^^,,,^ ^ ^^^^,,,^ ^ ^^^^,,,. , . , ,, ,aen caon ., .., .., ,, , , , .., ,. ,...,., , , .., , . , .., . .., .., . , , . .. , , , , , , . ..,.., ..., ,, , , .. , , , .., . .., , ,aen caon , . , .., . .., .., . , . . , . , . , , . , . , . , . , . . , , , .aen caon - , ., , , - ., . , , , - . . , , . , -, , - . , . , -, . , . , . , . , . , aen caon . , , -. . . , , . . . .. , ,^^ ,. ^^.… , ^^' , , ^^, … ,“, . , ^^,*” ^^^^*. . . . --, ^^, . , - . , , -, ^^*-, . , , aen caon - - . . , . , . .., . . , , , . , , , . , , , . , . , ,, . . , “.” ,., .., “ ” , . .., ,, “ ” . aen caon “” “ ” . , , , . , , , , ,. , ,, , . , , , , ,, . , , , .. . ,, “ “” ,” , .., . . . , , . . - , . , ..,aen caon , - - , , .- , -- - - - - - - - - - -, “”-. “ ” . “ ” “” . , , - -, - - , . , ,, . . , , , , , . . , , , . . . , , . , . 2 - -,1- -,aen caon4- -, - -,, . “” . ,,.., . , , . , .. . - ,..,- .- , ,, - - - ., - , “ “ ”” . “ ” “ ” , -. , - - , - . ,., , ,. , , . . aen caon , “-”, . , , ^^ ^^ , , ^^ . , ^^ .. “ ” , ^^ . . , ^^ ^^ , ^^ ^^ , ^^ ^^ , . ^^ ^^. , . ,, ^^* . .., ^^ ^,^ …, … , ^ ,^+ ^,^+ ^^, … , ^^+. ^^, … , ^^+.. ., , ,*aen caon ,, * . . ,^^, … , ^^+. ,.., ^^, … , ^^+ ..,. . , --. –, - , …, , , …, . , , …, .., .., ^^, … , ^^+ ., ^^, … , ^^+^. . , ^^,,,..., -^^ =.,,,. ^^ , . aen caon . , , .. , , .. . *,- , ,, …, . . , , …, , ,, …, . …, - . ,, 4,..,,12,1,2-,24,2,2, .., - , “” ,.4. , , ,7,11,1,1,2,27,1, , .7. “” , ,2,,1,14,1,22,2, , aen caon , .2. “ ” , ,1,,,1,17,21,2,2, ,.1. “ ” , ,4,44,4,2,,,4, , 12 1. “” , . , , , “ ”1,2,,4 17,1,1,2. 1,2, . . ,1,2,,417,,14,1,2,.17,1,1,2“ , ”1,,2,,4,,,,7, . , ,. ,,7,1,2,,4. ,1,2,, . ,4,7, aen caon1,2,,4.., ^^^^ ^^ 1,2,,4.^.^,^^^^ ^^^^1,,7, .., ^^^^, ^^, .^ 12,,4.^,- ^^^^. ^^^^21,2,,4.., ^^.^^ ^^^ 17,1,1,2.^.,^^+^^ ^^^^,,7, .., ^^.^^, ^^^^- ^^+^^. ^^^^ 17,1,1,2..,4. , , ,,4,47,1,,, , , . . 11 1“” ,,, ,,7,21,22,,2,24.. , ,,21,7,22,2,24,.21,72,2,2,24,1,2,,4,,,,, . ,7, ,,,7,12 4. , 1,2,,4.., ^^,^^ ^^,,7, .-^.^,^^.^^ ^^^^aen caon,,7, .., ^^,^^, ^^.-^.^,- ^^.^^. ^^^^,,7, 1,2,,4.., ^^^^ ^^^ 21,22,2,24.^.,^^^^ ^^^^7,,7, .., ^^^^, ^^^ 21,22,2,24.^-.,^^^^. ^^^^. , ,4,,42,4,,4,,2, , .1 14. “” ,,1,11, ,1,11,12 2,2,,27,2. . , ,,,212,2,27,2,21,1,11,2.2272,1,2,,4,,,,7, . ,,7,1,2,,4. , 1,2,,4.., ^^+^^ ^^^^,1,11,1..,^^^^ ^^^^ 2,,7, .., ^^+^^, ^^^^-,1,11,12..,^^^^. ^^^^1aen caon1,2,,4.., ^^,^^ ^^-^ 2,2,27,2.^.,^^.^^ ^^^^11,,7, .., ^^,^^, ^^-^^- ^^^^ ^^^^ 2,2,27,2..,.. 12. , , ,7,41,4,4,,7, 1, , .1. “” , ,,, ,, 1,14,1,1 11411 2,1,2. . , ,,2,,1,2,1,14,1,,1.2 12, ,,, , ,12 4,,,7, . ,,7,12,,4. , 1,2,,4.., ^^^^ ^^^ 1,14,1,1.^.,^^,^^ ^^-^^1,,7, .., ^^^^, ^^^ 1,14,1, .^-.,^^,^^. ^^-^^ 1141,2,,4.., ^^+^^ ^^^ 2,,, .^.,^^^^ ^^^^ 121aen caon,,7, .., ^^+^^, ^^^.^-.,^^^^. ^^^^ 2,,1,21. , , ,72,7,,4,,2, ,, . .2 24“” , ,4,,,4,,4,,,1,2. . ,4,,1,2, ,,4,, .4,1,2, , 1,14,1,1,1,11,12,1,11,12,1,14,1,1., , . . , , -., , “” . ,1,11,12.., ^^^^+ ^^^^ ^^^^ ^^^^,,4,, ,,, -.. 1,^^ ^^.aen caon1,14,1,1.., ^^^^ ^^^^,^^,^^, ^^-^^-,,4,, .., 2,^^ ^^,1,11,12.., ^^+^^+ ^^,^^ 4,,1,2,^^,,^^ ^^,^^,.., ^^ ^^+1,14,1,1.., ^^+^^ ^^,^^ ^^^^ ^^^^, 4,,1,2,, , , -,.., 4,^^ ^^ . ^^'^^^ =… , - ^… , ^^ ^^ aen caon ^^ , ^ ^^^ ^^^^*^ ^^^ ⋯ ⋯ ^^ ^^^^ ^^…^^^^^^* ^^ =…^^, ^^ =. . “ , , ” - ., , , - . “,, ” , . -,. , , , - ,, . , , . , , , . ,. , aen caon “ .” , . , , , . , . , , .., ,. , . , . . . , , . , , . , , , - . . - , , -, . , ==^^^^^^^^^^^,^^^^-^^^^^^^^^^^^^^^^=^^.^^^^^^^^+^^^^^^^^,^^^^-^^^^.^^^^^…^^^^^^^^^^^^^^^^^^+^^^^^^^^^^^^aen caon ^ ^ ^^ ^^^^+^ ^ ^ ^^^^ ^ ^ ^^ , , ,, , -, . , - . ,, , ,, , ,, , . . , . , , ,. , , , , , “ ” - ..,, . , , aen caon . -,, .-., -, -, ., . , , . , , . , , . , .., , , . - . , , , , . ,, ,, . , . . , , “ ” , . , , .., , . ,aen caon , , .., , . - , , , , ,. , , . . . , , ,, , . “ ”, . ” . , “- “- ” , , . “ ” ... , , , ,, - . - , - . , . , , , . aen caon - , , . , -. ^^^^,, ^ ^^^,,^ ^^^,,^ ^^^,,^ ^^^,,^ ^^^,,^ ^^^,,^ ^^^,,^ ^^^,,^ ^^^,,^ ^^^,,,,^ ^ ^^^^,,,.^ ^ ^^^^,,,,^ ^ ^^^^,,,-+, , ^ ^^ ^^ ^ ^^ ^^ , , . , , , . ^^^, . ^aen caon^^, ^^,.^^, ^^,- , -. ^^ = ^^, ^^,^^ ^,^, ^^, ^^, ^^, ^^, ^^,, ^^, ^^,- ^^,.^^^^,+^^ = ^^, ^^, ^^^,^ ^^, ^^, ^^, ^^, ^^, ^^, ^^,, ^^, ^^,^^^ ^ -^,. , ^,+^^ = ^^,, ^^,^^, ^,^,, ^^^,^ ^^,, ^^,, ^^, ^^,,, ^^, ^^,,- ^^,,.^^,,+^^ = ^^, ^^,, ^^^,^,,. ^^,,^ ^^^,,, ^^,,^^,, ^+^, ^^,, ^^, ^^,,, ^^, ^^,,-^^ ^^, = ^^, ^^, ^^^,^,. ^^,^ ^^^, ^^,^^ ^^, ^^, ^^, ^^,, ^^, ^^,-^^, , ,+^^- = ^^, ^^, ^^^,^ ^^,^ ^^,, ^^, ^^, ^^, ^^, ^^,, ^^,, ^^,-^^-,. ^, ^^,+^^. = ^^, ^^,, ^^^,^,,. ^^,,^ ^^^,,, ^^,,^^,, ^+^, ^^,, ^^, ^^,,, ^^, ^^,,-aen caon ^^.^^ = ^^, ^^,, ^^^,^,,. ^^,,^ ^^^,,, ^^,,^^ ^^, ^^,, ^^, ^^,,, ^^,, ^^,,-^^, ,,+. , . - , . , , , ,. - . ^^ ^^^^,,, ^ ^ ^^^^,,^^ ^^, ^^ ^^ ^^ ^ ^^^,^ ^^^,,^^,,^ ^^,^,,^ ^^,^^ ^,,^,^^,^^,^ ^^^^,,,,,,aen caon ^ ^ ^^^^,,.^ ^ ^^^^,,^ ^ ^^^^,,-+, , ^ ^ ^ , , . - , -. . -^^+, … , ^^-. ^, …, ,- , . , , , ,. - . ^^ ^^^^,, ^ ^^^,,^^, ^^^^,^ ^^^,,,^ ^^^,,,^ ^ ^^^^,,,aen caon ^ ^ ^^^^,,^ ^ ^^^^,,^ ^ ^^^,,^^,^^,^,^ ^^^,,,^ ^^^,,,^ ^ ^^^^,,,,,,^ ^^ ^^ ^ ^^ ^^ , , ^^ ^^ ^^ , , . - , -. -^^., … , ^^. ., …, ,. , . , , , , , …, . . . - , ., . aen caon ,, - . - . - - - - - - - - - - - .- - . ,-,- --,- - , , , -,- - ,. -,- - - - - - - , - . - -,- - - - - - - . - -aen caon ,- , , , .., . , , . - - , . , , ,. , . ..,-. . . aen caon -,- , . - .- . - - - . - . - . - . - . - . - . - . . - - , , - - . - -, - -. , ..,- - . , , aen caon ,,,, . , ., . , , “” “” . - -. ,, , , ..,- . , , - , . . , ..., “ ” ,-,- - . , “ ” - , ,, - . - , “- ,, , , ” , ,, . .., -,- -. aen caon , . , , .- - , - - - -. -1-2, ,- -. , , , 12- -1,2. , - - - -. , , -- - -. , - - -. , - . - , .., - - ., - , -. ,- , ^^,, ^^,, ^^,, ^^,,- . , , ^^,, ^^,, ^^,, ^^,, ^^,, aen caon ^ ^^^,^ ^^^,^ ^^,, , ,^^,,- ^^,,^^,,^^^,,^^, ^^, ^^, , ^^,, ^^,, ^^,, ^^,, ^^,, ^ ^ ^^^^,,^ ^ ^^^,,^ ^^^,,^^,, ^^,,, ^^,,, ^^,,,-,^,^^,, ^^,, ^^,, ^^,, ^^,, ^^,, ^ ^^,^^,^^,,, ^^^,,^ ^^^,,^ ^^^,,,,, . , - , ^^, ^ , ^^,,,,^,^^, ^^ ^ ^^^,,, ^^,^^,, , ..., , .- .., , , , , .. , , , , , . aen caon .., , , , . , .,., , . , , . . , . . -, . , -, , , ,. . , , .. . .,.., .., . . , .., ,. . ..,, aen caon . ,, , .. , . . , ,, . =* .. , , ., , . , . , , .. ,, , , , , . , ,. , .. , , , .. -aen caon , , . . ,aen caon

Claims

. , , , , ,, , . . , aen caon, , , , , . ,. . , ,., ,- -, . ., , .. , . . . , , . , aen caon– , , – . . , , , , , , , , , , , , , , , , , , , , , , , , . aen caon. , , , , , , , , , , , , , , , , , , , , , , , , . ,. . , ,., , - -, .., , . aen caon. ,, . . , – – –. aen caon

Images