https://eureka.patsnap.com/resources/blog/rd-blog/knowledge-distillation-techniques-patent-landscape/ · Patsnap · data cut-off 2026-07-31 · downloaded from the live page
Patent Landscape · Model Compression
Knowledge Distillation Patents: Mapping the Field
  • 16.6% concentration at the top. The five most active filers account for 111 of 667 records in scope — a leader well ahead of the field, then a long tail of single- and few-filing entrants.
  • Filings kept climbing through the last complete year. 2021 to 2024 filings rose 32%, from 81 to 107 — momentum sits in claim volume, not in a maturing, slowing field.
  • G06N dominates, but the healthcare and speech branches stay thin. 80.5% of records touch AI-model computing (G06N), while healthcare informatics (G16H) reaches only 4.2% — a visible gap between the general technique and applied domains.
Get a prior-art report on your approach
667
Published Records
17%
Top-5 Share of All Records
+32%
Filing Growth 2021→2024
CN
Leading Jurisdiction

Filing growth compares 2021 (81 records) with 2024 (107) — a three-year span. 2024 is the most recent year we treat as complete: publication lags filing by roughly 18 months, so 2025 onwards are still filling in and any growth rate that ends there would understate the field. Top-5 share is the combined record count of the five largest assignees divided by all 667 records in scope (CR5), not by the ranked leaders only.

Published byPatsnap Research··7 min readSourced from Patsnap Eureka
Overview

What the knowledge distillation patent record shows

Knowledge distillation covers a specific family of claims: a smaller student model trained against the outputs, logits or intermediate features of a larger teacher, typically softened by a temperature parameter or matched at the feature level. The search underlying this page combines those mechanism terms with a second layer — temperature scaling, soft labels, capacity gap, data-free distillation — to separate genuine distillation art from adjacent model-compression filings that only mention teacher-student training in passing.

667 records fall in scope across the 2015-2026 window this dataset covers, concentrated heavily in computing-based-AI-model classifications but reaching into image recognition, speech processing, and a smaller set of applied domains such as healthcare informatics. The filing curve rises through the last complete year, and the assignee ranking shows one clear leader ahead of a broad, moderately active field.

Filing activity and technology composition, 2015-2026
  1. 1INTERNATIONAL BUSINESS MACHINE CORPORATION44
  2. 2HUAWEI TECH CO LTD25
  3. 3SAMSUNG ELECTRONICS CO LTD16
  4. 4TENCENT TECHNOLOGY (SHENZHEN) CO LTD14
  5. 5QUALCOMM INC12
  6. 6NVIDIA CORP12
  7. 7VELLORE INSITUTE OF TECH10
  8. 8SNAP INC10
  9. 9DELL PROD LP9
  10. 10INTUIT INC9
Source: Patsnap Eureka. Assignee ranking and totals. Derived from a Patsnap search on Knowledge Distillation Techniques covering 2015–2026, data cut-off 2026-07-31. Counts reflect published records only and shift as new filings publish.Run this in Eureka MCP
The Data

Filing trends and technology composition

Two views of the same 667 records: the year-by-year filing curve, and the IPC subclasses those filings claim against.

A rising filing curve, with the most recent years still incomplete

Filings ran from 2 in 2017 to a peak of 157 in 2025, with 40 already recorded for 2026. Because publication lags filing by roughly 18 months, the 2025 and 2026 figures will still grow as later filings publish; 2021 to 2024 is the most recent span that can be read as a complete trend, and over it filings rose 32%, from 81 to 107.

A rising filing curve, with the most recent years still incomplete0501001502002201720182019202020212022202320241572025402026Most recent year is partial — publication lag means later filings are not yet visible.

Filings concentrate in AI-model computing, thin out toward applied domains

G06N (computing based on AI models) covers 80.5% of the 667 records, with G06F and G06V each above a quarter. Applied-domain classes are much thinner: G10L (speech/audio) sits at 8.1%, G06Q (business/commerce) at 5.7%, and G16H (healthcare informatics) at just 4.2% — the technique is broadly claimed in the abstract, far less so once tied to a specific application vertical.

Filings concentrate in AI-model computing, thin out toward applied domainsG06N · Computing based on AI models53780.5%G06F · Electric digital data processi…18127.1%G06V · Image/video recognition17426.1%G06T · Image data processing & genera…9814.7%G06K · Data recognition & presentation649.6%G10L · Speech & audio analysis/synthe…548.1%G06Q · Business, commerce & admin dat…385.7%G16H · Healthcare informatics284.2%Other11917.8%

Shares are the percentage of the 667 records in scope. A patent can carry several IPC classes, so the shares add up to more than 100%.

Source: Patsnap Eureka. Filing trend and technology composition. Derived from a Patsnap search on Knowledge Distillation Techniques covering 2015–2026, data cut-off 2026-07-31. Counts reflect published records only and shift as new filings publish.

Go deeper on Knowledge Distillation Techniques with Eureka

This page is one run against one query. Ask Eureka your own question about knowledge distillation techniques and every answer comes back with the patent numbers behind it.

Try Eureka
Key Patents

Representative and most-cited filings

Representative filing
US20230401424A12023-12-14

Born-again TSK fuzzy classifier based on knowledge distillation

HUZHOU UNIVERSITY

Filed by Huzhou University, this record applies knowledge distillation to a TSK fuzzy classifier: the fuzzy rule structure combines an antecedent built on soft-label information from a distillation-temperature-adjusted output distribution with a consequent based on the original data. It is a concrete example of distillation mechanics migrating from pure neural architectures into hybrid neuro-fuzzy classifiers.Published 2023-12-14.

US20230401424A1 — patent drawing 1US20230401424A1 — patent drawing 2
View full filing
Most-cited records in this dataset
#Publication no.Patent titleCitations
1US20180268292A1Learning efficient object detection models with knowledge distillation484
2US20180158552A1Interpretable deep learning framework for mining and predictive modeling of health care data250
3US20190205748A1Soft label generation for knowledge distillation162
4US20200302295A1System and method for knowledge distillation between neural networks140
5CN110674880A用于知识蒸馏的网络训练方法、装置、介质与电子设备109
6CN111027060A基于知识蒸馏的神经网络黑盒攻击型防御方法93
7CN114241282A一种基于知识蒸馏的边缘设备场景识别方法及装置87
8US20210117948A1Mobile device platform for automated visual retail product recognition87
9US20220344049A1Decentralized artificial intelligence (AI)/machine learning training system86
10US20220094713A1Malicious message detection69

Citation counts favour older filings simply because they have had more time to accumulate citers; read them as a signal of influence within this corpus, not as a ranking of current importance.

Patent titles are shown in the language they were filed in, not translated, so that each record stays verifiable against the original filing — a translated title will not match in Eureka or in any national register. Each row carries its publication number; clicking a row searches Eureka by that number.

Source: Patsnap Eureka. Citation counts and representative records. Derived from a Patsnap search on Knowledge Distillation Techniques covering 2015–2026, data cut-off 2026-07-31. Counts reflect published records only and shift as new filings publish.Run this in Eureka MCP
Run it yourself

Put your own technology through the same analysis


  
Where to run it
Fastest

Eureka on the web

When you want the answer in the next five minutes.

The agent works the prompt against patents and technical literature, citing every source.

Run your analysis now →
For builders

MCP server & REST API

When it has to run inside your own pipeline.

Patent search, landscape analysis and assignee resolution as MCP tools. Drop them into any agent framework, or call REST directly.

Browse MCP servers →
Insights

What the numbers mean for a filing decision

Three patterns worth acting on before drafting new claims in this space.

Concentration
16.6%
of 667 records held by the top 5 assignees

One clear leader, a long tail behind it

The leading assignee holds 44 records; by fifth place the count is down to 12, and by tenth to 9. That gap between first and the rest suggests one organisation has built a genuinely broad portfolio while the remaining activity is comparatively dispersed across many single-digit filers.

Assignee ranking, 100 companies
Growth
+32%
filing growth, 2021 to 2024

Momentum is still building, not fading

Filings rose from 81 in 2021 to 107 in 2024 — the last span that can be read as complete once the ~18-month publication lag is accounted for. Treat 2025's 157 and 2026's 40 as undercounts still filling in, not as a peak already passed.

Filing trend, 2017-2026
Composition
80.5%
of records classified under G06N

Claims sit on the model layer, not the application layer

The overwhelming majority of filings claim distillation as a general AI-model technique (G06N) rather than tying it to a specific vertical. Healthcare informatics (4.2%) and business/commerce (5.7%) are comparatively open, suggesting domain-specific distillation claims face less prior art than generic ones.

IPC subclass shares, 667 records
Geography
277
records filed via China receiving office

Filing activity is led from China, followed by the US

China's receiving office accounts for the largest single share of records at 277, ahead of the United States at 193 and WIPO's PCT route at 54. Europe, India and the UK each show more modest but active filing counts, indicating this remains a genuinely global filing pattern rather than one concentrated in a single jurisdiction.

Receiving offices, this dataset
Eureka AI Agent
Looking for what nobody has claimed yet?

Eureka can read the same corpus for gaps instead of for coverage: under-claimed branches adjacent to knowledge distillation techniques, with the prior art for and against each one.

Find the white space →
Source: Patsnap Eureka. Co-assignee relationships and derived observations. Derived from a Patsnap search on Knowledge Distillation Techniques covering 2015–2026, data cut-off 2026-07-31. Counts reflect published records only and shift as new filings publish.Run this in Eureka MCP
Players

Who is filing, and where activity has slowed

The ranked leaders span large technology companies, chipmakers and a handful of academic institutions; recent-year momentum data shows several of the most historically active filers with no recorded filings in the latest year, which is likely more a publication-lag artefact than an actual halt.

Leader
44
records

A single assignee well ahead of the field

The top-ranked assignee's 44 records stand well clear of the fifth-place count of 12, giving it a portfolio breadth no other single filer in this dataset currently matches.

Assignee ranking
Momentum
-33%
YoY, most active recent filer

Even the most active recent filer is pulling back

Vellore Institute of Technology recorded 4 filings in the latest year, down 33% year-on-year — the strongest recent-year momentum in the ranking, which is itself a modest figure against a field where several historically large filers show zero filings in the same year.

Recent-year momentum by assignee
Collaboration
8
co-assignee pairing, strongest pair

Co-filing is rare and concentrated where it exists

Only 10 co-assignee pairs appear across the dataset. The strongest, between Disney Enterprises and ETH Zurich, reaches 8 shared records — a rare example of sustained industry-academic co-filing in a field otherwise dominated by single-assignee filings.

Co-assignee pairs, this dataset
🔍
Under-claimed sub-areas worth checking before filing
Branches where composition shares are thin relative to the core technique — worth a freedom-to-operate check before assuming the space is occupied.
Data-free distillation pipelinesDistillation for speech/audio modelsHealthcare-informatics-specific student architecturesCapacity-gap-aware teacher selectionFeature-matching for edge/mobile students
Rank all filers by momentum →
Recent-year filing momentum by assignee
AssigneeRecent yearYoY
VELLORE INSITUTE OF TECH4-33%
International Business Machines Corporation (IBM)0—
Huawei Technologies Co., Ltd.0—
Samsung Electronics Co., Ltd.0-100%
Tencent Technology (Shenzhen) Co., Ltd.0-100%
Qualcomm Incorporated0-100%
NVIDIA Corporation0-100%
Presagen Pty Ltd0—
Source: Patsnap Eureka. Assignee-level momentum. Derived from a Patsnap search on Knowledge Distillation Techniques covering 2015–2026, data cut-off 2026-07-31. Counts reflect published records only and shift as new filings publish.Run this in Eureka MCP
What's Next

Where to take this next

The dataset points to specific next steps depending on whether you are scoping a filing, tracking a competitor, or evaluating freedom to operate.

Check the under-claimed branches first

Healthcare informatics, speech/audio and data-free distillation all carry thinner IPC shares than the core G06N claims. A quick prior-art check there is cheaper than assuming the whole field is occupied.

Explore white space in Eureka

Watch the leader's next moves, not just its count

A 44-record leader with no recorded latest-year filings is more likely a publication-lag gap than a real slowdown. Track filing dates against publication dates before concluding activity has stopped.

Set up assignee tracking in Eureka

Read the most-cited filings before drafting claims

The highest-cited records in this dataset define the language much of the later art responds to. Understanding what they actually claim narrows the search for a defensible angle.

Review key patents in Eureka
Source: Patsnap Eureka. Forward-looking reading of the same dataset. Derived from a Patsnap search on Knowledge Distillation Techniques covering 2015–2026, data cut-off 2026-07-31. Counts reflect published records only and shift as new filings publish.Run this in Eureka MCP
FAQ

Common questions about knowledge distillation patents

Answers are grounded in the same dataset. Derived from a Patsnap search on Knowledge Distillation Techniques covering 2015–2026, data cut-off 2026-07-31. Counts reflect published records only and shift as new filings publish.Run this in Eureka MCP

Research Knowledge Distillation Techniques in depth with Eureka

Go past this page: query the whole knowledge distillation techniques corpus yourself, in your own scope.
Every answer comes back with patent numbers you can open.

Try Eureka

Disclaimer. This page is generated from Patsnap Eureka data drawn from a limited snapshot of global patent and scientific-literature records, and is provided for general information and reference only.

Patent data carries inherent limitations: recent filings (typically the most recent 18–24 months) are under-counted due to standard publication lag; counts may be reported at either a patent-family or a patent-record basis and are not always directly comparable; classification, applicant-name, and citation data may contain errors, duplicates, or omissions; and the underlying search query defines and constrains the scope shown. As a result, the analysis may be incomplete or inaccurate and may not reflect the full technology landscape.

Nothing on this page constitutes an exhaustive prior-art, novelty, freedom-to-operate, or validity search, nor does it constitute legal, financial, investment, or professional advice, and it should not be relied upon as such. Any patent, commercial, or strategic decision should be verified independently and reviewed with qualified patent, legal, and domain professionals. Patsnap makes no warranties, express or implied, as to the accuracy, completeness, or fitness for any particular purpose of the information presented.

Machine translation. Assignee and organisation names originally recorded in Chinese, Japanese or Korean have been rendered into English by an AI translation step so that the tables stay readable. These renderings are best-effort and may not match a company's registered English name; the original name is what the underlying patent record carries, and it is what any Eureka query launched from this page uses.

Help us improve

Something wrong, out of date, or missing on this page? Tell us and it goes straight to the team that maintains it.