Book a demo

Neural Network Inference Acceleration Patents: Who Leads, Gaps 2026

Neural Network Inference Acceleration Patents: Who Leads, Gaps 2026
https://www.patsnap.com/resources/blog/rd-blog/neural-network-inference-acceleration-patent-landscape/ · Patsnap · data cut-off 2026-07-31 · downloaded from the live page
Patent Landscape · AI & Computer Vision
Neural network inference acceleration patents: where filings concentrate and where they don't
  • Filings peaked in 2020 at 81 and have since declined, suggesting the core sparse-accelerator claim space is now well staked out rather than still expanding.
  • Recent-year momentum has gone flat across the largest holders, with Intel, Microsoft, NVIDIA and Xilinx all showing zero filings in the latest year in this dataset.
  • The most-cited records all center on sparse convolutional accelerators, meaning the highest-traffic prior art is concentrated in one architectural family, not spread evenly.
Get a prior-art report on your approach
564
Published Records
35%
Top-5 Share of All Records
-13%
Filing Growth 2021→2024
US
Leading Jurisdiction

Filing growth compares 2021 (80 records) with 2024 (70) — a three-year span. 2024 is the most recent year we treat as complete: publication lags filing by roughly 18 months, so 2025 onwards are still filling in and any growth rate that ends there would understate the field. Top-5 share is the combined record count of the five largest assignees divided by all 564 records in scope (CR5), not by the ranked leaders only.

Published byPatsnap Research··7 min readSourced from Patsnap Eureka
Overview

What this landscape covers

This dataset tracks patent families combining accelerator architecture terms — neural network accelerator, inference acceleration, AI accelerator — with implementation-level terms in the claims and description: quantization, sparsity, dataflow, systolic array, and energy efficiency. The IPC filter narrows to G06N3, G06F15 and G06F7, which is where hardware-level neural computation claims are classified. The result is a corpus centred on how inference is executed in silicon, not on model architectures or training methods themselves.

Records span 2015 through the mid-2026 cut-off. Because publication typically lags filing by around 18 months, counts for the most recent one to two years are understated and should be read as a floor, not a ceiling.

Filing activity by year, 2017–2026
  1. 1INTEL CORP69
  2. 2MICROSOFT TECHNOLOGY LICENSING LLC49
  3. 3CEREBRAS SYSTEMS INC32
  4. 4SAMSUNG ELECTRONICS CO LTD28
  5. 5XILINX INC21
  6. 6NVIDIA CORP21
  7. 7ELECTRONICS & TELECOMM RES INST18
  8. 8AMAZON TECH INC16
  9. 9KOREA ADVANCED INST OF SCI & TECH15
  10. 10ZHEJIANG UNIV14
Source: Patsnap Eureka. Assignee ranking and totals. Derived from a Patsnap search on Neural Network Inference Acceleration covering 2015–2026, data cut-off 2026-07-31. Counts reflect published records only and shift as new filings publish.Run this in Eureka MCP
Data

Filing trend and technology composition

Two views of the same 564-family corpus: how filing activity has moved over time, and which IPC subclasses carry the claim weight.

A 2020 peak followed by a pull-back

Filings rose from 21 in 2017 to a peak of 81 in 2020, held near the midpoint at 62 in 2022, and have since fallen — 13 in the most recent (partial) year. Read the tail end cautiously given publication lag, but the shape from 2020 onward reads as consolidation rather than continued growth.

A 2020 peak followed by a pull-back02550751002120172018201981202020212022202320242025132026Most recent year is partial — publication lag means later filings are not yet visible.

G06N and G06F dominate the classification mix

G06N (AI-model computing) appears in 537 of 564 records and G06F (electric digital data processing) in 298, confirming this is fundamentally a hardware-execution corpus. Image/video-specific subclasses (G06V, G06T, G06K) and memory/coding subclasses (G11C, H03M) each carry single-digit-to-low-double-digit counts — present as application context, not as the centre of gravity.

G06N and G06F dominate the classification mixG06N · Computing based on AI models53795.2%G06F · Electric digital data processi…29852.8%G06V · Image/video recognition213.7%G06T · Image data processing & genera…203.5%H04L · Digital information transmissi…152.7%H03M · Coding & code conversion132.3%G11C · Static & digital memories112.0%G06K · Data recognition & presentation91.6%Other356.2%

Shares are the percentage of the 564 records in scope. A patent can carry several IPC classes, so the shares add up to more than 100%.

Source: Patsnap Eureka. Filing trend and technology composition. Derived from a Patsnap search on Neural Network Inference Acceleration covering 2015–2026, data cut-off 2026-07-31. Counts reflect published records only and shift as new filings publish.

Go deeper on Neural Network Inference Acceleration with Eureka

This page is one run against one query. Ask Eureka your own question about neural network inference acceleration and every answer comes back with the patent numbers behind it.

Try Eureka
Key Patents

The most-cited records in this corpus

Representative filing
US20230177310A12023-06-08

Systolic-array accelerator for recurrent neural network data processing

ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Proposed is a data parallel processing method for a recurrent neural network in a neural network accelerator based on a systolic array. A data processing device receives voice data of a user in a predetermined time section, separates it by sentence into voice data units, vectorizes those units into input vectors, and feeds the vectors to a systolic-array-based neural network accelerator for processing.Filed by the Electronics and Telecommunications Research Institute, published 2023-06-08 — illustrates how systolic-array dataflow claims are now being paired with specific application pipelines (voice segmentation) rather than filed as bare architecture claims.

US20230177310A1 — patent drawing 1US20230177310A1 — patent drawing 2
View full filing
Highest-citation records
#Publication no.Patent titleCitations
1US20180046906A1Sparse convolutional neural network accelerator438
2US20180046900A1Sparse convolutional neural network accelerator371
3US10891538B2Sparse convolutional neural network accelerator340
4US20180121796A1Flexible neural network accelerator and methods therefor316
5US10528864B2Sparse convolutional neural network accelerator312
6US10860922B2Sparse convolutional neural network accelerator307
7US20190286973A1Hardware accelerated neural network subgraphs185
8US20180046916A1Sparse convolutional neural network accelerator175
9US20190286972A1Hardware accelerated neural network subgraphs132
10US20190114534A1Neural network processing system having multiple processors and a neural network accelerator129

Citation counts inside a searched corpus favour older filings that have had more time to accumulate citers — treat this as a signal of influence on the field, not of current commercial relevance.

Each row carries its publication number; clicking a row searches Eureka by that number.

Source: Patsnap Eureka. Citation counts and representative records. Derived from a Patsnap search on Neural Network Inference Acceleration covering 2015–2026, data cut-off 2026-07-31. Counts reflect published records only and shift as new filings publish.Run this in Eureka MCP
Run it yourself

Put your own technology through the same analysis

 
Where to run it
Fastest

Eureka on the web

When you want the answer in the next five minutes.

The agent works the prompt against patents and technical literature, citing every source.

Run your analysis now →
For builders

MCP server & REST API

When it has to run inside your own pipeline.

Patent search, landscape analysis and assignee resolution as MCP tools. Drop them into any agent framework, or call REST directly.

Browse MCP servers →
Insights

What the numbers say about this field

Three read-throughs from the filing trend, the citation table, and the co-assignee pairs.

Filing trajectory
81 → 13
peak year (2020) to latest partial year

The growth phase has passed its peak

Filings climbed steadily to a 2020 high, held near that level through 2022, then declined. Combined with the recent-year momentum data showing several major holders at zero, this reads as a maturing claim space rather than an emerging one — new entrants face denser prior art than the 2017 baseline suggests.

Filing trend, 2017–2026
Citation concentration
438 citations
top-cited record

Influence clusters around sparse convolutional accelerators

The five most-cited records in this corpus are all variants on sparse convolutional neural network accelerators, with the leading record cited 438 times. That concentration means anyone designing a sparsity-handling datapath is working against a small number of heavily-cited reference points, not a diffuse literature.

Most-cited records table
Collaboration signal
6 co-filings
strongest pairing

Academic-institute pairing outweighs corporate co-filing

The strongest co-assignee pair in the dataset — Zhejiang University and Zhejiang Lab — outnumbers any corporate pairing observed, including Intel's pairings with individual named inventors. Joint university-lab filing appears to be a more active collaboration channel here than cross-company alliances.

Co-assignee pairs
Eureka AI Agent
Looking for what nobody has claimed yet?

Eureka can read the same corpus for gaps instead of for coverage: under-claimed branches adjacent to neural network inference acceleration, with the prior art for and against each one.

Find the white space →
Source: Patsnap Eureka. Co-assignee relationships and derived observations. Derived from a Patsnap search on Neural Network Inference Acceleration covering 2015–2026, data cut-off 2026-07-31. Counts reflect published records only and shift as new filings publish.Run this in Eureka MCP
Players

Who is filing, and who has slowed down

Recent-year momentum diverges sharply from historical citation leadership: the accelerator pioneers that built the most-cited prior art are not the ones filing now.

Momentum leader
1 filing
latest year

SambaNova Systems, Inc. is the only holder still filing

Among the tracked assignees, SambaNova Systems, Inc. (SambaNova Systems) is the only one with an active filing in the latest year captured. Every other major holder listed — Intel, Microsoft, NVIDIA, Xilinx, ETRI — shows zero filings in the same window.

Recent-year momentum
Historical leader
-100% YoY
Intel

Intel's filing pace has stopped, not slowed

Intel's co-assignee activity (pairings with individually named inventors, at 5 and 4 occurrences) points to a period of active internal collaboration that has not carried into the latest year, which shows a full year-over-year drop to zero.

Recent-year momentum by assignee
Academic cluster
6 co-filings
Zhejiang University + Zhejiang Lab

A dense academic pairing sits outside the corporate momentum picture

Zhejiang University and Zhejiang Lab form the strongest co-assignee pair in the dataset, independent of the corporate names showing momentum declines — suggesting research-institute output continues even as commercial filers pause.

Co-assignee pairs
🔍
Under-claimed sub-areas worth a closer look
Branches with thin representation in the IPC composition relative to the corpus core — worth checking before assuming the space is closed.
Mixed-precision quantization dataflowSparse-weight memory addressing (G11C overlap)Systolic-array energy-efficiency schedulingCoding-domain compression for accelerator I/O (H03M overlap)Cross-modal accelerator pipelines (G06V/G06T overlap)
Rank all filers by momentum →
Recent-year filing momentum by assignee
AssigneeRecent yearYoY
SambaNova Systems, Inc.1
Intel Corporation0-100%
Microsoft Technology Licensing, LLC0-100%
NVIDIA Corporation0-100%
Xilinx, Inc.0
Electronics and Telecommunications Research Institute (ETRI)0
Samsung Electronics Co., Ltd.0
Korea Advanced Institute of Science and Technology (KAIST)0
Source: Patsnap Eureka. Assignee-level momentum. Derived from a Patsnap search on Neural Network Inference Acceleration covering 2015–2026, data cut-off 2026-07-31. Counts reflect published records only and shift as new filings publish.Run this in Eureka MCP
What's Next

Where to take this

The filing and citation data point to a maturing core and a thinner periphery. Two directions follow from that.

Check the periphery before the core

G11C, H03M, G06V and G06T overlaps carry single-digit-to-low-double-digit counts against a 537-record G06N core. That gap is either genuine white space or an unclaimed application niche — worth a targeted search before committing a filing strategy to the dense sparse-accelerator core.

Explore white space in Eureka

Track momentum, not just historical leadership

The assignees with the most-cited records are not the ones filing now. A monitoring approach built on recent-year momentum will surface active filers like SambaNova earlier than one built purely on citation counts.

Set up momentum tracking in Eureka
Source: Patsnap Eureka. Forward-looking reading of the same dataset. Derived from a Patsnap search on Neural Network Inference Acceleration covering 2015–2026, data cut-off 2026-07-31. Counts reflect published records only and shift as new filings publish.Run this in Eureka MCP
FAQ

Common questions on this landscape

Answers are grounded in the same dataset. Derived from a Patsnap search on Neural Network Inference Acceleration covering 2015–2026, data cut-off 2026-07-31. Counts reflect published records only and shift as new filings publish.Run this in Eureka MCP

Research Neural Network Inference Acceleration in depth with Eureka

Go past this page: query the whole neural network inference acceleration corpus yourself, in your own scope.
Every answer comes back with patent numbers you can open.

Try Eureka

Disclaimer. This page is generated from Patsnap Eureka data drawn from a limited snapshot of global patent and scientific-literature records, and is provided for general information and reference only.

Patent data carries inherent limitations: recent filings (typically the most recent 18–24 months) are under-counted due to standard publication lag; counts may be reported at either a patent-family or a patent-record basis and are not always directly comparable; classification, applicant-name, and citation data may contain errors, duplicates, or omissions; and the underlying search query defines and constrains the scope shown. As a result, the analysis may be incomplete or inaccurate and may not reflect the full technology landscape.

Nothing on this page constitutes an exhaustive prior-art, novelty, freedom-to-operate, or validity search, nor does it constitute legal, financial, investment, or professional advice, and it should not be relied upon as such. Any patent, commercial, or strategic decision should be verified independently and reviewed with qualified patent, legal, and domain professionals. Patsnap makes no warranties, express or implied, as to the accuracy, completeness, or fitness for any particular purpose of the information presented.

Machine translation. Assignee and organisation names originally recorded in Chinese, Japanese or Korean have been rendered into English by an AI translation step so that the tables stay readable. These renderings are best-effort and may not match a company’s registered English name; the original name is what the underlying patent record carries, and it is what any Eureka query launched from this page uses.

Help us improve this page

Found incorrect or outdated information? Let us know and we'll get it fixed.