Sign up

Understanding Design Patent FTO

Design FTO is the process of systematically searching granted design patents worldwide to determine whether a product's appearance infringes existing design patent rights.

R&D Phase — Evaluate design direction, avoid potential infringement risks

Pre-Launch — Comprehensive infringement risk screening for products

E-commerce Compliance — Verify product designs against target market patents

Litigation & Invalidation — Search similar designs as evidence in proceedings

Key Findings

This benchmark evaluates the performance of three AI tools: PatSnap's Design FTO Search AI Agent, ChatGPT 5.4 (with web search), and Gemini 3.1 Pro (with web search). The evaluation dataset of 261 samples is distributed across three major patent offices (CN, US, EU) and covers 26 Locarno (LOC) primary classifications. Two sample types are included: e-commerce infringement images (64.8%) and patent invalidation real-object/line-drawing pairs (35.2%), ensuring the model performs well across both high-frequency commercial scenarios and challenging cross-modal patent comparisons. For receiving-office distribution, applications from China (CN), the European Union (EU), and the United States (US) each account for roughly one-third. This balanced mix reflects the different examination standards across major design patent jurisdictions and ensures more realistic, globally representative evaluation.

Benchmark results show that PatSnap's Design FTO AI Agent achieved a 77% High-Risk Patent Hit Rate and a 0.7 PRES Score within the top 200 results—significantly outperforming two leading general-purpose AI tools.

1) High-Risk Patent Hit Rate

PatSnap's Design FTO AI Agent achieved a High-Risk Patent Hit Rate of 77%—21 to 83 times that of general-purpose models (Gemini 3.71%, ChatGPT 0.93%)—an essential capability for speeding up infringement risk identification in product clearance and e-commerce compliance.

Performance was strongest at the EU office, where the agent reached a 92% Hit Rate and—the highest among all three major offices (CN/US/EU)—demonstrating particularly powerful search capabilities for European design patent scenarios.

2) PRES Score

The PRES Score measures an AI tool's end-to-end infringement determination capability—not only retrieving infringing patents, but also correctly delivering infringement conclusions in the final report. It is critical for real-world business decisions, as it directly reflects the quality of the complete pipeline from search to determination.

PatSnap's Design FTO AI Agent achieved a PRES Score of 0.7, helping teams—whether in-house IP counsel, patent attorneys, or e-commerce compliance officers—surface the most relevant infringing patents faster. This supports quicker risk assessment and stronger defensive strategies, reducing the chance of costly infringement disputes.

3) Typical Test Result Sample

In this test, a product image (the "test question") was submitted to each AI tool along with the target market (US). Their results were then evaluated against a confirmed infringing design patent USD869847S1 (the "model answer").

PatSnap's Design FTO AI Agent successfully identified the target infringing patent at rank #2 within 200 returned results, achieving a High-Risk Patent Hit Rate of 100% and a determination accuracy of 100%.

By comparison, ChatGPT 5.4 returned only 6 results and failed to identify the target patent, resulting in a Hit Rate of 0%. Gemini 3.1 Pro returned 20 results and placed the target at rank #6, achieving a 100% Hit Rate but with far fewer candidate patents for comprehensive screening.

These findings highlight that while general-purpose LLMs can attempt visual patent searches, they struggle with the specialized image-to-patent matching and comprehensive coverage required for design FTO. In comparison, domain-specific AI tools like PatSnap's Design FTO AI Agent offer superior accuracy and relevance, underscoring their essential role in design patent-focused workflows.

Future Research

Future benchmarks will focus on three key directions:

Cross-modal visual alignment enhancement: Improve hit rates for real-object and line-drawing scenarios and close the gap with e-commerce performance

Continued dataset expansion: Add test samples from JP and KR markets with broader LOC classification coverage

Wider model comparison: Incorporate more multimodal large models as testing baselines

Methodology

The PatSnap PatentBench Design FTO benchmark encompasses four key dimensions:

1) Test samples to establish the "benchmark value"

Each test sample is a basic unit in the benchmark, consisting of a "test question" (a product image plus its target market) and a "standard answer" (confirmed infringing design patents). Since ideal answers rarely exist in design patent tasks—like a definitive list of all visually similar patents that constitute infringement—domain experts must carefully define realistic questions and construct answers that closely approximate ideal outcomes, grounded in real patent examination practice and judicial precedent.

2) Datasets to create reliable and unbiased test results

To ensure statistical validity, the benchmark dataset includes 261 carefully selected samples that reflect real-world diversity across receiving offices, image types, and industrial classifications. All samples are sourced from real infringement cases—e-commerce platform complaints and patent X-reference relationships—rather than artificial simulations, and all infringement relationships have been rigorously verified by a human annotation team.

3) Evaluation metrics - the core of benchmarking

Evaluation metrics are used to measure and compare performance. They can be single or combined indicators, carefully designed by experts to reflect the practical needs of patent professionals.

Design patent FTO aims to identify visually similar patents that may constitute infringement, then determine whether infringement actually exists. It follows the principles of visual similarity search, but with a specialized focus on design patent law—including holistic observation, prioritization of key design features, and the ordinary observer standard.

The PatSnap PatentBench-Design FTO uses the following indicators to measure the quality of search results:

High-Risk PatentHit Rate: Proportion of test samples where the confirmed infringing patent appears in the top K results. The standard answer may contain multiple infringing patents; a hit is counted when at least one is found.

PRES Score: Measures end-to-end infringement determination quality. PRES (Patent Retrieval Evaluation Score), proposed by Magdy & Jones (2010), evaluates not only whether the infringing patent was found, but how highly it was ranked in the final output—directly reflecting the complete pipeline from search to determination.

4) Comparison AI tools with industry experts

AI tools are designed to support and enhance the work of professionals, so direct comparisons with established baselines are essential. This benchmark compares PatSnap's Design FTO AI Agent with two leading general-purpose models—ChatGPT 5.4 (OpenAI, with web search) and Gemini 3.1 Pro (Google, with web search)—to establish baselines and better understand the capabilities of specialized versus general-purpose AI in design patent infringement tasks.

PatSnap Design FTO AI Agent
Use Cases & Its Impact

This benchmark makes one thing clear: design patent infringement analysis is a fundamentally different challenge from what general-purpose AI was built to solve. PatSnap's Design FTO AI Agent achieves its leading performance by combining visual and textual feature fusion, iterative multi-round retrieval, and infringement reasoning grounded in design patent law. These tightly integrated capabilities create a level of domain expertise that general-purpose models cannot easily replicate.

For IP professionals in corporations, law firms, and e-commerce operations, this translates into a powerful productivity boost. Tasks like screening product images against global design patent databases—once requiring days of manual visual comparison—can now be completed in minutes with significantly higher accuracy. This shift allows experts to spend less time on repetitive search work and more on strategic risk assessment and decision-making.

PatentBench-Design FTO will continue to evolve alongside the technology it measures—growing its dataset, covering more jurisdictions, and refining its evaluation criteria to keep pace with the industry's advancing capabilities.