Patent Drafting Analysis of Zoox, Inc.’s Machine-Learning AV Teleoperation Optimization System | US 11,061,398 B2
Patent Drafting Analysis of Zoox's Machine-Learning AV Teleoperation Optimization System | US 11,061,398 B2
A structural and strategic analysis of Zoox's granted AV teleoperation patent, examining claim architecture, drafting quality, specification support, and prosecution positioning across method, system, and CRM claim types.
Structural Overview
The detailed description dominates at approximately 79% of total specification words (~14,500 of ~18,400), providing extensive embodiment coverage across 39 figures. The patent presents 20 total claims structured across 3 independent claims (method/system/CRM) with 17 dependent claims, yielding a dependent-to-independent ratio of 5.67:1. The 42 drawing sheets provide comprehensive coverage of the autonomous vehicle architecture, teleoperation interfaces, simulator systems, and policy explorer components, though the sheer volume creates some diffusion in claim-to-figure mapping.
Section Word Distribution
↗ Click bars to exploreFigure Inventory — 42 Sheets
| Figure | Description | Role |
|---|---|---|
| FIG. 1 | System overview showing fleet of autonomous vehicles (109a-109e) communicatively networked to autonomous vehicle service platform 101 via networks 106, with bidirectional AV 130 and AV Controller 147.Search in Eureka ↗ | System architecture |
| FIG. 2 | Flow diagram (200) showing method to monitor fleet of autonomous vehicles: detecting events with confidence levels, receiving candidate trajectories, identifying guidance data, receiving teleoperator trajectory selection, and transmitting to vehicle.Search in Eureka ↗ | Flow diagram |
| FIG. 3A | Interior diagram of bidirectional autonomous vehicle 330 showing sensors (image capture 340, audio capture 342, LIDAR 346, RADAR 348, sonar 341), AV Control Logic 347, and AV Controller 347a with motion controller 362, planner 364, perception engine 366, and localizer 368.Search in Eureka ↗ | Key embodiment |
| FIG. 3B | Diagram 391 depicting sensor field 301a of sensor 310a showing single Lidar field coverage around autonomous vehicle 330a.Search in Eureka ↗ | Other |
| FIG. 3C | Diagram 392 depicting four overlapping sensor fields from sensors 310a-310d providing redundant coverage regions 301, 302, and 303 around autonomous vehicle 330b.Search in Eureka ↗ | Other |
| FIG. 3D | Diagram 393 depicting loss of sensor field due to failed Lidar 309, showing gap 304 and reduced sensor field coverage 305, 306 around autonomous vehicle 330c traveling in direction of travel 396.Search in Eureka ↗ | Other |
| FIG. 3E | Diagram 394 depicting bidirectional maneuver by autonomous vehicle 330d to restore robust sensor field 302 at leading end, using driveway 397 to switch directionality and relocate taillights 348.Search in Eureka ↗ | Other |
| FIG. 4 | Functional block diagram (400) of system showing autonomous vehicle service platform 401 communicatively coupled via communication layer 402 to AV Controller 447, including planner 464 with trajectory evaluator 465, teleoperator 404, and reference data repository 405.Search in Eureka ↗ | System architecture |
| FIG. 5 | Flow diagram (500) for controlling autonomous vehicle: receiving multi-modal sensor data (502), correlating subsets (504), deriving object data (506), detecting objects affecting planned path (508), evaluating trajectories (510), determining confidence level (512), transmitting alternate path request to teleoperator (514).Search in Eureka ↗ | Flow diagram |
| FIG. 6 | Architecture diagram (600) of autonomous vehicle controller showing processes: motion controller 662, planner 664, perception 666, mapping 640, localization 668, with guidance data 606, 2D/3D map data, and actuators 650.Search in Eureka ↗ | System architecture |
| FIG. 7 | Diagram (700) of autonomous vehicle service platform 701 with reference data generator 705, vehicle data controller 702, fleet manager 703, teleoperator manager 707, simulator 740, policy manager 742, and redundant communication channels 770 (networks 771-774) to fleet vehicles 730.Search in Eureka ↗ | System architecture |
| FIG. 8 | Diagram (800) of messaging application showing teleoperator application 801 and autonomous vehicle application 830 exchanging data via message routers 854 and teleoperator API 852 over WAN 871 and LAN 872 networks using Data Distribution Service middleware protocol.Search in Eureka ↗ | System architecture |
| FIG. 9 | Diagram (900) depicting teleoperation data types including obstacle data 920, planner options data 924, position data 926, telemetry data 940/950, query data 942/952, and command data 946/956 exchanged via data-centric messaging bus 972 between teleoperator application 901 and autonomous vehicle application 930.Search in Eureka ↗ | Claim support |
| FIG. 10 | Diagram (1000) illustrating teleoperator interface showing autonomous vehicle service platform 1001 with teleoperator manager 1007, teleoperator display 1010 showing vehicle path 1012, candidate trajectories 1040, teleop-based path 1042, planner-generated path 1044, and unidentified obstacle 1046.Search in Eureka ↗ | UI/interface |
| FIG. 11 | Diagram (1100) of planner 1164 configured to invoke teleoperations, showing trajectory evaluator 1120 with state/event manager 1122, confidence level generator 1123, guided trajectory generator 1126, trajectory tracker 1128, receiving policy data 1130 and perception engine data 1132.Search in Eureka ↗ | Key embodiment |
| FIG. 12 | Flow diagram (1200) for controlling AV: receiving objects with classification certainty (1202), receiving localizer/map data with event certainty (1204), determining path (1206), local position (1208), probabilistic state of operation (1210), normative state likelihood (1212), transmitting teleoperator monitoring request (1214).Search in Eureka ↗ | Flow diagram |
| FIG. 13 | Diagram (1300) showing planner trajectory generation with trajectory evaluator 1320, confidence level generator 1322, teleoperator query messenger 1329, trajectory recalculator 1325, and nominal driving trajectory generator 1327 receiving inputs from perception engine 1366 and localizer 1368.Search in Eureka ↗ | Key embodiment |
| FIG. 14 | Diagram (1400) of autonomous vehicle service platform 1401 with teleoperator manager 1407, teleoperator action recommendation controller 1412, simulator interface controller 1414, teleoperator interaction capture analyzer 1416, simulator 1440, policy manager 1442, and reference data updater 1438.Search in Eureka ↗ | System architecture |
| FIG. 15 | Flow diagram (1500) showing teleoperator computing device receiving event message data (1502), accessing teleoperation repository for simulation-based and teleoperator-interaction-based recommendations (1504), combining subsets (1506), presenting recommended courses of action (1508), receiving teleoperator selection (1510).Search in Eureka ↗ | Flow diagram |
| FIG. 16 | Diagram (1600) of autonomous vehicle fleet manager 1603 with fleet optimization manager 1620 including transit request processor 1631, AV dispatch optimization calculator 1634, hybrid AV/non-AV processor 1640, and non-AV service region 1690 within road network 1650.Search in Eureka ↗ | System architecture |
| FIG. 17 | Flow diagram (1700) for managing fleet: receiving policy data (1702), extracting fleet management data (1704), receiving transit request (1706), calculating attributes (1708), selecting autonomous vehicle (1710), generating dispatch data (1712).Search in Eureka ↗ | Flow diagram |
| FIG. 18 | Diagram (1800) of autonomous vehicle fleet manager 1803 with communication link manager 1820, environment event detector 1831, policy adaption determinator 1832, policy download manager 1842, COMM-configured AV dispatcher 1844, and reduced communication region 1880.Search in Eureka ↗ | System architecture |
| FIG. 19 | Flow diagram (1900) for actions during communication events: receiving policy data (1901), implementing actions including dispatching vehicles as relays, peer-to-peer communications, event policy download, invoking teleoperations, recalculating paths (1902), monitoring fleet (1914).Search in Eureka ↗ | Flow diagram |
| FIG. 20 | Diagram (2000) of localizer 2068 with positioning system 2010 and localization system 2012 receiving Lidar 2072, camera 2074, radar 2076 sensor data plus reference data 2020 (2D/3D/4D map data), producing local pose data 2052 via localization data integrator 2014.Search in Eureka ↗ | System architecture |
| FIG. 21 | Flow diagram (2100) for generating local pose data: receiving 3D map reference data (2102), localization sensor data (2104), positioning sensor data (2106), integrating data (2108), forming local position data (2110).Search in Eureka ↗ | Flow diagram |
| FIG. 22 | Detailed localizer diagram (2200) showing localization system 2210 (projection processor 2254a, odometry processor 2254b, integrator processor 2254c) and relative localization system 2212 (localization processor 2254d, visual registration processor 2254e, radar return processor 2254f) feeding into localization data integrator 2266.Search in Eureka ↗ | Key embodiment |
| FIG. 23 | Diagram (2300) of perception engine 2366 with segmentation processor 2310, object tracker 2330, and classifier 2360 receiving local position data 2352, Lidar 2372, camera 2374, and radar 2376 data, producing perception engine data 2354.Search in Eureka ↗ | System architecture |
| FIG. 24 | Flow chart (2400) for generating perception engine data: retrieving local position (2402), receiving localization sensor data (2404), segmenting environment features (2406), spatially tracking segmented objects (2408), classifying as static/dynamic (2410), associating classification type (2410), generating classified object data (2412).Search in Eureka ↗ | Flow diagram |
| FIG. 25 | Segmentation processor diagram (2500) showing meta spin generator 2521, segmentation processor 2523, scan differencing processor 2513, blob classifier 2520, radar segmentation processor 2514 processing Lidar 2572, camera 2574, and radar 2576 data to produce occupancy grid map 2515 and obstacle velocity data 2517.Search in Eureka ↗ | Key embodiment |
| FIG. 26A | Diagram (2600) of object tracker 2630 and classifier 2660 showing data association processor 2632, image tracker 2633, track updater 2634, track database 2636, and track classification engine 2662 generating static obstacle data 2672 and dynamic obstacle data 2674.Search in Eureka ↗ | System architecture |
| FIG. 26B | Alternate object tracker diagram (2601) showing object tracker 2631 with optional registration portion 2699 including object scan registration and fusion processor 2696 and 3D object database 2698.Search in Eureka ↗ | Other |
| FIG. 27 | Front-end processor diagram (2700) for perception engine showing ground segmentation 2723a, over-segmentation 2723b, aggregation classification 2712, data association 2732, track database 2736, and track classification engine 2762 processing colored Lidar data 2775.Search in Eureka ↗ | System architecture |
| FIG. 28 | Simulator diagram (2800) showing simulated environment 2803 with simulated autonomous vehicle 2830, simulated AV controller 2847 (perception engine 2866, localizer 2868, motion controller 2862, planner 2864), physics processor 2850 with collision detection 2852, and teleoperator computing device 2804.Search in Eureka ↗ | Key embodiment |
| FIG. 29 | Flow chart (2900) for simulating autonomous vehicle: retrieving 3D map data (2902), dynamic object data (2904), forming simulated environment (2906), simulating AV with controller (2908), generating simulated sensor data (2910), generating simulated vehicle commands (2912), evaluating policy compliance (2914).Search in Eureka ↗ | Flow diagram |
| FIG. 30 | Flow chart (3000) for generating 3D map data: retrieving trajectory data (3002), localization data with image data (3004, 3006), aligning subsets for global position (3008), generating 3D map data (3010), implementing map data (3012).Search in Eureka ↗ | Flow diagram |
| FIG. 31 | Architecture diagram (3100) of 3D mapping engine receiving Lidar log 3172, camera log 3174, radar log 3176, trajectory log 3140 data, with loop closure detector 3150, 3D mapper 3154, Lidar self-calibration 3156, generating 3D map data 3120 for fleet 3164, simulator 3166, and teleoperator 3168.Search in Eureka ↗ | System architecture |
| FIG. 32 | Diagram (3200) of autonomous vehicle application on mobile device 3203 showing AV service application 3240 with transportation controller 3242, AV user controller 3244, user identification controller 3246 communicating with autonomous vehicle 3230 via links 3260-3262 to AV service platform 3201.Search in Eureka ↗ | UI/interface |
| FIG. 33 | Computing platform diagram (3300) showing processor 3304, memory 3306, storage device 3308, communication interface 3313 with AV controller module 3350 for implementing autonomous vehicle service functions, deployable in autonomous vehicle 3391 or mobile device 3390b.Search in Eureka ↗ | Claim support |
| FIG. 34 | Computing platform diagram (3400) showing autonomous vehicle service platform module 3450 in memory 3306 for implementing teleoperator manager and simulator functions of the autonomous vehicle service platform.Search in Eureka ↗ | Claim support |
| FIG. 35 | Computing platform diagram (3500) showing AV service module 3550 in memory 3306 for mobile computing device 3390b delivering autonomous vehicle service functionalities.Search in Eureka ↗ | Claim support |
| FIG. 36 | Policy explorer diagram (3600) showing road network 3650 with autonomous vehicles 3630/3630a, planner 3670 with telemetry data 3671 and policy data 3672, policy explorer 3699 accessing repositories 3693-3697 to generate updated policy data 3694 communicated to fleet vehicles.Search in Eureka ↗ | Key embodiment |
| FIG. 37 | Flow chart (3700) for generating updated policy data: receiving telemetry and policy data (3702), extracting confidence level (3704), determining state of operation (3706), calculating candidate trajectories with confidence levels (3708), generating updated policy data (3710), communicating updated policy data (3712).Search in Eureka ↗ | Flow diagram |
| FIG. 38 | Diagram (3800) showing policy explorer 3899 implemented in simulator 3840 accessing physics processor 3850, correlator 3861, comparator 3862, statistical change point detector 3864 to generate updated policy data 3894 communicated to teleoperator 3894, autonomous vehicles 3830, and data repository 3890.Search in Eureka ↗ | Key embodiment |
| FIG. 39 | Diagram (3900) showing policy explorer 3999 implemented in teleoperator 3940 accessing correlator 3961, comparator 3962, change point detector 3964 to generate updated policy data 3994 communicated to simulator 3990, autonomous vehicles 3930, and data repository 3991.Search in Eureka ↗ | Key embodiment |
Claim Architecture Analysis
The patent presents 3 independent claims covering method (Claim 1), system/apparatus (Claim 7), and non-transitory computer-readable medium/CRM (Claim 14) — a complete tripartite structure providing enforcement coverage across all major claim types. The 17 dependent claims yield a 5.67:1 dependent-to-independent ratio, above the typical 4–8:1 norm for this G05D IPC class but functionally moderate given the breadth of each independent claim. A notable strategic choice is that all three independent claims are structurally parallel, sharing nearly identical core limitations around the ML training loop on teleoperator interactions, which concentrates validity risk at a single claim nucleus.
Independent Claim Dissection
| Claim | Preamble | Transition | Key Body Elements |
|---|---|---|---|
| Claim 1 | A method comprising | comprising | receiving sensor data from an autonomous vehicle; determining an event in a region of an environment based on sensor data, event associated with event data; receiving a teleoperator interaction associated with the event including a communication transmitted to and causing AV to perform an action; training based on teleoperator interaction and event a machine-learning (ML) model to output a recommended action based on sensor data or event dataSearch prior art ↗ |
| Claim 7 | A system comprising | comprising | one or more processors; memory having stored processor-executable instructions that when executed cause: receiving sensor data from AV; determining event in region of environment; receiving teleoperator interaction associated with event, the interaction associated with communication transmitted to AV; training based on teleoperator interaction and event a machine-learning (ML) model to output a recommended actionSearch prior art ↗ |
| Claim 14 | A non-transitory computer-readable medium comprising processor-executable instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising | comprising | receiving sensor data associated with AV; determining event in region of environment based on sensor data, event associated with event data; receiving teleoperator interaction associated with event; training based on teleoperator interaction and event a machine-learning (ML) model to output a recommended action based on sensor data or event dataSearch prior art ↗ |
Claim Dependency Tree
| Metric | This Application | Autonomous Vehicle / Software Industry Norm |
|---|---|---|
| Total claims | 20 | 15 – 25 |
| Independent claim count | 3 | 2 – 4 |
| Dependent : Independent ratio | 5.67 : 1 | 4 – 8 : 1 |
| Method claims present? | Yes — Claim 1 | Common |
| System / apparatus claims? | Yes — Claim 7 | Common |
Drafting Quality Signals
The patent demonstrates strong structural completeness through its tripartite method/system/CRM claim architecture and a large, technically rich specification. However, the three independent claims are near-verbatim replicas of each other with only superficial format changes — a strategic weakness that concentrates invalidity risk and limits prosecution flexibility, particularly given the absence of any explicitly claimed ML model architecture or training mechanism specificity in Claims 1, 7, and 14.
Strategic Intent Scorecard
Multi-dimensional assessment of this application's patent strategy quality, based on claim structure, specification depth, and prosecution positioning.
3 Critical Gaps in This Claim Set
A senior-attorney lens on the three highest-priority structural weaknesses — what each exposes in prosecution and litigation, and what a stronger filing would have done differently.
3 Critical Gaps in This Claim Set
See the full attorney-level analysis of what this application leaves unprotected — and how to draft it more defensively for your own filings.
US 11,061,398 B2 — key questions answered
Disclaimer: This analysis is generated by PatSnap Eureka AI based on publicly available patent data from the USPTO. It does not constitute legal advice and should not be relied upon as such. Patent data may be subject to change as prosecution progresses. Scores and assessments reflect automated analysis and may not capture all relevant legal or technical nuances. Always consult a qualified patent attorney for formal legal opinions on patentability, freedom to operate, or infringement.
PatSnap Eureka searches patents and data to answer instantly.