Guides
These guides cover every major feature of NPipeline with practical code examples. Each guide is self-contained - read them in any order depending on what you need.
New to NPipeline? Start with Defining Pipelines, then move to Lambda Nodes or Custom Nodes depending on your preference.
Defining and Running Pipelines
- Defining Pipelines - fluent builder API and class-based definitions
- Lambda Nodes - inline node definitions with delegates
- Custom Nodes - implement source, transform, and sink nodes
- Pipeline Context - runtime parameters, shared state, and framework services
- Dependency Injection - integrate with Microsoft.Extensions.DependencyInjection
- Pipeline Validation - validate graph structure before execution
Data Flow Patterns
- Branching and Merging - fan-out, taps, and fan-in
- Routing with RouteNode - conditional fan-out with named route outputs
- Batching and Windowing - group items by size, time, or intent
- Joins and Lookups - keyed joins, time-windowed joins, and lookup enrichment
- Aggregation - reduce streams with aggregate and advanced aggregate nodes
- Pipeline Composition - embed reusable sub-pipelines
Execution and Performance
- Optimization Profiles - choose between batteries-included defaults and zero-allocation strict mode
- Parallel Execution - concurrent transforms with backpressure control
- Streaming Large Datasets - memory-efficient lazy data streams