Dagster - The Modern Data Orchestrator for Building Data Platforms

Dagster The Modern Data Orchestrator for Building Data Platforms

What is Dagster?

Dagster is a modern data orchestrator built for data engineers developing and managing data platforms. It provides a unified platform to develop, test, and monitor data pipelines with features designed to enhance productivity and confidence.

Dagster allows users to write pipelines with code and visualize them in the Dagster UI. The platform supports monitoring data quality and freshness, provides rich metadata and observability, and offers end-to-end data lineage. Dagster+ enhances the developer experience with features such as serverless or hybrid deployments, cost insights, a rich data catalog, and branching deployments for efficient testing.

Features

Code-based Pipeline Development: Write, develop, and test data pipelines with code.
dbt-native orchestration: Native support to orchestrate dbt models.
Task-based workflows: Create and manage workflows based on individual tasks.
Data Quality and Freshness Monitoring: Monitor data quality and freshness across the data platform.
Rich Metadata and Observability: Gain insights into the data platform with rich metadata and observability features.
End-to-End Data Lineage: Understand data flow from ingestion to BI with full data lineage.
Serverless/Hybrid Deployments: Choose between fully serverless or hybrid deployment options.
Cost Insights: Track costs associated with Dagster and external services.
Branching Deployments: Utilize branching deployments for easier testing.

Use Cases

Developing and testing data pipelines.
Monitoring data quality and ensuring data freshness.
Understanding data platforms with rich metadata.
Achieving end-to-end data lineage.
Orchestrating dbt models.
Managing data platform costs.
Building and scaling large-scale data platforms.

FAQs

How do you measure usage?

In Dagster+, credits measure the key events that drive your data platform, as well as the history and metadata for your assets. A credit is defined as the sum of asset materializations and ops executed. Every asset materialized in your pipeline counts as 1 credit. This includes assets defined as software-defined assets as well as asset materialization events logged from an op. Each op that executes counts as 1 credit. This applies whether the ops are executed in a job or as part of an underlying asset.
Do you have a free trial?

Yes. You can get access to everything Dagster+ has to offer, free for 30 days.
What payment methods do you offer? Can I be invoiced?

We accept credit and debt cards on our Start and Solo plans. Custom invoicing and ACH available to Pro customers.