Dagster favicon

Dagster
The Modern Data Orchestrator for Building Data Platforms

What is Dagster?

Dagster is a modern data orchestrator built for data engineers developing and managing data platforms. It provides a unified platform to develop, test, and monitor data pipelines with features designed to enhance productivity and confidence.

Dagster allows users to write pipelines with code and visualize them in the Dagster UI. The platform supports monitoring data quality and freshness, provides rich metadata and observability, and offers end-to-end data lineage. Dagster+ enhances the developer experience with features such as serverless or hybrid deployments, cost insights, a rich data catalog, and branching deployments for efficient testing.

Features

  • Code-based Pipeline Development: Write, develop, and test data pipelines with code.
  • dbt-native orchestration: Native support to orchestrate dbt models.
  • Task-based workflows: Create and manage workflows based on individual tasks.
  • Data Quality and Freshness Monitoring: Monitor data quality and freshness across the data platform.
  • Rich Metadata and Observability: Gain insights into the data platform with rich metadata and observability features.
  • End-to-End Data Lineage: Understand data flow from ingestion to BI with full data lineage.
  • Serverless/Hybrid Deployments: Choose between fully serverless or hybrid deployment options.
  • Cost Insights: Track costs associated with Dagster and external services.
  • Branching Deployments: Utilize branching deployments for easier testing.

Use Cases

  • Developing and testing data pipelines.
  • Monitoring data quality and ensuring data freshness.
  • Understanding data platforms with rich metadata.
  • Achieving end-to-end data lineage.
  • Orchestrating dbt models.
  • Managing data platform costs.
  • Building and scaling large-scale data platforms.

FAQs

  • How do you measure usage?
    In Dagster+, credits measure the key events that drive your data platform, as well as the history and metadata for your assets. A credit is defined as the sum of asset materializations and ops executed. Every asset materialized in your pipeline counts as 1 credit. This includes assets defined as software-defined assets as well as asset materialization events logged from an op. Each op that executes counts as 1 credit. This applies whether the ops are executed in a job or as part of an underlying asset.
  • Do you have a free trial?
    Yes. You can get access to everything Dagster+ has to offer, free for 30 days.
  • What payment methods do you offer? Can I be invoiced?
    We accept credit and debt cards on our Start and Solo plans. Custom invoicing and ACH available to Pro customers.

Related Queries

Helpful for people in the following professions

Dagster Uptime Monitor

Average Uptime

100%

Average Response Time

124.03 ms

Last 30 Days

Related Tools:

Blogs:

  • Chat with PDF AI Tools

    Chat with PDF AI Tools

    Easily interact with your PDF documents using our advanced AI-powered tool. Whether you're reading lengthy reports, research papers, contracts, or eBooks, our platform lets you chat directly with your PDF files, ask questions, extract insights, and get summaries in real-time.

  • Best AI tools for recruiters

    Best AI tools for recruiters

    These tools use advanced algorithms and machine learning to automate tasks such as resume screening, candidate matching, and predictive analytics. By analyzing vast amounts of data quickly and efficiently, AI tools help recruiters make data-driven decisions, save time, and identify the best candidates for open positions.

  • Best AI tools for trip planning

    Best AI tools for trip planning

    These tools analyze user preferences, budget constraints, and destination details to provide personalized itineraries, suggest optimal routes, recommend accommodations, and even offer real-time updates on weather and local events.

  • Long Videos into Viral Shorts

    Long Videos into Viral Shorts

    Klap.app is an AI-powered video editing tool that transforms long-form videos into engaging short clips optimized for platforms like TikTok, Instagram Reels, and YouTube Shorts

Didn't find tool you were looking for?

Be as detailed as possible for better results