Release 0.4.0

Release Notes for v0.4.0

New Features

• Column-level configuration: Configure profiling, drift detection, and anomaly detection at the column level with custom metrics and thresholds
• Schema-level configuration: Apply configuration across all tables within a schema
• Database-level configuration: Apply configuration across all schemas within a database
• BYOK LLM for human-readable alerts: Bring your own LLM provider (OpenAI, Anthropic, Azure, Ollama) to generate natural language explanations for drift and anomaly alerts

Improvements

• License update: Migrated to Apache 2.0 license

Maintenance

• Removed deprecated dbt integration code: Cleaned up old dbt integration testing and deprecated functionality

Release 0.3.0

Release v0.3.0

New Features

dbt Integration

Comprehensive dbt integration for scalable profiling and drift detection within dbt workflows.

Component 1: dbt Refs/Selectors in Baselinr Configs

• Use dbt model references (dbt_ref) directly in baselinr table patterns
• Support for dbt selectors (e.g., tag:critical, config.materialized:table)
• Leverage dbt tags for scalable table selection
• Automatic resolution of dbt models to database tables via manifest parsing

Database Configuration Support

• Specify database at the table pattern level
• Override the default database from source.database per pattern
• Enables multi-database profiling in a single configuration

Example:
profiling:
tables:
- database: analytics_db
schema: public
pattern: "users_*"
- database: staging_db
schema: public
table: events## Improvements

• Enhanced dbt manifest parsing to check both node.tags and node.config.tags for tag resolution
• Improved dbt selector resolution with support for multiple tag locations
• Added local testing scripts for dbt integration (bash and PowerShell)
• Added test script for debugging with existing manifest.json files

Bug Fixes

• Fixed dbt integration CI workflow to correctly install baselinr package
• Fixed GitHub Actions workflow syntax (always() function)
• Fixed dbt tag resolution to check both top-level tags and config tags
• Added proper permissions block to dbt-integration workflow

Documentation

• Added comprehensive dbt Integration Guide
• Added dbt package README with usage examples
• Added local testing documentation for dbt integration
• Updated development guide with dbt integration information

Related

• Full changelog: v0.2.0...v0.3.0
• dbt Integration PR: #35
• Database Configuration PR: #34

---

Upgrade:
pip install --upgrade "baselinr[dbt]>=0.3.0"

Release 0.2.0

Release 0.2.0

This release was automatically created from tag v0.2.0.

Installation

pip install baselinr==0.2.0

What's Changed

Major feature: pattern-based table selection

• Pattern-based table selection: use wildcards (user_*, *_staging) or regex patterns to profile multiple tables
• Schema-level profiling: profile all tables in a schema with select_schema: true
• Database-level profiling: profile all tables across all schemas with select_all_schemas: true
• Tag-based selection: filter tables using database metadata tags (Snowflake object tags, BigQuery labels, PostgreSQL comments, etc.) or dbt tags from manifest.json
• Advanced filtering: exclude patterns, filter by table types, row counts, required columns, and modification dates
• Precedence override system: use specific table configurations to override broader pattern matches with priority-based resolution
• Multi-database tag support: tag-based selection across PostgreSQL, Snowflake, SQLite, MySQL, BigQuery, and Redshift
• Performance safeguards: configurable limits for large schemas with caching and discovery limits

Developer SDK improvements

• Initial developer SDK released: programmatic access to Baselinr functionality via Python SDK
• Enhanced programmatic interface for integration into custom workflows

Documentation and website updates

• Migrated documentation to Docusaurus: improved documentation site and navigation
• Updated website structure for better discoverability

Bug fixes

• Fixed pattern expansion bug preventing proper table discovery in profile commands
• Fixed Dagster integration to correctly handle pattern-based configurations
• Improved error handling and validation throughout the codebase

Other changes

• License update: Updated to Apache 2.0 with commercial distribution restrictions
• CI/CD improvements: Fixed Windows emoji handling and Python 3.12 compatibility issues

See the full changelog for details.

Release 0.1.3

Release 0.1.3

This release was automatically created from tag v0.1.3.

Installation

pip install baselinr==0.1.3

What's Changed

See the full changelog for details.

Release 0.1.2

Release 0.1.2

This release was automatically created from tag v0.1.2.

Installation

pip install baselinr==0.1.2

What's Changed

See the full changelog for details.