Skip to content

Conversation

@wietzesuijker
Copy link
Contributor

@wietzesuijker wietzesuijker commented Oct 24, 2025

Comprehensive test suite for data-pipeline scripts.

Unit Tests

tests/unit/test_convert.py

  • Conversion configs (S1/S2 groups, CRS, chunks, tiles, sharding)
  • Mission detection from collection IDs
  • Config validation

tests/unit/test_register.py

  • S3 URL conversion (s3:// → https://)
  • Asset href rewriting
  • STAC item upsertion
  • Projection extension from zarr
  • Visualization links (S1 VH, S2 TCI)

Integration Tests

tests/integration/test_pipeline_e2e.py

  • End-to-end conversion workflow
  • S1/S2 collection parameter dispatch
  • Workflow template compatibility

CI

.github/workflows/test.yml

  • pytest on Python 3.13
  • pre-commit hooks
  • Coverage reporting

Note: Refactored from original PR targeting slim branch. Updated to test consolidated scripts (convert.py, register.py) instead of 8+ deprecated scripts.

@wietzesuijker wietzesuijker force-pushed the slim branch 15 times, most recently from 96e2de5 to efe5618 Compare October 30, 2025 07:17
@wietzesuijker wietzesuijker changed the base branch from slim to main October 30, 2025 10:02
@wietzesuijker wietzesuijker force-pushed the feat/unit-tests branch 2 times, most recently from 980d314 to 5142a4a Compare October 30, 2025 10:34
- Unit tests for all 6 core scripts
- Test fixtures and test infrastructure
- CI integration with pytest

Tests cover:
- augment_stac_item.py - Projection and visualization augmentation
- create_geozarr_item.py - GeoZarr conversion wrapper
- get_conversion_params.py - Collection parameter lookup
- register_stac.py - STAC item creation and registration
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants