JobWeaver v0.1.0 — Distributed Workflow Core

Initial functional milestone for JobWeaver — a distributed job orchestration system built on Spring Boot and Kafka.

This release introduces the core event-driven workflow pipeline across API, Scheduler, and Worker services.

Highlights

• Event-driven architecture using Kafka for job orchestration
• API service for job submission and event publishing
• Scheduler service implementing job lifecycle management and retry orchestration
• Worker service executing simulation instructions asynchronously
• Idempotent event processing with execution attempt tracking
• Manual Kafka acknowledgment with transactional processing boundaries
• Multi-in-flight per-partition processing with contiguous offset barrier coordination
• Exponential retry with scheduler-managed backoff
• Dead-letter queue handling for exhausted retries
• Distributed trace correlation using traceId propagation via Kafka headers
• MDC logging integration across services

Infrastructure

• Spring Boot 3 microservices
• Apache Kafka messaging layer
• PostgreSQL per-service database isolation
• Flyway database migrations
• Dockerized service setup

Architecture Concepts

• Event-carried state transfer
• Idempotent consumer design
• Explicit retry orchestration
• Failure isolation via DLQ
• Executor-based asynchronous job processing
• Partition-safe offset commit coordination

Upcoming Work

• Authentication service using Spring Authorization Server
• JWT-based service authentication
• API gateway integration
• Observability improvements (metrics/tracing)
• Production deployment configuration