Do not use fivetran synced dates older than or equal March 9 2024 [prod]

[lukaszgryglicki]

cc @mlehotskylf @ahmedomosanya

Signed-off-by: Lukasz Gryglicki [email protected]

Assisted by OpenAI

Assisted by GitHub Copilot

[coderabbitai]

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

✨ Finishing touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Post copyable unit tests in a comment
• Commit unit tests in branch unicron-4862-use-only-newer-fivetran-sync-dates-prod

---

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

[Copilot]

Pull Request Overview

This PR adds logic to skip using Fivetran synced dates that are on or before March 9, 2024, likely due to data quality concerns with older Fivetran data in the signature timestamp backfill process.

Key changes:

• Introduced a cutoff date constant for filtering unreliable Fivetran data
• Added validation logic to check if Fivetran timestamps fall before the cutoff
• Modified the snowflakeFix function to skip Fivetran data when timestamps are too old

---

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.