Skip to content

feat: Add coordinator setting deltas_batch_progress_size #1538

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
as51340 wants to merge 1 commit into
base: memgraph-3-9
Choose a base branch
from
Open

feat: Add coordinator setting deltas_batch_progress_size #1538

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 14 additions & 0 deletions pages/clustering/high-availability/best-practices.mdx
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -279,6 +279,20 @@ The configuration value can be controlled using the query:
SET COORDINATOR SETTING 'max_replica_read_lag' TO '10' ;
```

### `deltas_batch_progress_size`

Users can control how often replicas report back to main that they're stil processing the data (transactions, WALs, snapshots)
the main has sent to them. The default value is 100'000 which should be enough for the big part of your transactions.
However, if processing 100'000 deltas take more than 30s (because you're dealing with large deltas or you have older CPUs)
, you can set the configuration value `deltas_batch_progress_size` to a smaller value. This will avoid timeouts on replicas social
you won't see query exception "At least one SYNC replica has not committed" but at the cost of a lower throughput since replica
will sending more often in-progress messages to the main.

```
SET COORDINATOR SETTING 'deltas_batch_progress_size' TO '50000' ;
```


## Observability

Monitoring cluster health is essential. Key metrics include:
Expand Down