[Feature]: QA pairs to generate by chunk size #63
Description
Is your feature request related to a problem? Please describe.
The current configuration has num_pairs parameter which generates QA per document. Would it be possible to tie that to the number of chunks instead? I mean if I have document that is split into 29 chunks and another one with 200 chunks, and the parameter num_pairs is 25 then it wouldn't make sense to have only 25 QAs for both documents.
Describe the solution you'd like
I would like to see a parameter like:
num_pairs_per_chunk: [integer]
instead of
num_pairs: [integer]
Describe alternatives you've considered
No response
Additional context
No response