v0.1.6

What's New

• Support custom merge operation by @mthrok, @moto-meta in #1012, #1047, #1045
  Please check the documentation for usage https://facebookresearch.github.io/spdl/main/generated/spdl.pipeline.defs.Merge.html#spdl.pipeline.defs.Merge
• Introduce config system to change default queue/hook/callbacks by @moto-meta in #1018, #1042, #1033
  This allows to change the default Queue/TaskHook/ProfileHook so that teams/projects can use a standard one. This is particularly helpful to log the performance across organization without manually configuring it for each pipeline. https://facebookresearch.github.io/spdl/main/generated/spdl.pipeline.config.html

Bugfix

• Fix the return values of ordered pipe by @mthrok in #1024 (Thanks @EthanRosenthal for reporting #1023)
• Fix type annotation by @mthrok in #1062

What's Changed

• Remove type parameter from AsyncQueue by @mthrok in #1021
• Removes source annotation from PipelineConfig by @moto-meta in #1043
• Update Pipeline Queue annotation by @mthrok in #1025
• Throw if no input in profiling by @moto-meta in #1038
• Use weakref.finalize to clean up the Pipeline by @moto-meta in #1039

Examples

• Update benchmark scripts to save result to CSV by @moto-meta and @mthrok in #1017, #1019

Packaging

• Add missing 3.13t to Linux aarch64 build by @mthrok in #1014
• Lower to manylinux_2_26 for aarch64 by @mthrok in #1015

Documentation Update

• Mention diagnostic mode in profile_pipeline function by @mthrok in #1013

Internal / Refactor

• Move the type alias of callable to defs by @mthrok in #1004
• Refactor 1 - Move queue and hook by @moto-meta in #1026
• Refactor 2 - Move node by @moto-meta in #1027
• Refactor 3 - Build logic by @moto-meta in #1031
• Refactor 4 - Make agg and disagg specialized config by @moto-meta in #1028
• Refactor 5 - Add _cmponents/init.py by @moto-meta in #1029
• Refactor 6 - Use defs/init.py by @moto-meta in #1032
• Refactor 7 - Refactor utilities by @moto-meta in #1030
• Update import path by @moto-meta in #1037
• Remove op_require_eof from _PipeArgs by @moto-meta in #1040
• Set pyre-strict in _node.py by @moto-meta in #1046
• Migrate pipeline_profiling_test to Python unittest by @moto-meta in #1044
• Migrate configs_test.py from pytest to unittest by @vbourgin in #1057
• Migrate video_frame_slice_test.py from pytest to unittest by @vbourgin in #1053
• Migrate zero_copy_bytes_passing_test.py from pytest to unittest by @vbourgin in #1050
• Migrate video_encoding_test.py from pytest to unittest by @vbourgin in #1049
• Migrate frames_test.py from pytest to unittest by @vbourgin in #1058
• Migrate audio_decoding_test.py from pytest to unittest by @vbourgin in #1055
• Migrate tar_test.py from pytest to unittest by @vbourgin in #1056
• Migrate demuxer_test.py from pytest to unittest by @vbourgin in #1052
• Migrate image_decoding_test.py from pytest to unittest by @vbourgin in #1048
• Migrate async_test.py from pytest to unittest by @vbourgin in #1051
• Migrate audio_encoding_test.py from pytest to unittest by @vbourgin in #1054
• Migrate buffer_conversion_refcount_test.py from pytest to unittest by @vbourgin in #1059
• Migrate streaming_decoding_test.py from pytest to unittest by @vbourgin in #1066

Full Changelog: v0.1.5...v0.1.6