Version 2.14.0
This release is a version alignment release. This release succeeds the KFP 2.5.0 release. In this 2.14.0 release, KFP backend is aligned in major and minor versions (X.Y) with all the KFP python packages. Please read more about this and the KFP versioning policy here.
What's Changed
- chore(sdk): kfp and kfp-kubernetes 2.13 & 1.5 by @HumairAK in #11870
- update release doc paths & make script executable by @HumairAK in #11871
- chore(components): GCPC 2.20.0 Release by @copybara-service[bot] in #11869
- chore(components): Relax KFP SDK dependency for GCPC by @copybara-service[bot] in #11879
- chore: bump master to release 2.5 by @HumairAK in #11872
- chore(deps): bump sagemaker from 2.1.0 to 2.237.3 in /components/aws/sagemaker by @dependabot[bot] in #11876
- Internal cleanup by @copybara-service[bot] in #11877
- feat(backend): Add the Kubernetes native pipeline store by @mprahl in #11881
- fix(sdk): resolve issue when creating pipeline version from pipeline name using the cli. Fixes #11810 by @chjdev in #11866
- fix(backend): Stop logging the strack trace on benign user errors by @mprahl in #11883
- chore: update all owners files by @HumairAK in #11886
- feat(backend): Allow the launcher command to be configurable by @mprahl in #11888
- feat(backend/sdk): enable dsl.Collected for parameters & artifacts by @zazulam in #11725
- fix(sdk): fix pip install for dev by @dandawg in #11891
- chore: Adding Adopters file for CNCF graduation by @franciscojavierarceo in #11894
- feat(backend): parameterize retryStrategy input in Argo workflow by @alyssacgoins in #11861
- chore: Add mprahl to the samples owners file by @mprahl in #11897
- chore: handle empty tolerations dict/lists parrameterization by @HumairAK in #11898
- feat(backend): add the option to enable/disable cache globally by @hbelmiro in #11831
- feat(frontend): Add "Always Use Latest Version" option for recurring runs (fixes #11581) by @kaikaila in #11755
- add maintainer to kfp by @HumairAK in #11900
- chore: correct broken links in README.md by @Shekharrajak in #11896
- fix(sdk): Resolves issue when using ParallelFor with param and depending tasks by @mai-nakagawa in #11903
- chore(components): fix v1 model_evaluations components mingled under the preview module by @copybara-service[bot] in #11902
- feat(backend): Add migration script to create Pipeline and PipelineVersion objects from the database to Kubernetes API by @VaniHaripriya in #11884
- chore(components): GCPC 2.20.1 Release by @copybara-service[bot] in #11909
- chore: Add IBM Research Foundation Model Data Engineering team by @anishasthana in #11905
- chore(tests): fix KFP SDK tests by @hbelmiro in #11911
- chore(backend): break up driver logic by @HumairAK in #11885
- chore(components): Update OS packages in GCPC container image by @copybara-service[bot] in #11912
- feat(backend): Add CLI flags to support Kubernetes native API implementation by @VaniHaripriya in #11907
- chore(test): Update cache test timeout and polling intervals by @hbelmiro in #11916
- docs(KEP): Propose a new pipeline run workspace feature by @mprahl in #11875
- chore(backend): upgrade mysql to 8.4 by @HumairAK in #11917
- chore: Enable go fmt as a lint check for Go code by @cmdevoto in #11830
- chore(test): fixed log collection in tests by @hbelmiro in #11910
- feat(proto): Add WorkspaceConfig and KubernetesWorkspaceConfig message types to pipeline_spec proto by @VaniHaripriya in #11921
- chore(ci): clean up unnecessary parentheses and fix the formatting of the CI files by @lekaf974 in #11926
- docs(frontend): add ui dev docs by @HumairAK in #11931
- feat: add openshift env to manifests by @HumairAK in #11932
- chore: Updating KFP docs by @franciscojavierarceo in #11927
- docs: add GoLand-specific configs to backend Readme by @alyssacgoins in #11919
- test: Update the Kubernetes and Python version ranges in the CI by @mprahl in #11924
- feat(backend) implement retryStrategy for nested pipelines by @alyssacgoins in #11908
- chore(deps): bump tornado from 6.4.2 to 6.5.1 in /test/sample-test by @dependabot[bot] in #11936
- fix(tests): free up space in kfp samples test workflow by @alyssacgoins in #11942
- chore: pipeline api spec minor release by @HumairAK in #11939
- docs(frontend): added build instruction to readme by @rsun19 in #11943
- chore: Nest sdk docs by @anishasthana in #11945
- chore: Adding Devin's DeepWiki to README by @franciscojavierarceo in #11948
- docs(frontend): Added clean up section to openshift docs by @rsun19 in #11951
- chore: add c1 to ADOPTERS.md by @zazulam in #11954
- feat(sdk): update PipelineConfig to reflect new workspace Protobuf changes by @VaniHaripriya in #11934
- feat(backend/frontend): Add the name field for pipelines and pipeline versions by @mprahl in #11952
- feat(frontend) Use native k8s probes for pipeline-ui by @LaurentGoderre in #11955
- chore(deps): bump torch from 2.6.0 to 2.7.1 in /samples/contrib/ibm-samples/ffdl-seldon/source/seldon-pytorch-serving-image by @dependabot[bot] in #11959
- fix(cache): Optimize cache expiration query solves #11614 by @cbartram in #11920
- feat(backend/sdk): support PipelineTaskFinalStatus input by @alyssacgoins in #11953
- feat(backend): Use native k8s probes for api-server and visualization by @LaurentGoderre in #11960
- test(backend): Add unit test for NewLauncherV2 by @jpthompson23 in #11854
- chore(deps): bump requests from 2.18.4 to 2.32.4 in /components/contrib/arena/docker by @dependabot[bot] in #11963
- fix(backend): Fix the pipeline samples by @mprahl in #11967
- chore(deps): bump requests from 2.32.2 to 2.32.4 in /test/kfp-functional-test by @dependabot[bot] in #11966
- fix(test): Fix the frontend sample test by @mprahl in #11968
- chore(deps): bump brace-expansion in /test/frontend-integration-test by @dependabot[bot] in #11971
- chore(deps): bump brace-expansion from 1.1.11 to 1.1.12 in /frontend by @dependabot[bot] in #11972
- chore(deps): bump brace-expansion from 1.1.11 to 1.1.12 in /frontend/server by @dependabot[bot] in #11978
- chore(deps): bump protobuf from 4.25.3 to 4.25.8 in /test/kfp-functional-test by @dependabot[bot] in #11985
- user master for dev manifests by @HumairAK in #11977
- chore(deps): bump protobuf from 4.25.4 to 4.25.8 in /test/sample-test by @dependabot[bot] in #11986
- chore(deps): bump urllib3 from 1.26.15 to 2.5.0 in /components/aws/sagemaker by @dependabot[bot] in #11993
- chore: update workflows to test proto changes in ci by @zazulam in #11995
- fix(apiserver): fix typos in resource_manager.go: by @milosjava in #11998
- fix(backend): Fix boolean flag syntax for
--cache_disabledand update test to cover pipelines with outputs by @hbelmiro in #12001 - chore(backend): upgrade minio-go to v7 by @HumairAK in #12005
- chore(backend): Fixed warnings in Dockerfiles by @hbelmiro in #12003
- chore(deps): bump urllib3 from 2.4.0 to 2.5.0 in /sdk/python by @dependabot[bot] in #11999
- chore(docs): change adrs to kep in contrib doc by @HumairAK in #12011
- chore(deps-dev): bump pbkdf2 from 3.1.2 to 3.1.3 in /frontend by @dependabot[bot] in #12007
- feat(ui): add
ESCshortcut for closing SidePanel. Fixes #11873 by @EnyMan in #11874 - feat(docs): erdiagram of kfp-db by @112358fn in #12009
- fix(components): Changed method_whitelist. Fixes #11880 by @Tlaquetzal in #11961
- feat(sdk): Add Support for Docker Container Run Arguments by @BieniekAlexander in #12006
- fix: input resolution with set_display_name by @zazulam in #11938
- chore: Migrate busybox images form registory.k8s.io to ghcr by @akagami-harsh in #12014
- chore(components): Bump image version for Structured Data pipelines by @copybara-service[bot] in #12004
- fix(sdk): Fixes for Identifying Untagged Images for Running by @BieniekAlexander in #11984
- fix(sdk): Move version info to version.py for editable installs. by @therrshan in #11997
- feat(backend): Add support for platform specs on K8s native API by @mprahl in #12016
- chore(deps): Update go-grpc-middleware to v2 by @mprahl in #12043
- feat(backend): support for optional input parameters in nested pipelines by @alyssacgoins in #11980
- feat(docs): Guide to report security vulnerabilities by @andreyvelich in #12044
- add new KFP maintainers by @HumairAK in #12059
- fix: Delete the pipeline along with its all versions. Fixes #11665 by @milinddethe15 in #12019
- chore(components): Bump image version for Structured Data pipelines by @copybara-service[bot] in #12057
- feat(backend): update Argo Workflow Compiler to create workspace PVCs by @VaniHaripriya in #11982
- fix(backend): increase max_metadata_size for ml-metadata grpc server by @droctothorpe in #12062
- Fix broken Pipeline Root documentation link by @mustachemo in #12051
- chore(deps): bump on-headers and compression in /frontend by @dependabot[bot] in #12064
- docs: Add a proposal for Model Registry integration by @mprahl in #12020
- docs(KEP): Adding a proposal for the overhaul of tests in the KFP project by @nsingla in #11991
- feat(sdk): Add support for compiling pipelines to Kubernetes native format in SDK by @VaniHaripriya in #12012
- chore(deps): bump golang.org/x/oauth2 from 0.0.0-20210628180205-a41e5a781914 to 0.27.0 in /test/tools/project-cleaner by @dependabot[bot] in #12066
- chore: Update owners instructions to ensure other locations are up to date by @anishasthana in #12069
- chore(deps): bump golang.org/x/oauth2 from 0.22.0 to 0.27.0 by @dependabot[bot] in #12070
- chore(deps): bump urllib3 from 2.2.3 to 2.5.0 in /backend/metadata_writer by @dependabot[bot] in #12025
- chore(docs): Added new AI/ML lifecycle blog post link to README.md by @hbelmiro in #12065
- fix(sdk): Support partial replace of placeholders in dict/list objects by @mai-nakagawa in #12039
- chore: Upgrade Argo Workflows to v3.6.7, bump golang version to v.1.24 by @hbelmiro in #12072
- chore(deps): bump github.com/go-viper/mapstructure/v2 from 2.2.1 to 2.3.0 by @dependabot[bot] in #12076
- fix(backend/sdk): update proto packages by @HumairAK in #12067
- fix: backwards compatibility for pipeline spec task_name by @zazulam in #12061
- chore(backend): resolve linting errors by @HumairAK in #12083
- chore: Switch Argo Workflows manifests to remote Git references by @hbelmiro in #12074
- feat(backend): Support more than one label & annotations setting per component by @alyssacgoins in #12049
- feat(sdk) Add Input Parameter support for node affinity by @VaniHaripriya in #12028
- chore(components): Bump image version for Structured Data pipelines by @copybara-service[bot] in #12091
- fix(sdk,backend): Make the workspace size required by @mprahl in #12094
- fix(deps): revert metadata_writer k8s version by @zazulam in #12099
- fix(backend): omit unknown fields in json marshaling by @HumairAK in #12101
- add versioning policy for KFP by @HumairAK in #12105
New Contributors
- @chjdev made their first contribution in #11866
- @franciscojavierarceo made their first contribution in #11894
- @kaikaila made their first contribution in #11755
- @Shekharrajak made their first contribution in #11896
- @cmdevoto made their first contribution in #11830
- @lekaf974 made their first contribution in #11926
- @rsun19 made their first contribution in #11943
- @LaurentGoderre made their first contribution in #11955
- @cbartram made their first contribution in #11920
- @jpthompson23 made their first contribution in #11854
- @milosjava made their first contribution in #11998
- @EnyMan made their first contribution in #11874
- @112358fn made their first contribution in #12009
- @Tlaquetzal made their first contribution in #11961
- @BieniekAlexander made their first contribution in #12006
- @therrshan made their first contribution in #11997
- @mustachemo made their first contribution in #12051
Full Changelog: 2.5.0...2.14.0