0.21.0
This release primarily fixes a number of bugs that were introduced as part of
the 0.20.0 ZenServer release. These significantly improve the stability when
using ZenML with the ZenML Server.
Notable fixes include:
- Improved the synchronization that transfers pipeline run information from
the MLMD database to the ZenML Server. This helps fix a number of issues with
missing steps in the post-execution workflow, model deployment steps and other
issues. - The Label Studio example is fixed and now works again end-to-end.
- The ZenML Label Studio integration can now be used with non-local (i.e.
deployed) instances. For more information see the Label Studiodocs.
New features and other improvements:
- ZenML now uses alembic for
automated database migrations. The migrations happen automatically after every
ZenML update. - New
zenml pipeline runs export / import / migrate
CLI commands are now
available to export, import and migrate pipeline runs from older, pre-0.20.0
versions of ZenML. The ZenML server now also automatically picks up older
pipeline runs that have been logged in the metadata store by ZenML prior to
0.20.0. - An MLMD gRPC service can now be deployed with the ZenML Helm chart to act
as a proxy between clients, orchestrators and the MySQL database. This
significantly reduces the time it takes to run pipelines locally. - You can now specify affinity and tolerations and node selectors to all
Kubernetes based orchestrators with the new Kubernetes Pod settings feature.
Breaking Changes
The following changes introduces with this release mey require some manual
intervention to update your current installations:
- the zenml server helm chart
values.yaml
file has been restructured to make
it easier to configure and to clearly distinguish between the zenml server
component and the newly introduced gRPC service component. Please update your
values.yaml
copies accordingly. - the Azure integration dependency versions have been updated. Please run
zenml integration install azure
to update your current installation, if
you're using Azure.
What's Changed
- Implement automatic alembic migration by @AlexejPenner in #990
- Fix GCP Artifact Store listdir empty path by @safoinme in #998
- Add flavors mini-video to docs by @strickvl in #999
- Remove the Client() warning when used inside a step by @stefannica in #1000
- Fix broken links caused by updated by @AlexejPenner in #1002
- Fix
FileNotFoundError
with remote path in HuggingFace Dataset materializer by @gabrielmbmb in #995 - Add
zenml pipeline runs export / import / migrate
CLI commands by @fa9r in #977 - Log message when activating a stack as part of registration by @schustmi in #1005
- Minor fixes in Migration to 0.20.0 documentation by @alvarobartt in #1009
- Doc updates by @htahir1 in #1006
- Fixing broken links in docs by @dnth in #1018
- Label Studio example fix by @strickvl in #1021
- Docs for using CUDA-enabled docker images by @strickvl in #1010
- Add social media heading on docs page by @dnth in #1020
- Add executing custom command for getting requirements by @gabrielmbmb in #1012
- Delay user instruction in dockerfile generation by @schustmi in #1004
- Update link checker configs for faster, more accurate checks by @dnth in #1022
- Add
pip install zenml[server]
to relevant examples by @dnth in #1027 - Add Tolerations and NodeAffinity to Kubernetes executor by @wefner in #994
- Support pydantic subclasses in BaseParameter attributes by @schustmi in #1023
- Unify run names across orchestrators by @schustmi in #1025
- Add gRPC metadata service to the ZenML helm chart by @stefannica in #1026
- Make the MLMD pipeline run information transfer synchronous by @stefannica in #1032
- Add console spinner back by @strickvl in #1034
- Fix Azure CLI auth problem by @wjayesh in #1035
- Allow non-local Label Studio instances for annotation by @strickvl in #1033
- Before deleting the global zen_server files, spin it down by @AlexejPenner in #1029
- Adding zenserver integration to stack recipe CLI by @wjayesh in #1017
- Add support for Azure ZenServer by @wjayesh in #1024
- Kubernetes Pod settings by @schustmi in #1008
New Contributors
- @alvarobartt made their first contribution in #1009
- @wefner made their first contribution in #994
Full Changelog: 0.20.5...0.21.0