User-Community Airflow Helm Chart完全指南如何在Kubernetes上部署Apache Airflow【免费下载链接】chartsThe User-Community Airflow Helm Chart is the standard way to deploy Apache Airflow on Kubernetes with Helm. Originally created in 2017, it has since helped thousands of companies create production-ready deployments of Airflow on Kubernetes.项目地址: https://gitcode.com/gh_mirrors/charts27/chartsUser-Community Airflow Helm Chart是在Kubernetes上使用Helm部署Apache Airflow的标准方式。自2017年创建以来它已帮助数千家公司在Kubernetes上创建了生产就绪的Airflow部署。本指南将为你提供使用该Helm Chart在Kubernetes上部署Apache Airflow的完整步骤从环境准备到最终访问Airflow UI让你轻松上手。准备你的部署环境在开始部署之前确保你的环境满足以下要求Kubernetes1.18Helm3.0(installing helm)(可选) 配置包含DAG文件的Git仓库 (loading dag definitions)(可选) 用于CeleryExecutor的外部PostgreSQL或MySQL数据库 (connecting your database)(可选) 用于CeleryExecutor的外部Redis数据库 (connecting your redis)Tip要部署User-Community Airflow Helm Chart你需要一个Kubernetes集群。以下是一些流行的Kubernetes发行版按平台分类PlatformKubernetes DistributionLocal Machinek3dLocal MachinekindLocal MachineminikubeAmazon Web ServicesAmazon Elastic Kubernetes Service (EKS)Microsoft AzureAzure Kubernetes Service (AKS)Google CloudGoogle Kubernetes Engine (GKE)Alibaba CloudAlibaba Cloud Container Service for Kubernetes (ACK)IBM CloudIBM Cloud Kubernetes Service (IKS)添加Helm仓库执行以下命令将仓库添加到你的Helm## add this helm repository helm repo add airflow-stable https://airflow-helm.github.io/charts ## update your helm repo cache helm repo update创建自定义Values文件Helm图表通过values进行配置图表的所有values列表都在图表的values.yaml文件中该文件也设置了默认值。User-Community Airflow Helm Chart有数量极多的values超过1000个但不必担心你可以从定义一些重要的values开始然后逐步扩展你的custom-values.yaml。我们建议你从我们的示例中开始创建custom-values.yaml文件CeleryExecutorKubernetesExecutorCeleryKubernetesExecutorTip以下链接将帮助你扩展custom-values.yaml以满足你的需求Docs: Key FeaturesDocs: Frequently Asked QuestionsDocs: ExamplesDocs: Helm Values安装Airflow Chart## set the release-name namespace export AIRFLOW_NAMEairflow-cluster export AIRFLOW_NAMESPACEairflow-cluster ## create the namespace kubectl create ns $AIRFLOW_NAMESPACE ## install using helm 3 helm install \ $AIRFLOW_NAME \ airflow-stable/airflow \ --namespace $AIRFLOW_NAMESPACE \ --version 8.X.X \ --values ./custom-values.yaml ## wait until the above command returns and resources become ready ## (may take a while)Warning始终固定--version这样你就不会意外更新图表版本Tip在我们的CHANGELOG中找到完整的图表版本列表在GitHub上Watch 以获取有关新图表版本的通知点击watch→custom→releases。访问Airflow UI## port-forward the airflow webserver kubectl port-forward svc/${AIRFLOW_NAME}-web 8080:8080 --namespace $AIRFLOW_NAMESPACE ## open your browser to: http://localhost:8080 ## (default login: admin/admin)Tip了解更多关于身份验证的信息Manage Airflow UsersIntegrate Airflow with LDAP or OAUTH常见配置与管理配置数据库Configure Database (External)Configure Database (Built-In)Configure PgBouncer配置RedisConfigure Redis (Built-In)Configure Database (External)管理Airflow组件Manage Airflow PluginsInstall Extra Python/Pip PackagesConfigure Celery Worker Autoscaling管理DAGsLoad Airflow DAGsManage Airflow ConnectionsManage Airflow VariablesManage Airflow Pools安全设置Set Airflow Fernet Encryption KeySet Airflow Webserver Secret Key监控与日志Integrate Airflow with PrometheusManage Airflow LogsManage Airflow Logs CleanupKubernetes相关配置Configure Kubernetes IngressMount Extra Persistent VolumesMount Files from Secrets/ConfigMapsMount Environment Variables from Secrets/ConfigMapsConfigure Pod Affinity/Selectors/TolerationsInclude Extra Kubernetes Manifests升级与卸载指南升级Airflow Chart如需升级已部署的Airflow Chart可参考Upgrade Guide。卸载Airflow Chart若要卸载Airflow Chart可按照Uninstall Guide进行操作。通过本指南你已经掌握了使用User-Community Airflow Helm Chart在Kubernetes上部署、配置和管理Apache Airflow的基本方法。如有更多需求可查阅项目的官方文档获取更详细的信息。【免费下载链接】chartsThe User-Community Airflow Helm Chart is the standard way to deploy Apache Airflow on Kubernetes with Helm. Originally created in 2017, it has since helped thousands of companies create production-ready deployments of Airflow on Kubernetes.项目地址: https://gitcode.com/gh_mirrors/charts27/charts创作声明：本文部分内容由AI辅助生成（AIGC），仅供参考