![]() ![]() warning ( "Could not import DAGs in example_kubernetes_executor_config.py: %s ", str ( e )) log. """ import logging import os from airflow import DAG from airflow.example_ import print_stuff from import PythonOperator from import days_ago default_args =, ) start_task > volume_task > third_task start_task > other_ns_task start_task > sidecar_task start_task > task_with_template except ImportError as e : log. > On Mon, at 5:57 PM Bolke de Bruin <> wrote.> I particularly like the draggable grid view split and how log view > auto-adjusts (and that it stays sticky between reloads) - this is a > huge UX improvement for the Grid view. """ This is an example dag for using a Kubernetes Executor Configuration. I tested a > few DAGs, looked around the new small UI improvements. ![]() Airflow has two strict requirements for pod template files: base image and pod name. Let’s first setup Airflow with the CeleryExecutor as follows helm install airflow stable/airflow -f chapter2/airflow-helm-config-celery-executor.yaml -version 7.2.0 You should see the. You must provide the path to the template file in the podtemplatefile option in the kubernetes section of airflow.cfg. See the License for the # specific language governing permissions and limitations # under the License. podtemplatefile To customize the pod used for k8s executor worker processes, you may create a pod template file. You may obtain a copy of the License at # Unless required by applicable law or agreed to in writing, # software distributed under the License is distributed on an # "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY # KIND, either express or implied. The Kubernetes Executor allows you to run all the Airflow tasks on Kubernetes as separate Pods. The ASF licenses this file # to you under the Apache License, Version 2.0 (the # "License") you may not use this file except in compliance # with the License. See the NOTICE file # distributed with this work for additional information # regarding copyright ownership. This email is calling a vote on the release, which will last at least 72 hours+1day for Thanksgiving/Long weekend, from Friday, Novemat 6:30 am UTC until Wednesday, Novemat 6:30 am UTC, and until 3 binding +1 votes have been received. # Licensed to the Apache Software Foundation (ASF) under one # or more contributor license agreements. tseruga on helm install mini-af -f values.yaml bitnami/airflow Run a DAG Observe the worker pods fail to initialize Output of helm version: Did you install any custom plugin in Airflow (see loading custom plugins ) Are you using the default podtemplate.yaml or did you set the worker.podTemplate parameter to customize it. Hey fellow Airflowers, I have cut Airflow 2.5.0rc1. ![]()
0 Comments
Leave a Reply. |
Details
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |