Skip to content Skip to sidebar Skip to footer
Showing posts with the label Airflow

Running Google Colab Every Day At A Specific Time

I recently have built a Python program that runs on Google Colaboratory, I need to run the program … Read more Running Google Colab Every Day At A Specific Time

Simplehttpoperator Airflow, Data Templated

I'm trying to rendered correctly data inside a SimpleHttpOperator in Airflow with configuration… Read more Simplehttpoperator Airflow, Data Templated

How To Define Operations Of An Stfp Operator On Airflow?

class SFTPOperation(object): PUT = 'put' GET = 'get' operation=SFTPOpera… Read more How To Define Operations Of An Stfp Operator On Airflow?

"handling Signal: Ttou" Message While Running Dag In Airflow

I have created sample DAG, where I had DAG config as below. default_args = { 'owner': &… Read more "handling Signal: Ttou" Message While Running Dag In Airflow

Etl In Airflow Aided By Jupyter Notebooks And Papermill

So my issue is that I build ETL pipelines in Airflow, but really develop and test the Extract, Tran… Read more Etl In Airflow Aided By Jupyter Notebooks And Papermill

Airflow On Docker - Path Issue

Working with airflow I try simple DAG work. I wrote custom operators and other files that I want to… Read more Airflow On Docker - Path Issue

Unexpected Airflow Behaviour In Dynamic Task Generation

For reasons acceptable to me, I am trying to dynamically generate ExternalTaskSensor tasks with dif… Read more Unexpected Airflow Behaviour In Dynamic Task Generation

Reversed Upstream/downstream Relationships When Generating Multiple Tasks In Airflow

The original code related to this question can be found here. I'm confused by up both bitshift… Read more Reversed Upstream/downstream Relationships When Generating Multiple Tasks In Airflow