How to trigger Cloud Composer-2 DAG Pipelines from Cloud Functions-2

Photo by Ricardo Gomez Angel on Unsplash

In this post , we are going to see how to trigger cloud composer-2 DAG from Cloud Functions-2. To start with , first enable the cloud composer API in the Google cloud console.

Cloud Composer API

Next, we will select cloud composer-2 to provision the environment .

Note: CloudComposer-2 has the advantage of Autoscaling (GKE Auto-Pilot) over cloud composer-1. Detailed comparison is available in the Google cloud documentation site below.

Cloud Composer versioning overview | Google Cloud

Before provisioning , it is recommended to create a custom network for cloud composer. I have created a node subnet, services subnet and pod subnet. Post creation , these subnet ranges can be selected in the Network configuration of the cloud composer.