Open in app

Sign in

Write

Sign in

Rajathithan Rajasekar
Rajathithan Rajasekar

190 Followers

Home

About

Oct 28

Quick way to learn the basics of Apache Beam Programming

Apache Beam Katas is a set of interactive beam coding exercises which helps to learn the Apache Beam concepts and Programming Model, Currently the coding exercises are available in Go, Kotlin, Java and Python. The link is given below, beam/learning/katas at master · apache/beam Beam Katas are interactive Beam coding exercises (i.e. code katas) that can help you to learn Apache Beam concepts and…github.com

Apache Beam

7 min read

Quick way to learn the basics of Apache Beam Programming
Quick way to learn the basics of Apache Beam Programming
Apache Beam

7 min read


Oct 24

How to connect to Private Cloud-SQL from DataProc

If you need to connect to private cloud sql from dataproc for your Hadoop / Spark batch jobs , then this post is for you. When we provision a dataproc cluster , there is an option to give the initialization action . Initialization actions | Dataproc Documentation | Google Cloud When creating a Dataproc cluster, you can specify initialization actions in executables or scripts that Dataproc will…cloud.google.com

Cloud Sql

2 min read

How to connect to Private Cloud-SQL from DataProc
How to connect to Private Cloud-SQL from DataProc
Cloud Sql

2 min read


Aug 13

How to create Dataflow Flex templates and trigger them from Cloud Functions-2

In my last medium post, I had discussed on how to create a custom classic dataflow template to load xml data from GCS to BigQuery. This is in continuation to that, so I would recommend going through the below post to get more details. How to load nested XML data from GCS into BigQuery via Dataflow If you are one among the few who still uses XML data to transfer / communicate between systems and wants that data to…rajathithanrajasekar.medium.com

Dataflow

5 min read

How to create Dataflow Flex templates and trigger them from Cloud Functions-2
How to create Dataflow Flex templates and trigger them from Cloud Functions-2
Dataflow

5 min read


Aug 11

How to load nested XML data from GCS into BigQuery via Dataflow

If you are one among the few who still uses XML data to transfer / communicate between systems and wants that data to be loaded into BigQuery for data analysis , then this post is for you. To get started enable the below APIs Dataflow API Dataflow Pipelines API BigQuery…

Dataflow

5 min read

How to load nested XML data from GCS into BigQuery via Dataflow
How to load nested XML data from GCS into BigQuery via Dataflow
Dataflow

5 min read


Jul 30

How to send email using cloud function after a pub/sub event trigger

In this post, we are going to see how to send email from cloud function using a customized html template by listening to a pub/sub event . Let’s take a scenario of notifying the completion of storage transfer service Job , So when the data transfer from AWS S3 to…

Cloud Functions

2 min read

How to send email from cloud function after a pub/sub event trigger
How to send email from cloud function after a pub/sub event trigger
Cloud Functions

2 min read


Jul 22

How to trigger Cloud Composer-2 DAG Pipelines from Cloud Functions-2

In this post , we are going to see how to trigger cloud composer-2 DAG from Cloud Functions-2. To start with , first enable the cloud composer API in the Google cloud console.

Google Cloud Composer

7 min read

How to trigger Cloud Composer-2 DAG Pipelines from Cloud Functions-2
How to trigger Cloud Composer-2 DAG Pipelines from Cloud Functions-2
Google Cloud Composer

7 min read


Mar 18

Quickguide to configure tensorflow and pytorch in Windows with Nvidia GPU

This blog post is a quick guide on the installation and configuration of the below softwares. Installation links are provided below Anaconda python distribution Nvidia Graphic drivers Compatible — CUDA toolkit Compatible — CuDNN DNN library Compatible — MS Visual Studio Setup of Conda environments and installation of required packages …

Pytorch

3 min read

Quickguide to configure tensorflow and pytorch in Windows with Nvidia GPU
Quickguide to configure tensorflow and pytorch in Windows with Nvidia GPU
Pytorch

3 min read


Mar 16

How to upload data to Google Cloud Firestore using python async client

In this post, we will see how to upload data to Google cloud firestore using asyncio and aiofiles packages for concurrent execution of code which speeds up the upload process. GCP firestore asynclient code snippets are available in the below link. python-docs-samples/firestore/cloud-async-client at main · GoogleCloudPlatform/python-docs-samples You can't perform that action at this time. You signed in with another tab or window. You signed out in another tab or…github.com

Python

2 min read

How to upload data to Google Cloud Firestore using python async client
How to upload data to Google Cloud Firestore using python async client
Python

2 min read


Mar 12

How to deploy a war file in a tomcat container pod and expose the service in GKE

In this post, we are going to see how to deploy a java war file inside a tomcat container pod and expose the endpoint as an external load balancer in google Kubernetes engine . Usually in container microservices CI/CD — we check in the code to a source control repository…

Tomcat

4 min read

How to deploy a war file in a tomcat container pod and expose the service in GKE
How to deploy a war file in a tomcat container pod and expose the service in GKE
Tomcat

4 min read


Mar 1

How to transfer a batch of data between GCS buckets using Cloud Functions

In this post, we will see how to transfer data from one cloud storage bucket to another cloud storage bucket using EventArc and CloudFunction. Let’s Consider a scenario where data is uploaded to source bucket at different times in a day and all these data needs to be staged together…

Google Cloud Platform

4 min read

How to transfer a batch of data between GCS buckets using Cloud Functions
How to transfer a batch of data between GCS buckets using Cloud Functions
Google Cloud Platform

4 min read

Rajathithan Rajasekar

Rajathithan Rajasekar

190 Followers

I like to write code in Python . Interested in cloud , dataAnalysis, computerVision, ML and deepLearning. https://rajathithanrajasekar.medium.com/membership

Following
  • FS Ndzomga

    FS Ndzomga

  • Kurtis Pykes

    Kurtis Pykes

  • OpenVINO™ toolkit

    OpenVINO™ toolkit

  • Sofien Kaabar, CFA

    Sofien Kaabar, CFA

  • Louis Bouchard

    Louis Bouchard

See all (82)

Help

Status

About

Careers

Blog

Privacy

Terms

Text to speech

Teams