Member-only story

How to send data to BQ & GCS from On-prem via Hybrid connection

Rajathithan Rajasekar
3 min readJan 17, 2022

--

Photo by NordWood Themes on Unsplash

By default, when you send data from On-Prem hosts to a cloud storage bucket or a BigQuery dataset , they send data over the internet to these public api endpoints —[ https://bigquery.googleapis.com/ , https://storage.googleapis.com] and will not use your Hybrid connectivity between GCP & On-Prem to send the data.

In order to send data via the hybrid connection, there are 2 different options available , private google access for on-prem hosts and private services connect for on-prem hosts. Let’s see those 2 options.

In private google access, you have two special domains.

“ private.googleapis.com(199.36.153.8/30) and restricted.googleapis.com (199.36.153.4/30)”

Use Private.googleapis.com when you need access to most google apis from on-prem and use restricted.googleapis.com when your on-prem hosts need access to apis supported by VPC service controls and not to any other apis. You can get the detailed information from the below link.

--

--

Rajathithan Rajasekar
Rajathithan Rajasekar

Written by Rajathithan Rajasekar

I like to write code in Python . Interested in cloud , dataAnalysis, computerVision, ML and deepLearning. https://rajathithanrajasekar.medium.com/membership

No responses yet