Member-only story
Mutliprocessing stackdriver log extraction
In this post, we are going to see how we can multiprocess stackdriver log extraction in your local system, if you had any experience in using “ gcloud logging read” in your local system to extract the stackdriver logs , you would have noticed that it takes lot of time to extract the logs from stackdriver.
This script is especially useful in case you dont have a Log Sink configured for your environment, it will help to speed up the extraction process. If someone could improve the script , you are more than welcome to do so, i have shared the github link for your reference. Please let me know if someone comes up with a better version.
Also i think , It wound be nice, if google cloud can add the feature of multiprocessing the log read in gcloud command line.
The scripts checks for the gcloud installation, if gcloud sdk is present in your system , the script will execute further or it will exit, Then it retrieves your current account and current project. [ I would recommend setting your current account and current project before executing this script ]
