It all started when I wanted to check the performance of JSON of MYSQL and JSONB of PostgreSQL I am a big fan of PostgreSQL for its power and I have read N number of articles showing why PostgreSQL is better than MySQL Various Benchmarks and research done to prove[...]
Read moreAuthor: Sarav AK
How to Subscribe Private Endpoint Internal HTTP URL to SNS - AWS
In this article, we will see an interesting use case or system design where we want to connect AWS SNS to an internal HTTP or HTTPS service. SNS is a public service designed to connect to external public HTTPS endpoints. SNS is purpose-built for external communications and it supports Public[...]
Read moreHow to find Unused Load Balancers - Based on Traffic | AWS FinOps
In this article, we are going to see how to find unused load balancers - based on Cloud Watch usage metrics like request count, active flow count We are going to get the usage metric from CloudWatch API using Python Boto and write it as a CSV report for all[...]
Read moreHow to configure Sendgrid as an SMTP Relay on Metabase
In this article, we are going to see how to configure SendGrid as an SMTP relay for the Metabase If you are here I assume that you already are aware of Metabase and a little basics of SendGrid Mail service provider. In Metabase, the SMTP server or Email Channel plays[...]
Read moreHow to Send SNS messages to S3 - using AWS Kinesis Data Firehose
In this article, we are going to see how to save the SNS messages to S3 using Kinesis Data Firehose The first step of building a data engineering pipeline in your organization is storing the unorganized data with long retention and partitioning. Therefore storing the SNS data with Long-term storage[...]
Read moreKubernetes NGINX Sidecar ReverseProxy - Connection refused Localhost
While using NGINX reverse Proxy as a Sidecar container for your microservice, We often use localhost to connect to the application container on the same POD but it can potentially harm your application availability in certain systems and lead to a lot of 502 or connection refused issues Here is[...]
Read moreRun SQL queries directly on S3 backup of AWS RDS - using Apache Drill
Apache Drill is a revolutionary product that identifies itself as a Schema-free SQL Query Engine for Hadoop, NoSQL and Cloud Storage - While it was often represented or perceived as a tool for Data Engineers or Analysts. It is not just for Data Engineers In this article, we are going[...]
Read moreCloudflare Ansible Example - To create, update, delete DNS records
In this article, we will discuss how to use Ansible to automate CloudFlare DNS management. Ansible has modules for almost everything and it includes Cloudflare the popular CDN and DNS provider Since Cloudflare is part of the community.general collection of ansible - it is likely you would have it installed[...]
Read moreAWS IMDS - What is Link-Local IP address 169.254.169.254
In the world of networking, IP addresses are crucial for devices to communicate with each other over the Internet. However, not all IP addresses are created equal, and some serve unique purposes. One such IP address is 169.254.169.254, which is commonly referred to as a link-local address. In this article,[...]
Read moreComparing a Kid and AI - Learning AI with real life examples
If you are reading this, am sure you are trying to get into the mystery world of AI and puzzled by the various terminologies of the AI world. AI Model GPT - Generative Pre-trained Transformer LLM - Large Language Model FM - Foundation Model Text Generation Text Summarization Transformers Embeddings[...]
Read more