Posts

My Journey Building a Production-Ready ML Pipeline: House Rent Prediction

Image
My Journey Building a Production-Ready ML Pipeline: House Rent Prediction How I learned to build a scalable machine learning system from scratch using Apache Spark, Kubernetes, and AWS services 🎯 The Learning Challenge When I started my ML learning journey, I wanted to build something real - not just another tutorial project. I decided to create a house rent prediction system that could actually be used in production. The challenge was daunting: I needed to build a system that could: Process thousands of house listings efficiently Train ML models with complex feature engineering Serve predictions in real-time Scale automatically based on demand Maintain data lineage and reproducibility ...

Extracting Smart Video Clips with LLMs: Inside the Clips Extractor App

Image
Introduction In the age of information overload, finding the most relevant moments in lengthy videos can be a daunting task. Clips Extractor is an innovative application designed to solve this problem by leveraging state-of-the-art Large Language Models (LLMs) and AI-powered transcription. This blog post explores the app's goals, technical architecture, and how it uses LLMs to deliver precise, topic-based video clips. What is Clips Extractor? Clips Extractor enables users to extract meaningful clips from YouTube videos based on a topic of interest. Whether you're a researcher, content creator, or casual viewer, you can quickly surface the most relevant segments without manually scrubbing through hours of footage. Key Features Extract clips from YouTube video Search for segments based on user-provided topics Get precise timestamps and transcripts for each clip Combine selected clips into a single video Chrome Extension for direct YouTube integration ...

Evolution of AI: From ML to ANI/AGI/ASI - A Sci-Fi Inspired Journey

Introduction

Life on Our Planet [2023] - My Review and Interesting Notes on Evolution

Review:   This is probably the only series that I’ve watched at 1.5x speed and yet it felt like a normal one. Thankfully, the narrator was Morgan Freeman else it would’ve been a very boring series altogether for its sluggish storytelling. Though it still felt like attending a biology class for the most part, the creators tried their level best to make it as interesting as possible by adding some introduction BGMs with fights within the species and how they evolved which added value to the storytelling. The creators intentionally presented it in a non-linear way assuming to make it interesting but it only causes confusion since human brains are not designed to think millions of years back & forth it feels like Steven Spielberg likes the dinosaurs so much for his success depends on it so he keeps going back to the dinosaurs period again & again. I was expecting some theory & visuals of how human life was created & evolved but nothing related was shown. Overall, it’s ...

Build an Equity Backtester AI agent from scratch with Python using open/free LLM APIs

I wrote a blog post in markdown format and tried formatting the codes here, but it felt like an endless task, so I decided to not continue with it, hence I'd request you to please read it out from the repo directly .

India: Union Budget 2025 - Notes

These are the notes I made while watching Nirmala Sitharam's 8th Union Budget presentation. NOTE: if you like reading a streamlined version of my notes compiled by GPT then got to the second half of this post Starts with opposition stages walkout with huge shouts but anyway Tai starts off at 11:05 am Aim is to achieve zero poverty Agri (1st engine): Centre(via a new scheme, atmanirbhar agri, PM Dhan Dhaniya Krishi Yojana?) to collaborate with 100(to start with) low productivity districts to enhance productivity - scheme to benefit 1.7Cr farmers Comprehensive programs for fruits & vegetables   Makhana Board to support Bihar farmers MSMEs(2nd engine): Increasing credit access to MSME sectors New fund of funds for 10K Cos Focus on making global hub for toys Credit card for micro enterprises   UPI linked credit card for street vendors New schema for women SC/ST entrepreneurs   Investments (3rd engine): Broadband for govt schools School books in regional languages Expansio...

The Platform 2 Movie Reviewed / Explained

I got to watch the 2nd part of The Platform on Netflix today and below is my short review & explanation from my perspective (spoilers ahead): Just like the first part, there are a lot of metaphors and answers to some of the questions from the first part too. The film starts off with the plot known to the prisoners and just like in the real world, there are revolutionist groups formed. They fight against each other throughout the movie which makes this part a bit boring for me. Still, fortunately, the makers take us through the journey of the protagonist/female/heroine who first tries to abide by the rules but then notices how doing so doesn’t help her much, the transition happens when she meets different characters in the film. We’re shown how she becomes rebellious to go against the system at last and this time we’re shown how the prisoners have advanced themselves to find a hack to become conscious when the prison admins clean up the space by the end of every month and that’s whe...