We’ve covered a lot of local LLMs on It’s FOSS. You can use them as coding assistants or run them on your tiny Raspberry Pi setups. But recently, I’ve noticed many comments asking about local AI tools to interact with PDFs and
Read More
Programming is the one area where AI is being used extensively. Most editors allow you to add AI agents like chatGPT, Microsoft’s Copilot etc. There are also several open source large language models specifically centered around coding like CodeGemma. And then we
Read More
As artificial intelligence continues to weave into our daily lives, there’s a noticeable shift towards smaller, more efficient language models that can run locally on devices. SmolLM, part of a growing trend in compact language models, is a prime example, showing that
Read More
Ever since AI took a major leap with the introduction of real-time conversational capabilities like what we saw with GPT-4, there’s been a growing desire to bring these dynamic, human-like interactions into everyday applications. Developers, from hobbyists to enterprises, are now seeking
Read More
Just to give you a quick refresher, the Pi 5 is a tiny computer with a 4-core Cortex-A76 CPU, up to 8GB of RAM, and a VideoCore VI GPU. It’s basically a pocket-sized computer. Now, the real fun begins. Our contenders for
Read More
Google’s latest AI offering, NotebookLM took the tech world by storm. Whether you are a university student or a working professional, getting time to sit and read is not an option for many, and often, the text-heavy PDFs get pushed to the
Read More
Tired of wrestling with LLM installations? Llamafiles offer a refreshingly simple way to run large language models on your own machine. Here’s what you need to know. Llamafile, is a cutting-edge solution from Mozilla that promises to revolutionize how we handle LLMs.
Read More
Generative AI and Large Language Models (LLMs) are often used interchangeably, but while they share some similarities, they differ significantly in purpose, architecture, and capabilities. In this article, I’ll break down the difference between the two, explore the broader implications of generative
Read More
If you’ve been following our articles on Large Language Models (LLMs) or digging into AI, you’ve probably come across the term token more than a few times. But what exactly is a “token,” and why does everyone keep talking about it? It’s
Read More
When someone mentions ‘Hugging Face’ 🤗 in the world of AI, and machine learning, we go along with it even if we do not know what it is. We just know that we can find AI models at Hugging Face. That’s it.
Read More