Tech TipsPromptfoo is an open-source CLI (24.1k GitHub stars) that treats LLM prompts as testable code using YAML test cases and assertions. OpenAI announced it was acquiring the company on March 9, 2026, committing to continue the open-source project. This guide covers installation (Node.js 22.22.0 or newer, Node 24 recommended), scaffolding a first eval with npx promptfoo@latest init, choosing assertion types by cost tier, guarding cost and latency, RAG and agent evals, CI gating strategy, the red teaming half of the tool, and three honest limits of eval suites.
Aug 10, 2026 · 8 min read 
Open SourceSpeakoFlow is a free, MIT-licensed local-first voice assistant for Windows, macOS and Linux, built by solo developer Abhishek Barali as a fork of CJ Pais's Handy. It combines hotkey dictation, a 'Hey Flow' generative writing mode, an assistant panel with screen vision, live translation and AI cleanup. Speech-to-text always runs on-device via whisper.cpp and Parakeet; the assistant can run fully offline through a built-in llama.cpp engine, through Ollama or LM Studio, or through any OpenAI-compatible cloud provider with your own key. There is no account and no telemetry. The trade-offs are real: the binaries are not code-signed on Windows or macOS, requiring a manual quarantine-clearing step on Mac, and the project is at v1.0.1 with 126 commits, six GitHub stars and one maintainer.
Aug 7, 2026 · 8 min read 
Open SourceMeetily is a privacy-first, open-source AI meeting assistant with 27.4K GitHub stars and an MIT license. Built on Rust and Tauri, it runs Whisper or Parakeet transcription and Ollama summarization entirely on your own device, so meeting audio never touches the cloud. It supports macOS and Windows, with flexible summary providers and a commercial PRO tier.
Jul 30, 2026 · 5 min read 
Open SourceBumblebee is Perplexity's open-source, read-only supply-chain scanner for macOS and Linux developer endpoints, written in Go with zero non-stdlib dependencies under Apache 2.0. It inventories npm, PyPI, Go, RubyGems, Composer and other package managers plus MCP configs, editor extensions, and browser extensions, emitting NDJSON findings against operator-supplied exposure catalogs. Its read-only design never invokes package managers, so it cannot trigger malicious postinstall scripts during a scan.
Jul 28, 2026 · 6 min read 
Open SourceOn July 15, 2026, xAI open-sourced Grok Build, the Rust terminal coding agent behind its grok CLI, under Apache 2.0. The release covers the agent loop, tools, TUI, and extension system, and supports a fully local-first config.toml path pointing at self-hosted inference. External PRs aren't accepted and the model stays closed, so it's a source-transparency release, not a community project.
Jul 27, 2026 · 6 min read 
Tech TipsA practical guide to LangGraph, the durable agent framework that hit 1.0 in October 2025 and the 1.2 line by mid-2026. It covers the three core primitives (state, nodes, edges), conditional edges for branching and loops, and checkpointer-based persistence for crash recovery and memory. It also explains the deprecation of create_react_agent in favor of LangChain's create_agent, and the rule of thumb for choosing between the high-level agent builder and low-level StateGraph.
Jul 26, 2026 · 6 min read 
Open SourceStrix is an open-source (Apache-2.0) AI penetration-testing tool with ~39,000 GitHub stars. Its autonomous agents dynamically run your app, exploit OWASP Top 10 vulnerabilities, and validate each finding with a working proof-of-concept, cutting the false positives of static scanners. It installs via a single curl command, needs Docker plus an LLM API key, is model-agnostic through LiteLLM, and drops into CI/CD with a non-interactive mode that fails builds on findings.
Jul 24, 2026 · 5 min read 
Open SourceOpenHands is an MIT-licensed, self-hostable AI coding agent that works in a Docker sandbox to write code, run tests, and open PRs.
Jul 23, 2026 · 5 min read 
Open SourceOpenClaw is a free, self-hosted, model-agnostic AI agent that runs as a persistent background daemon and acts across WhatsApp, Telegram, Slack, and Discord. It became the fastest-growing repo in GitHub history (383K+ stars) but carries serious security flaws: authentication off by default, plaintext credential storage, tens of thousands of internet-exposed instances, and fake installers spreading infostealer malware. Run it only from the official repo, behind a VPN, with auth on and scoped credentials.
Jul 22, 2026 · 6 min read 
ReviewsZed 1.0, released April 29, 2026, is an open-source code editor written in Rust with a custom GPU-accelerated framework, positioned as both a fast traditional editor and an AI workbench. It offers agentic editing, Zeta edit prediction, parallel agents, and the open Agent Client Protocol, plus a generous free tier. Its main drawbacks are a small extension library and uneven language support compared with VS Code.
Jul 21, 2026 · 5 min read 
Tech TipsLiteLLM is an open-source gateway that gives developers a single OpenAI-format interface to call 100+ LLM providers. This tutorial covers installing the SDK and Proxy Server, switching providers by changing a model string, unified exception handling, streaming, and adding cost tracking, observability, virtual keys, and budgets.
Jul 17, 2026 · 7 min read 
Tech TipsLangfuse is an open-source, MIT-licensed LLM observability platform acquired by ClickHouse in January 2026. It provides hierarchical tracing, prompt management, evaluations, and datasets. Its OpenTelemetry-based Python SDK v3 uses the @observe decorator and integrates with LangChain, the OpenAI SDK, Anthropic, and LiteLLM.
Jul 16, 2026 · 6 min read 
ReviewsWarp is an Agentic Development Environment that folds a terminal, coding agents, and shared context into one app centered on prompting rather than typing. It scores 71% on SWE-bench Verified and #1 on Terminal-Bench (52%), and its standout feature is running multiple agents in parallel. Warp went open-source in April 2026. Pricing settled at a $20/mo Build plan with 1,500 credits plus BYOK, after volatility that hurt early-adopter trust.
Jul 11, 2026 · 6 min read 
Tech TipsUnsloth is an open-source library that fine-tunes open LLMs (Llama, Qwen, Mistral, Gemma, gpt-oss) roughly 2x faster and with up to 70% less VRAM than a stock Hugging Face setup, without sacrificing accuracy. It achieves this with custom OpenAI Triton kernels and a manual backpropagation engine, and fuses LoRA with 4-bit quantization. It runs on any NVIDIA GPU with CUDA Capability 7.0+, including the free Colab T4. Install with 'pip install unsloth' and use FastLanguageModel.from_pretrained plus get_peft_model to attach LoRA adapters before training with trl's SFTTrainer.
Jul 10, 2026 · 6 min read 
Deep DivesLoRA (2021) freezes a model's weights and trains tiny low-rank matrices, cutting GPT-3's trainable parameters 10,000x with no inference latency. QLoRA (2023) quantizes the frozen base to 4-bit NF4, fitting a 65B model on one 48GB GPU at ~33% less memory but ~39% more training time. Rank sets capacity; alpha (via alpha/r) sets scale. Adapt attention projections first and raise rank only when quality demands it.
Jul 3, 2026 · 8 min read 
Tech TipsDSPy is a Stanford NLP Python framework (v3.3, MIT-licensed, 6.4M+ monthly downloads) for programming LLMs instead of hand-writing prompts. You declare tasks as typed signatures, compose them as modules like Predict/ChainOfThought/ReAct, define a metric, then run optimizers such as GEPA or MIPROv2 to auto-tune prompts — often lifting a baseline from ~62% to ~89% on the same model. Used in production by Shopify, Databricks, Dropbox, and Replit.
Jul 2, 2026 · 7 min read 
Tech TipsvLLM is the default open-source LLM serving engine in 2026. PagedAttention cuts KV-cache memory waste from 60-80% to under 4%, and continuous batching keeps the GPU full, together delivering 14-24x the throughput of Hugging Face Transformers. Install with pip, launch an OpenAI-compatible server via 'vllm serve', then tune --gpu-memory-utilization, --max-num-batched-tokens, --tensor-parallel-size, and chunked prefill against real traffic.
Jul 1, 2026 · 7 min read 
Tech TipsA hands-on guide to Ollama, the default local-LLM runner in 2026 (v0.30.10). Covers install, pulling and running models, calling them from the OpenAI SDK at localhost:11434, structured JSON outputs, tool calling, and Modelfiles, plus how to size a model to your hardware.
Jun 25, 2026 · 6 min read 
ReviewsOpenCode is an open-source (MIT), terminal-native AI coding agent with 178K GitHub stars. It is model-agnostic, connecting to 75+ providers (Anthropic, OpenAI, Google, Ollama) with bring-your-own keys. LSP integration feeds compiler diagnostics back to the model; built-in build and plan agents plus a general subagent. Runs locally/air-gapped, ships frequently (v1.17.9, 826 releases), and now has a desktop beta. Trade-offs: a terminal learning curve, you pay your own API bills, and quality depends on the model you plug in.
Jun 24, 2026 · 5 min read 
Deep DivesA deep dive into the KV cache in LLM inference: why autoregressive decoding needs it, how it dominates GPU memory, the 60-80% waste of contiguous allocation, and how vLLM's PagedAttention fixed it.
Jun 22, 2026 · 9 min read 
AI NewsMoonshot AI's Kimi K2.7-Code is an open-weights, OpenAI-compatible coding model (1T-param MoE, 32B active, 256K context) claiming a 30% cut in reasoning tokens and a narrow win over Claude Opus 4.8. But all published benchmarks are Moonshot's own proprietary suites, with no independent results yet, so the efficiency claims remain unverified.
Jun 14, 2026 · 5 min read 
AI NewsGoogle released Gemma 4 12B on June 3, 2026, a multimodal open model with an encoder-free architecture that feeds vision and audio directly into the LLM backbone. It runs locally on 16GB of memory, approaches the 26B MoE on benchmarks, uses Multi-Token Prediction drafters for low latency, and ships under Apache 2.0 with broad tooling support.
Jun 9, 2026 · 5 min read 
Open SourceUnderstand-Anything converts any codebase into a navigable knowledge graph for easier comprehension.
May 28, 2026 · 5 min read 
Deep DivesZyphra's ZAYA1-8B MoE model, trained on AMD, achieves high performance with efficient parameter activation.
May 24, 2026 · 6 min read 
Open SourceEmdash is an open-source IDE that runs 22 coding agents in parallel for enhanced development.
May 24, 2026 · 7 min read 
Open SourceKilo Code v7 is an open-source AI agent rebuilt for parallel coding, offering subagents and multi-model comparison.
May 16, 2026 · 5 min read 
Open SourceVercel Open Agents provides forkable, sandbox-isolated background coding agents with GitHub integration and PR creation.
May 14, 2026 · 6 min read 
Open SourceOpenClaw, a self-hosted AI agent, saw rapid growth amidst rebrands and a crypto scam.
May 12, 2026 · 7 min read 
AI NewsMoonshot's Kimi K2.6, an open-weights model, surpasses GPT-5.4 on SWE-Bench Pro.
May 12, 2026 · 6 min read 
Open SourceNVIDIA GR00T N1.7 is an open robot brain, trained on human video, showing real dexterity scaling.
May 5, 2026 · 6 min read 
Open SourcePostiz is a popular open-source social scheduler, offering a Buffer alternative with AI agent capabilities.
May 4, 2026 · 6 min read 
Open SourceMicrosoft's VibeVoice is an open-source voice AI offering advanced ASR and TTS capabilities.
May 2, 2026 · 7 min read 
Open SourceTrinity-Large-Thinking is Arcee AI's 400B open-weights reasoning model, offering powerful, cost-effective agent tuning.
Apr 30, 2026 · 7 min read 
Open SourceNVIDIA's Nemotron 3 Nano Omni is a 30B open multimodal model, processing diverse data with high throughput.
Apr 29, 2026 · 6 min read 
AI NewsDeepSeek V4 Pro is a top 1.6T open-weights model for agents, but has a high hallucination rate.
Apr 29, 2026 · 5 min read 
Open SourceArchon OS is an open-source knowledge backbone that helps AI coding assistants remember information.
Apr 21, 2026 · 6 min read 
Open SourceVoicebox is a local-first, open-source voice cloning studio for Mac and Windows, built on Qwen3-TTS.
Apr 18, 2026 · 7 min read 
Open SourceNVIDIA Ising offers open-source AI models to improve quantum error correction, making quantum computing more effective.
Apr 17, 2026 · 6 min read 
Tech TipsEdgee Codex Compressor, a Rust gateway, cuts LLM costs by 35.6% by compressing tool output.
Apr 12, 2026 · 4 min read 
Open SourceRay is an open-source AI financial advisor that runs locally, securing your data while connecting to banks.
Apr 12, 2026 · 4 min read 
Open SourceHermes Agent is an open-source AI that learns your workflow with persistent memory and skill creation.
Apr 12, 2026 · 4 min read 
Open SourceGoogle's Gemini CLI, an open-source terminal AI agent, hits 101K GitHub stars with new features.
Apr 9, 2026 · 4 min read 
Open SourceMoondream 3 is a 9B vision model that runs efficiently like a 2B, offering advanced capabilities.
Apr 1, 2026 · 4 min read 
Open SourceMistral's Voxtral TTS is an open-weight speech model challenging ElevenLabs with naturalness and voice cloning.
Mar 31, 2026 · 4 min read 
AI NewsNVIDIA's Nemotron 3 Super, a hybrid architecture, delivers 5x throughput and top agentic benchmarks.
Mar 31, 2026 · 4 min read 
Open SourceMistral Small 4 unifies three AI products into one powerful open-source model, simplifying capabilities.
Mar 30, 2026 · 4 min read 
AI NewsLightricks' LTX 2.3 is an open-source model generating native 4K video with perfectly synced audio.
Mar 29, 2026 · 6 min read 
Open SourceAlibaba's Qwen 3.5 Small, a 9B multimodal AI, surprisingly beats models 13x its size.
Mar 29, 2026 · 5 min read 
Open SourceBiome v2.4, a Rust toolchain, is replacing ESLint and Prettier with faster, more efficient performance.
Mar 29, 2026 · 6 min read 
Open SourceOpenClaw, a self-hosted AI agent integrating with various UIs, quickly became a GitHub sensation.
Mar 29, 2026 · 6 min read 