11 minutes read
Getting AI Assistants to generate insecure CURL requests
Testing AI code assistants willingness to generate insecure CURL requests
Browse
Posts
Essays and practical notes on software engineering, AI, and research, focused on what works in real projects.
4 minutes read
Simplified Handwriting OCR with AnnoMemo
a telegram bot that provides handwriting OCR services and integration with memos.
10 minutes read
Ditch that ChatGPT Subscription: Moving to Pay-as-you-Go AI usage with Open Web UI
Introduction In the world of AI assistants, subscription services like ChatGPT Plus, Claude Pro and Google One AI have become increasingly popular …
4 minutes read
LLMs: To Fine-Tune or Not to Fine-Tune?
Knowing when to fine-tune LLMs and when to use an off-the-shelf model is a tricky question. New research can help shed a light on when each approach …
5 minutes read
LLMs Can't Do Probability
I’ve seen a couple of recent posts where the writer mentioned asking LLMs to do something with a certain probability or a certain percentage of …
7 minutes read
Self-hosting Llama 3 on a home server
Self-hosting Llama 3 as your own ChatGPT replacement service using a 10 year old graphics card and open source components. Last week Meta launched …
6 minutes read
Finding the Best AI-Powered Handwriting OCR
Quite unusually for me, this essay started as a scribble in a notebook rather than something typed in a markdown editor. A few weeks ago, Tiago Forte …
4 minutes read
Moving from Gitea to Forgejo including Actions with Docker Compose
I just moved from gitea to forgejo and the process could not have been simpler. I’m really impressed. I suppose since the latter was until very …
5 minutes read
Digital Gardening
I’m currently undergoing a bit of a refactor of my personal knowledge management (PKM) approach. Up until now I’ve been a victim of the …
9 minutes read
Serving NLP Models with MLflow
Serving NLP models with MLflow is a little trickier than serving models expecting tabular input. In this post we explore one possible solution with code examples.
7 minutes read
How can AI practitioners reduce our carbon footprint?
In recent weeks and months the impending global climate catastrophe has been at the forefront of many peoples’ minds. Thanks to movements like …