links.lmorchard.com - #caching

Prompt caching: 10x cheaper LLM tokens, but how? | ngrok blog

Fri, 19 Dec 2025 19:50:01 +0000

By the end of this post you will... Understand, at a deeper level, how LLMs work Have built some new intuition for why LLMs work the way they do Understand the exact 1s and 0s that get cached, and how they reduce the cost of your LLM requests

Tags: #caching #genai #hosting #llms #ops

about REDbot

Mon, 12 Mar 2012 22:11:19 +0000

RED is a robot that checks HTTP resources to see how they'll behave, pointing out common problems and suggesting improvements. Although it is not a HTTP conformance tester, it can find a number of HTTP-related issues.

Tags: #caching #http #imported:pinboard #performance #redbot #webdev

about REDbot

Mon, 12 Mar 2012 22:11:19 +0000

Tags: #caching #http #performance #redbot #webdev

Using Flat Files So Elections Don't Break Your Server - NYTimes.com

Fri, 18 Mar 2011 16:24:27 +0000

In the Times Interactive News Department, we pay careful attention to caching strategy to make sure it’s a good fit for the project at hand.

Tags: #architecture #caching #performance #rails #webdev

Displaying PHP APC Cache Information

Mon, 08 Feb 2010 16:56:24 +0000

"APC is the Alternative PHP Cache, which is a free, open, and robust framework for caching and optimizing PHP intermediate code. I posted about how to install APC on Linux a couple of days ago, and will now look at the apc.php script which comes with APC and shows information about how much of the cache is being used, what files are being cached, the number of times they've been accessed etc."

Tags: #apc #caching #gui #php #webdev

Holy Shmoly! » WordPress, Nginx and WP Super Cache

Tue, 24 Nov 2009 17:58:24 +0000

"If you host your own WordPress blog, it’s probably on Apache. That all fine and good. For most sites Apache works wonderfully, especially as it’s so easy to find information on it, on mod_rewrite and everything else that everyone else uses. One of the alternatives is Nginx, a really fast webserver that streaks ahead of Apache in terms of performance, but isn’t quite as easy to use. That’s partly because Apache is the default webserver on most Linux distributions and hosts. Want to try Nginx? Here’s how."

Tags: #caching #metablogging #nginx #webdev #wordpress

A Bunch of Great Strategies for Using Memcached and MySQL Better Together | High Scalability

Wed, 06 Aug 2008 20:37:00 +0000

"The primero recommendation for speeding up a website is almost always to add cache and more cache. And after that add a little more cache just in case. Memcached is almost always given as the recommended cache to use. What we don't often hear is how to effectively use a cache in our own products. MySQL hosted two excellent webinars (referenced below) on the subject of how to deploy and use memcached."

Tags: #caching #memcached #mysql #performance #tips #webdev

Coding Horror: Behold WordPress, Destroyer of CPUs

Thu, 24 Apr 2008 23:55:22 +0000

"Personally, I think it's absolutely irresponsible that WP-Cache like functionality isn't already built into WordPress"

Tags: #caching #metablogging #webdev #wordpress

Simon Wistow - Standing in Line

Wed, 19 Mar 2008 23:06:33 +0000

"What I actually want out of this is a kind of de facto standard like Memcached or Apache or whatever that's so simple to understand and use that it changes the way people develop their apps such that they just start with the assumption that some of their

Tags: #async #caching #queues #webdev

mnot’s Web log: Cache Channels Beta

Fri, 04 Jan 2008 08:34:07 +0000

"The default implementation uses an archived Atom feed to represent the contents of the channel, which the cache to stay in touch"

Tags: #atom #caching #http #webdev

mnot’s Web log: Two HTTP Caching Extensions

Wed, 12 Dec 2007 21:42:55 +0000

stale-while-revalidate and stale-if-error

Tags: #caching #http #webdev