/tags/evals/ Recent bookmarks tagged #evals Mon, 02 Nov 2026 08:24:51 +0000 https://github.com/hamelsmu/evals-skills Skills for AI Evals to compliment the course: AI Evals For Engineers & PMs<br/> <p><strong>Tags:</strong> #agents #ai #evals #llms</p> Fri, 27 Mar 2026 19:06:42 +0000 linkding-ssg:bookmark:38426 agents ai evals llms https://www.anthropic.com/engineering/eval-awareness-browsecomp Instead of inadvertently coming across a leaked answer, Claude Opus 4.6 independently hypothesized that it was being evaluated, identified which benchmark it was running in, then located and decrypted the answer key. To our knowledge, this is the first documented instance of a model suspecting it is being evaluated without knowing which benchmark was being administered, then working backward to successfully identify and solve the evaluation itself.<br/> <p><strong>Tags:</strong> #ai #claude #evals #llms</p> Sun, 08 Mar 2026 06:53:55 +0000 linkding-ssg:bookmark:38361 ai claude evals llms https://github.com/Halluminate/WebBench?tab=readme-ov-file WebBench is an open, task-oriented benchmark designed to measure how effectively browser agents handle complex, realistic web workflows. It includes 2,454 tasks across 452 live websites selected from the global top-1000 by traffic<br/> <p><strong>Tags:</strong> #agents #evals #llms #webbench</p> Tue, 28 Oct 2025 19:05:16 +0000 linkding-ssg:bookmark:37887 agents evals llms webbench https://github.com/langchain-ai/openevals Readymade evaluators for your LLM apps<br/> <p><strong>Tags:</strong> #ai #evals #llms</p> Wed, 24 Sep 2025 00:00:35 +0000 linkding-ssg:bookmark:37750 ai evals llms https://github.com/langchain-ai/agentevals?tab=readme-ov-file#trajectory-llm-as-judge Readymade evaluators for agent trajectories<br/> <p><strong>Tags:</strong> #agents #ai #evals #llms</p> Wed, 24 Sep 2025 00:00:25 +0000 linkding-ssg:bookmark:37749 agents ai evals llms https://hamel.dev/blog/posts/evals/index.html I’ve found that unsuccessful products almost always share a common root cause: a failure to create robust evaluation systems.<br/> <p><strong>Tags:</strong> #ai #evals #llms</p> Wed, 16 Jul 2025 18:56:15 +0000 linkding-ssg:bookmark:29438 ai evals llms https://hamel.dev/blog/posts/evals-faq/ This document curates the most common questions Shreya and I received while teaching 700+ engineers & PMs AI Evals. Warning: These are sharp opinions about what works in most cases. They are not universal truths. Use your judgment.<br/> <p><strong>Tags:</strong> #ai #evals #llms</p> Wed, 16 Jul 2025 18:55:41 +0000 linkding-ssg:bookmark:29439 ai evals llms