Professional Tips: Evals - Detailed Analysis

👋 Sign in for the ability to sort posts by relevant, latest, or top.

deavgprime

Nov 1

What exactly are AI evals?

#ai #llm #evals #scoring

9 min read

deavgprime

Nov 1

Resuming an eval without changing the experiment

#ai #evals #python #testing

6 min read

deavgprime

Nov 1

Before scoring a model, test the evaluator

#ai #evals #scoring #kubernetes

6 min read

Danny Holloran

Nov 1

LLM Evals Start as Thirty Test Cases, Not a Platform

#ai #llm #evals #typescript

4 min read

Journal A.I.

Oct 29

"🚫 Your Agent Demo Is Not a Release Gate"

#agents #evals #devops #ci

2 min read

Journal A.I.

Oct 29

"⛔ Stop Merging Agents Without a Required Check"

#agents #evals #github #devops

2 min read

Journal A.I.

Oct 29

"🧪 RAG Without CI Metrics Is Just a Chatbot"

#rag #evals #llm #python

2 min read

Walker Miller

Oct 30

Testing multi-agent crews: forcing split-brain, goal drift, and context drift to happen in CI

#multiagent #testing #evals #coordination

9 min read

Ahmad Dogar

Oct 25

Evals before prompts: a small eval harness for an LLM feature

#ai #llm #evals #testing

9 min read

Ankur Jindal

Oct 25

Pick Your LLM With Your Own Prompt: A Side-by-Side Model Comparison Tool

#ai #evals #chatgpt #claude

7 min read

Jason Agostoni

Oct 17

Jev is not as cheap as you think. Unless it is.

#ai #jev #evals #webdev

6 min read

Basavaraj SH

Oct 7

The Safety Check That Runs on the Conversation, Not the Turn

#llm #ai #evals #trustandsafety

2 min read

Oliver Zehentleitner

Oct 7

The Model Changed. My Skill Didn't. The Score Still Dropped.

#ai #evals #agents #codereview

7 min read

Ahmet Zeybek

Oct 6

Write the eval before the prompt

#llm #testing #aiengineering #evals

7 min read

FA33

Sep 27

How to Evaluate AI Agents: Reliability, Cost, Latency, and Failure Modes

#ai #agents #evals #reliability

7 min read

👋 Sign in for the ability to sort posts by relevant, latest, or top.