DEV Community

Shashank Agarwal profile picture

Shashank Agarwal

Founder & CEO, Noveum AI; creator of API.market. Ex-AWS SageMaker launch team. Author of Intelligence at Scale. I write about production AI, agent evaluation and API infrastructure.

Education

Master's degree in computer science, The Ohio State University

Work

Founder & CEO, Noveum AI | Creator, API.market

HTTP Success Is Not Agent Success: A Reproducible Python Acceptance Lab

HTTP Success Is Not Agent Success: A Reproducible Python Acceptance Lab

Comments
11 min read

Want to connect with Shashank Agarwal?

Create an account to connect with Shashank Agarwal. You can also sign in below to proceed if you already have an account.

Already have an account? Sign in
Document API Changes Without Rewriting History

Document API Changes Without Rewriting History

Comments
2 min read
Make API Usage Reports Useful to the Person Paying

Make API Usage Reports Useful to the Person Paying

Comments
2 min read
Review the Billing Contract Before Integrating an API

Review the Billing Contract Before Integrating an API

Comments
2 min read
What to Show Beside an Example API Response

What to Show Beside an Example API Response

Comments
2 min read
Turn an API Support Question Into a Documentation Fix

Turn an API Support Question Into a Documentation Fix

Comments
2 min read
An API Error Message Is Part of the Product

An API Error Message Is Part of the Product

Comments
2 min read
Connect a Marketplace to Agents Without Hiding Limits

Connect a Marketplace to Agents Without Hiding Limits

Comments
2 min read
A Practical Acceptance Test for a Tool-Using Agent

A Practical Acceptance Test for a Tool-Using Agent

Comments
2 min read
Document an MCP Gateway for a New Developer

Document an MCP Gateway for a New Developer

Comments
2 min read
Tool Availability and Permission Are Different Questions

Tool Availability and Permission Are Different Questions

Comments
2 min read
What Human Approval Should Show Before a Tool Action

What Human Approval Should Show Before a Tool Action

Comments
2 min read
Choose an API With an Agent and Review the Choice

Choose an API With an Agent and Review the Choice

Comments
2 min read
Handle an Empty Tool Result Without Inventing an Answer

Handle an Empty Tool Result Without Inventing an Answer

Comments 1
2 min read
Use a Small API Workflow as the First Agent Test

Use a Small API Workflow as the First Agent Test

Comments
2 min read
What to Record When an Agent Calls a Paid Tool

What to Record When an Agent Calls a Paid Tool

Comments
2 min read
When an Agent Should Stop Before Spending Money

When an Agent Should Stop Before Spending Money

Comments
2 min read
Describe Tool Inputs So Agents Can Use Them Correctly

Describe Tool Inputs So Agents Can Use Them Correctly

Comments
2 min read
A First-Call Checklist for an Agent Using a New API

A First-Call Checklist for an Agent Using a New API

Comments
2 min read
Authentication Does Not Settle API Pricing

Authentication Does Not Settle API Pricing

Comments
2 min read
Tool Discovery Should End With a Checkable Result

Tool Discovery Should End With a Checkable Result

Comments
2 min read
One MCP Connection Still Contains Many Product Decisions

One MCP Connection Still Contains Many Product Decisions

Comments
2 min read
How to Explain a Technical Company Without Hype

How to Explain a Technical Company Without Hype

Comments
2 min read
Choosing the Customer for an Infrastructure Product

Choosing the Customer for an Infrastructure Product

Comments
2 min read
The Difference Between Launching and Operating a Product

The Difference Between Launching and Operating a Product

Comments
2 min read
A Founder’s Guide to Recognizing a Useful Pivot

A Founder’s Guide to Recognizing a Useful Pivot

Comments
2 min read
Before Turning an Internal Service Into a Product

Before Turning an Internal Service Into a Product

Comments
2 min read
What a Senior Engineer Adds to a Founding Team

What a Senior Engineer Adds to a Founding Team

Comments
3 min read
Why I Built API.market After PipFeed

Why I Built API.market After PipFeed

Comments
4 min read
The AI Agent Feedback Loop: From Findings to Reviewed Changes

The AI Agent Feedback Loop: From Findings to Reviewed Changes

Comments
2 min read
Monitoring and Evaluation: Connecting Execution to Agent Outcomes

Monitoring and Evaluation: Connecting Execution to Agent Outcomes

Comments
2 min read
How to Scale Agent Evaluation Without Losing the Evidence

How to Scale Agent Evaluation Without Losing the Evidence

Comments
2 min read
Privacy and Policy Review Signals in AI Agent Traces

Privacy and Policy Review Signals in AI Agent Traces

Comments
2 min read
How to Measure the Cost of an Agent’s Captured Workflow

How to Measure the Cost of an Agent’s Captured Workflow

Comments 1
2 min read
Five Agent Failure Categories and the Evidence Each Needs

Five Agent Failure Categories and the Evidence Each Needs

1
Comments
2 min read
How to Investigate Agent Failures With Captured Traces

How to Investigate Agent Failures With Captured Traces

Comments
2 min read
Beyond Accuracy: Choosing the Right Dimensions of AI Agent Quality

Beyond Accuracy: Choosing the Right Dimensions of AI Agent Quality

Comments
2 min read
Using System Prompts in Evaluation Without Discarding Reviewed Evidence

Using System Prompts in Evaluation Without Discarding Reviewed Evidence

1
Comments
2 min read
Evaluate Agent Outcomes and Tool Use Together

Evaluate Agent Outcomes and Tool Use Together

1
Comments
2 min read
A Small, Runnable Evaluation Harness for an Agent Tool Workflow

A Small, Runnable Evaluation Harness for an Agent Tool Workflow

1
Comments
3 min read
System Prompts Define Instructions. Factual Evaluation Needs Evidence.

System Prompts Define Instructions. Factual Evaluation Needs Evidence.

1
Comments
2 min read
Model Evaluation and Agent Evaluation: Choosing the Unit

Model Evaluation and Agent Evaluation: Choosing the Unit

1
Comments
2 min read
A Bolt and API.market Prototype: What to Check Before Sharing

A Bolt and API.market Prototype: What to Check Before Sharing

2
Comments
2 min read
Building api.market. Anyone Interested?

Building api.market. Anyone Interested?

Comments
1 min read
loading...