Skip to content

Publications

NeuPortal Quant Lab

Research on AI agents, backtesting and audits of market forecasts, and the platform's architecture.

Model pitfalls · 18

  1. Model pitfalls

    How Often Do AI Agents Actually Finish the Job? 66% Once, 47% Every Time

    Thinkingbox runs 507 stateful business workflows past AI agents 20 times each and reports pass^20, not just pass@1. The strongest model solves 66.50% on one attempt and 47.53% on all twenty; another posts 89.35% pass@20 and 7.50% pass^20. What that gap means for agents running unattended, why the attempts are not coin flips, and how to measure your own.

    11 min read9 sections

  2. Model pitfalls

    Your 30-Day Backtest Has 3,275 Windows and 110 Observations

    Slide a window across price history and you get thousands of samples. Almost none of them are independent. Here is the arithmetic, measured on real Binance history, and what it means for every confidence interval you have ever published.

    7 min read7 sections

  3. Model pitfalls

    What Is Backtesting? Testing a Strategy on the Past

    Backtesting runs a strategy against historical data to see how it would have performed. Here is what it really measures, why a great backtest is so easy to fake, and what an honest one looks like.

    4 min read5 sections

  4. Model pitfalls

    How to Spot Overfitted Financial Models

    Learn the key warning signs of overfitted financial models, the tests that expose them, and why transparency in any AI-driven market tool is non-negotiable.

    7 min read7 sections

  5. Model pitfalls

    What Is Feature Importance in a Trading Model?

    Learn what feature importance means in AI trading models, why it matters for transparency, and how to interpret it without being a data scientist.

    8 min read8 sections

We use cookies to keep the AI terminals and the payment gateway working and to complete verification. By staying on the site, you agree to our Cookie Policy and Privacy Policy.

By choosing “Accept and continue” you also allow Google Ads advertising cookies, used to measure our ads. They are never used in the user account.