The 5-test audit — each test reveals a different dimension of overfit risk. Flip any card to see the MT5 steps for running that test.
Danger: Over-optimised
Max drawdown: 3.2%
Win rate: 94%
Suspiciously smooth. No realistic variance. This represents data mining, not market edge.
Robust: Structurally sound
Max drawdown: 18%
Win rate: 58%
Believable drawdown periods with recoveries. Learned from structure, not from history.
Backtest vs Forward Test Gap
PASS
<30% drop in net profit in forward test vs backtest
FAIL
>50% drop or profitable backtest → losing forward test
MT5 Steps: Backtest vs Forward Test Gap
Run Strategy Tester on historical data (e.g. Jan 2022–Dec 2023). Note net profit. Then run the EA on a demo account from Jan 2024 forward and compare. If live/demo forward performance drops more than 50% from the backtest expectation, the EA is likely overfit to the historical period.
MT5: View → Strategy Tester → set date range to optimisation period → run backtest. Then deploy on demo for 3 months → compare monthly returns.
Tap to flip back
Parameter Sensitivity Test
PASS
Net profit varies <25% when parameters are adjusted by ±20%
FAIL
Results collapse dramatically with small parameter change (cliff-edge effect)
MT5 Steps: Parameter Sensitivity Test
Take your best-performing parameter set. Manually vary each parameter by ±10% and ±20%. Re-run the backtest. A robust EA shows gradual performance change. An overfit EA shows one sharp peak — the exact optimised value — with collapse on either side.
MT5 Strategy Tester → Optimisation tab → vary one parameter at a time across a range. Look for a smooth performance landscape vs a single sharp spike.
Tap to flip back
Walk-Forward Test
PASS
Profitable in 3 of 4 forward windows (75% pass rate)
FAIL
Profitable in backtest, unprofitable in every forward window
MT5 Steps: Walk-Forward Test
Divide data into 4 equal periods. Optimise on period 1, test on period 2 (forward window 1). Optimise on periods 1–2, test on period 3 (forward window 2). Continue. If the EA passes <50% of forward windows, it was optimised to historical conditions, not to a structural edge.
MT5 Strategy Tester → Expert Properties → enable Walk Forward Optimisation → set In-Sample % to 70% → run. Review the Walk Forward report.
Tap to flip back
Monte Carlo Simulation
PASS
<20% of simulation runs end in ruin (>50% drawdown)
FAIL
>40% of simulation runs show ruin from trade order randomisation
MT5 Steps: Monte Carlo Simulation
Monte Carlo randomly reorders the sequence of trades from your backtest thousands of times. If the trade sequence matters dramatically (i.e., the EA only works because of lucky ordering), a high proportion of runs will show ruin. A robust edge should survive most orderings.
MT5 does not include built-in Monte Carlo. Use Forex Tester or Quant Analyser — import your MT5 backtest report (XML/HTML export) and run Monte Carlo with 1,000+ iterations.
Tap to flip back
Out-of-Sample Ratio
PASS
At least 30% of total data held out from optimisation (untouched)
FAIL
EA optimised on 100% of available data with no holdout period
MT5 Steps: Out-of-Sample Ratio
Ask the developer (or check documentation): what percentage of historical data was held out during optimisation? A properly built EA will have been optimised on, say, 2019–2022 data, then tested on 2023–2024 data without touching those years during optimisation. If 100% of available data was used for optimisation with no holdout, the EA has never been genuinely tested outside its training window.
When setting up Strategy Tester optimisation: set date range to ONLY the training period. Save results. Then separately run a backtest on the holdout period (no optimisation) and compare.
Tap to flip back
Overoptimisation — also called curve-fitting — is the process of tuning an EA's parameters so precisely to historical data that the EA becomes an expert in the past rather than in the structure of the market. The distinction is critical: a genuinely robust EA has been designed around a logical market mechanic (the London open creates increased volatility; institutional flow at session opens produces identifiable breakout patterns). An overfit EA has had its parameters tuned until its historical profit was maximised, without any structural logic to explain why those exact parameters should continue to work.
The tragedy of overfit EAs is that they are designed to look exactly like robust EAs in backtests. Their equity curves are often smoother and more impressive than genuinely robust EAs. The tell-tale signs appear only when you test outside the optimisation window, vary the parameters slightly, or run the EA forward in live conditions.
XAUUSD is particularly vulnerable to this problem. Gold's distinct volatility regimes — driven by central bank policy cycles, geopolitical risk events, and physical demand patterns — create historically rich data that is easy to over-mine. An EA optimised on 2022 gold (aggressive Fed tightening) will look brilliant in that backtest and may struggle dramatically when gold enters a different regime. How to prevent overfit from the start during EA construction is a separate topic — this guide focuses on diagnostic testing an existing EA.
The most accessible test and often the most revealing. Run your EA in MT5 Strategy Tester on its claimed historical data range and note the key metrics: net profit, win rate, profit factor, maximum drawdown. Then deploy the EA on a demo account and run it for 2–3 months. Compare the monthly return and win rate to what the backtest predicted.
Expected divergence: some degradation from backtest to forward test is normal and expected. Spreads in live conditions differ from historical data. Slippage affects real execution. A robust EA should show forward performance within 20–30% of its backtest expectation. An overfit EA typically shows more than 50% degradation — or the forward test reveals it is unprofitable entirely.
The reason this test works is that overfit EAs were designed to maximise performance on the specific data period they were tested on. That data period has already passed — the market will not repeat the same sequence. But a structural edge (London session breakout) will continue to operate in the forward period because the underlying market mechanic (institutional session flow) continues to exist.
If you purchased a pre-built EA, you may not have access to the optimisation data or the developer's methodology, which limits certain tests. You can always run: Test 1 (backtest vs forward gap), Test 2 (parameter sensitivity), and a simplified version of Test 5 (asking the developer what data was used for optimisation and what data was held out). Walk-forward (Test 3) and Monte Carlo (Test 4) require either MT5 Strategy Tester Pro or third-party tools and access to the EA's backtest export data.
The most important indicator for a purchased EA is the developer's ability to explain the structural logic. If the developer can describe, in plain terms, why the strategy should work (not just that it has worked historically) — the session mechanic, the filter logic, the reason for each parameter — the EA is less likely to be the product of pure optimisation. If the answer to "why does this strategy work?" is "because it had the highest backtest profit," that is a red flag. How frequently an EA that shows possible overfit needs to be updated is covered in our gold EA update protocol. Operational health checks that help diagnose issues are in our EA health check guide.
Interactive Tool
Select a parameter to see how performance changes as it varies. A robust EA shows gradual change. An overfit EA shows a sharp spike at the exact optimised value.
The selected parameter is shown at the highlighted (current) value. These charts show gradual variation — the sign of a robust EA. An overfit EA would show near-zero performance at all values except the exact optimised one.
If your EA fails two or more of the five tests, you have actionable options:
Contact the developer
Share your test results. Ask specifically: (1) What data was used for optimisation? (2) Was any data held out? (3) Can you provide the walk-forward test report? A legitimate developer will engage with this. If they dismiss the question, treat that as information.
Run an extended demo
If you cannot get clarity from the developer, run the EA on a demo account for 6 months before going live (or continuing live). Six months covers at least one market regime cycle and gives you meaningful forward data regardless of the backtest claims.
Reduce position sizing
If you are already live with an EA that fails multiple tests, the lowest-risk response is to reduce position sizing to the minimum (0.01 lot) while you run the diagnostic tests and gather forward test data. This keeps the EA running (for data) without material risk.
Replace with a structurally-grounded EA
If testing confirms overfit and the developer cannot provide satisfactory answers, the most efficient path is to replace the EA with one built on structural logic. All Pro-Scalper EAs are built on session-based mechanics and can explain exactly why each parameter exists.
Building in robustness from strategy design — not just testing
Read more →
How updates can introduce new overfit risk to a previously robust EA
Read more →
Why overfit EAs often show abnormal trade frequency in live testing
Read more →
The evidence for automated systems — which separates genuine edge from overfit
Read more →
Profitability metrics that reveal overfit vs genuine edge
Read more →
How to run backtests that reveal overfit rather than hide it
Read more →
Goldie Sniper, Goldie Razor V2 and V2.8.4, Blind Sniper, and Hybrid Scalper. Full suite for every market condition.
Not sure which EA fits your account size or trading style? Email us and we will help you choose.
Pro-Scalper EA Range
Session breakout · M1 · London & NY
High-frequency session breakout capturing London open and NY session momentum on the M1 timeframe.
Range breakout · M15 · H4 EMA filter
M15 range breakout with H4 200 EMA trend filter, 6-level trailing stop, and failed-breakout recovery.
H1 range breakout · proven track record
The original Goldie Razor — H1 breakout strategy with a long live track record on XAUUSD.
Triple-confirmation · low frequency
Low-frequency sniper requiring triple signal confirmation — fewer trades, higher per-trade selectivity.
Manual entry · automated exits
You control entries; the EA manages exits, trailing stops, and position management automatically.
Full Pro-Scalper suite
All five Expert Advisors at a bundle price — cover every market condition and trading style.
Goldie Razor V2.8.4
M15 breakout + H4 EMA filter — built for XAUUSD on MT5