Inconsistent Backtest Results

[Gautam Heble-1756230857752]

I'm running into a consistency issue with my backtesting that's making it hard to trust the results.

I've been backtesting a weekly strategy, tracking all my parameters (index, backtest period, filters, market trend filter, etc.) in a spreadsheet along with results, screenshots, and CSV file export.

The problem is when I rerun the exact same backtest a few days or weeks later using identical parameters, I'm getting completely different results.

This is a problem because if backtest results re not reproducible, then I cannot rely on them.

For example, I tested a specific parameters set a couple of weeks ago and got the below results.

When I ran the same backtest parameters again today, I got a completely different result!

[ARSHITKUMAR DOBARIYA-1752728479219]

This happens due to split,bonus and other corporate actions, if you see for longer horizon it won't affect much

recently I bought 9 shares as per system, but after split, I done backtesting and it showed 10 shares

so minor differnce could be there, but in long run it average out

[Gautam Heble-1756230857752]

I doubt thats it, because these backtests were executed within a span of 2 weeks. So I can expect minor differences, but over a backtest period of 9 years, the huge difference is concerning.

[Rajendra Manke-1755576305833]

@G Heble
Try to post images of all the screens used in the back testing for better understanding. A small variation in a parameter can give different results.

[Gautam Heble-1756230857752]

@Rajendra Manke At this point I don't have screenshots of the criteria, just my notes on each and both the criteria notes have the same parameter values.

[Yogesh Kumar-1757946211892]

I have also observed the difference between back testing and real portfolio through momentify. Will post with images.

[Gautam Heble-1756230857752]

@Yogesh Kumar Yes, I saw your post as well, thanks for testing it against your real portfolio.

I am now struggling to get convinced to invest in the platform more until there's clarity around this aspect and the support team has not been responding.