I have an issue which I think I know the reason, however I welcome your thoughts.
Most of our products in our site aren’t indexed and here’s why I think it may be,
1. Our sitemap is currently incorrect and is undergoing a fix – therefore none of our URLs are in the sitemap
2. We currently have no robots.txt blocking any pages/resources/files so Google will be crawling the 200,000+ pages/files/resources in our site and eating up our crawl budget and not getting round to all our product pages (around 450 pages ish)
I ran a Screaming Frog crawl to find there was over 200,000 pages/resources/files being crawled, so Google must be doing the same, especially with no Disallows.
I have checked meta tags on product pages and they are all set to INDEX, FOLLOW.
Any other potential reasons?
The site for reference is, Trouser Braces & Suspenders for Men & Women | British Braces
SEO Chat Forums