Scrape backend e- commerce site PYTHON

Need to build a python scraper to get background info from e- commerce site. I need to find URLs, from Ecommerce / online Sneaker stores, which are hidden/not indexed/not live yet on the site. As well as hidden variant / Product ID / and generall Product information that helps to cart and buy product early. As every site is diffrent and i want to use it for multiple diffrent sites - i need to learn/ understand how this can be achieved and alter / change the script if needed to make it work on all pages.