As the web grows, api’s have grown with it. However, not every site has an api that is accessible. To get around this, developers have been using crawlers and scrapers for years. When it comes to ecommerce sites, this information is very valuable. For example, one could use a scraper to cache product prices, or perhaps create a database of their favorite products. For now the package has custom methods made for Amazon, Walmart, Target, BestBuy, and Etsy (chosen based of ecommerce alexa ratings).
To try and solve this problem, I wrote a small package to scrape ecommerce product pages. Please check it out, use it, and contribute to it.
wrote a package to do web scraping of ecommerce product pages. https://t.co/qgWNDzwPud #nodejs #npm— Jon Stuebe (@jonstuebe) November 22, 2015