Most sites that block curl only check its name
I sent curl to the top 10,000 sites under a dozen names. Two in three that 403 curl let it in as something else, and Chrome isn't the best disguise.
#scraping
1 post tagged scraping. Or see every tag.
1 post tagged scraping. Or see every tag.
I sent curl to the top 10,000 sites under a dozen names. Two in three that 403 curl let it in as something else, and Chrome isn't the best disguise.