(2) Wed Mar 26 2008 22:23: "Sometimes it in buyer's requirement that "Beautiful Soup" should be used in the Python spider". Who are these mysterious "buyer"s? Contract one-off scraping jobs arranged through developer-for-hire sites?
Posted by Evan at Thu Mar 27 2008 08:48
In the style of Murakami's short-story-writing protagonists:"Our hero mostly made his way by one-off screen scrape jobs. The pay wasn't what he was accustomed to, but Beautiful Soup did most of the work anyway. His last job was to scrape cooking websites for recipes involving miso; the buyer was a small publishing outfit run by a wealthy housewife.
She didn't seem to care much about the recipes, or cooking in general. The working title, 'Me So Miso' , was the only buyer's requirement."
The Mysterious buyers are from freelancing sites. Sometimes they explicitly mention that 'beautiful soup' needs to be used.