Webbots, Spiders, and Screen Scrapers: A Guide to Developing Internet Agents with PHP/CURL - Softcover

Michael Schrenk

  • 3.77 out of 5 stars
    86 ratings by Goodreads
 
9781593271206: Webbots, Spiders, and Screen Scrapers: A Guide to Developing Internet Agents with PHP/CURL
Softcover
ISBN 10: 1593271204 ISBN 13: 9781593271206
Publisher: No Starch Press, 2007

Synopsis

The Internet is bigger and better than what a mere browser allows. Webbots, Spiders, and Screen Scrapers is for programmers and businesspeople who want to take full advantage of the vast resources available on the Web. There's no reason to let browsers limit your online experience—especially when you can easily automate online tasks to suit your individual needs.

Learn how to write webbots and spiders that do all this and more:
–Programmatically download entire websites
–Effectively parse data from web pages
–Manage cookies
–Decode encrypted files
–Automate form submissions
–Send and receive email
–Send SMS alerts to your cell phone
–Unlock password-protected websites
–Automatically bid in online auctions
–Exchange data with FTP and NNTP servers

Sample projects using standard code libraries reinforce these new skills. You'll learn how to create your own webbots and spiders that track online prices, aggregate different data sources into a single web page, and archive the online data you just can't live without.

You'll learn inside information from an experienced webbot developer on how and when to write stealthy webbots that mimic human behavior, tips for developing fault-tolerant designs, and various methods for launching and scheduling webbots. You'll also get advice on how to write webbots and spiders that respect website owner property rights, plus techniques for shielding websites from unwanted robots.

Some tasks are just too tedious—or too important!—to leave to humans. Once you've automated your online life, you'll never let a browser limit the way you use the Internet again.

"synopsis" may belong to another edition of this title.

About the Author

Michael Schrenk has developed webbots for over 15 years, working just about everywhere from Silicon Valley to Moscow, for clients like the BBC, foreign governments, and many Fortune 500 companies. He's a frequent Defcon speaker and lives in Las Vegas, Nevada.

"About this title" may belong to another edition of this title.

Publisher
No Starch Press
Publication date
2007
Language
English
ISBN 10 
1593271204
ISBN 13 
9781593271206
Binding
Paperback
Edition number
1
Number of pages
306
Rating
  • 3.77 out of 5 stars
    86 ratings by Goodreads