CS 257: Software Design

Web crawler revision

Revise and improve your web crawler program based on the comments you received in the code review and from the grader for the course. A few things to think about:

• Make sure you have set up argparse to parse the command line as specified, sending appropriate error messages and usage reminders to standard error (sys.stderr).
• Adhere to the specification. If you had to make a judgement call on an ambiguous specification, note that judgement in the comment at the top of your source code. Note that "adherence to the spec" typically has many aspects. In this case, it includes the command-line syntax (and corresponding program behavior) as well as the output format.
• Get the program to work correctly if it was not doing so before.
• Improve your naming, your code organization, your commenting strategy, etc., as recommended in your code review.
• Anything that bugged you about the original program? Fix it.

Have fun.