[svn] Fixes for recursive spider mode.

[wget] / src / ChangeLog

diff --git a/src/ChangeLog b/src/ChangeLog
index 51c194f8686c5d9363c6c5f9d8f02d8c2a3ce29c..563abbf38df60fab3d2b7d12f96b368d8a576709 100644 (file)
--- a/src/ChangeLog
+++ b/src/ChangeLog
@@ -1,3 +1,22 @@
+2006-06-28  Mauro Tortonesi  <mauro@ferrara.linux.it>
+
+       * res.c: Implemented is_robots_txt_url function for detection of
+       robots.txt URLs and related test routine.
+
+       * res.h: Ditto.
+
+       * url.c: Implemented are_urls_equal function for URL comparison and
+       related testing routine.
+
+       * url.h: Ditto.
+
+       * convert.c: Fixes for recursive spider mode: don't consider
+       non-existing robots.txt as a broken link, and use are_urls_equal
+       instead of strcasecmp for referrer URLs comparison.
+
+       * test.c: Call tests routines for are_urls_equal and 
+       is_robots_txt_url.
+
 2006-06-26  Hrvoje Niksic  <hniksic@xemacs.org>
 
        * wget.h (wgint): Typedef to any 64-bit (or larger) type we can