Fix some other problems with GNU TLS and non blocking sockets.

[wget] / src / ChangeLog

2011-08-30  Giuseppe Scrivano  <gscrivano@gnu.org>

        * gnutls.c (wgnutls_read_timeout): Use the non blocking socket only for
        `gnutls_record_recv'.  Set errno to ETIMEDOUT on a read timeout.

2011-08-29  Giuseppe Scrivano  <gscrivano@gnu.org>

        * gnutls.c (wgnutls_read_timeout): New function.
        (wgnutls_read): Use wgnutls_read_timeout.
        (wgnutls_peek): Likewise.

2011-08-27  Giuseppe Scrivano  <gscrivano@gnu.org>

        * main.c (print_help): Exit with an error status if print to stdout
        fails.
        (print_usage): Change method signature and return a status code.
        (print_version): Likewise.

2011-08-26  Giuseppe Scrivano  <gscrivano@gnu.org>

        * gnutls.c: Include "ptimer.h".
        (wgnutls_read): Honor read timeout.

        * openssl.c (ssl_init): Make `meth' const.

2011-08-25  Giuseppe Scrivano  <gscrivano@gnu.org>

        * utils.c [HAVE_UTIME && HAVE_UTIME_H]: Include <utime.h>.
        [HAVE_UTIME && HAVE_SYS_UTIME_H]: Include <sys/utime.h>.
        (touch) [HAVE_UTIME: Prefers utime over futimens when it is available.
        It was reported that Cygwin has a not working futimens.

2011-08-19  Giuseppe Scrivano  <gscrivano@gnu.org>

        * init.c (home_dir) [MSDOS]: Move local variable `len' here.

2011-08-18  Giuseppe Scrivano  <giuseppe@southpole.se>

        * http.c (gethttp): Fix a memory leak on some errors.  Free the head
        buffer.

        * Makefile.am: Use an additional file "css_.c" which in turn includes
        "wget.h" and immediately "css.c".

        * http.c (gethttp): Reset chunked_transfer_encoding on redirections.

2011-08-13  Giuseppe Scrivano  <gscrivano@gnu.org>

        * retr.c (fd_read_body): Ensure max is not already defined.

        * mswindows.h (snprintf): Remove definition.
        (vsnprintf): Likewise.

2011-08-12  Giuseppe Scrivano  <gscrivano@gnu.org>

        * css.l: Remove include "wget.h".
        Reported by: Perry Smith <pedzsan@gmail.com>.

2011-08-11  Giuseppe Scrivano  <gscrivano@gnu.org>

        * utils.c (abort_run_with_timeout): Use sigprocmask instead of
        sigsetmask.

        * gnutls.c (ssl_connect_wget): Remove call to deprecated function
        `gnutls_certificate_type_set_priority'.

        * Makefile.am (version.c): Don't invoke hg to set version string.

2011-08-10  Giuseppe Scrivano  <gscrivano@gnu.org>

        Fix a linker error on systems with an older gnutls version.
        * gnutls.c (ssl_connect_wget)
        [HAVE_GNUTLS_PRIORITY_SET_DIRECT]:  Use gnutls_priority_set_direct.
        [! HAVE_GNUTLS_PRIORITY_SET_DIRECT]:  Use gnutls_protocol_set_priority.
        Reported by: Karl Berry <karl@freefriends.org>

2011-08-06  Jochen Roderburg <Roderburg@Uni-Koeln.DE>

        * host.c (lookup_host): Ensure it doesn't print more IPs than available
        ones.

2011-08-06  Giuseppe Scrivano  <gscrivano@gnu.org>

        * init.c (defaults): Set default value for show_all_dns_entries.

        * host.c (lookup_host): If `showalldnsentries' is used then print all
        the IP corresponding to a DNS entry.
        * init.c (commands): Add `showalldnsentries'.
        Suggested by: Witold Baryluk <baryluk@smp.if.uj.edu.pl>

        * http.c (gethttp): Add the Cache-Control HTTP header when --no-cache
        is specified.
        Reported by: Коренберг Марк <socketpair@gmail.com>.

2011-08-05  Giuseppe Scrivano  <gscrivano@gnu.org>

        * utils.c (acceptable): Accept always the file if it is the specified
        output destination.
        Reported by: Shai Berger <shai@platonix.com>

2011-08-05  Giuseppe Scrivano  <giuseppe@southpole.se>

        * gnutls.c (ssl_connect_wget): Use `gnutls_priority_set_direct' instead
        of the deprecated `gnutls_protocol_set_priority'.

2011-08-02  Giuseppe Scrivano  <giuseppe@southpole.se>

        * cookies.c (parse_set_cookie): If the value is quoted, do not modify
        it.
        Reported by: Nirgal Vourgère <jmv_deb@nirgal.com>

2011-07-29  Giuseppe Scrivano  <giuseppe@southpole.se>

        * log.c (logprintf): Exit immediately on a SIGPIPE error.
        Reported by: Noèl Köthe  <noel@debian.org>.

2011-07-26  Carlos Martín Nieto  <carlos@cmartin.tk>  (tiny change)

        * init.c (home_dir): Allocate path buffer dinamically.

2011-07-26  Giuseppe Scrivano  <giuseppe@southpole.se>

        * retr.c (retrieve_url): Do not register redirects when in spider mode.

2011-07-20 Merinov Nikolay <kim.roader@gmail.com>

        * iri.c (remote_to_utf8): Add test for non-ASCII symbols with
        UTF-8 URI encoding.
        * res.c (res_retrieve_file): Fix url_parse call.

2011-06-08  Giuseppe Scrivano  <giuseppe@southpole.se>

        * retr.c (retrieve_from_file): Parse the url careless if IRI is enabled.
        Reported by: Volker Kuhlmann <list0570@paradise.net.nz>.

2011-05-24  Giuseppe Scrivano  <gscrivano@gnu.org>

        * retr.c (fd_read_body): Define max.

2010-12-28  Adrien Nader  <adrien@notk.org> (tiny change)

        * main.c [WINDOWS]: Include <io.h> and <fcntl.h>.
        (main) [WINDOWS]: Set the stdout file mode to binary.
        Submitted also by: Martin Panter <vadmium@gmail.com>

2011-05-23  Giuseppe Scrivano  <gscrivano@gnu.org>

        * retr.c (fd_read_body): Be sure the buffer size is at least 8Kb.
        BUFSIZ may assume very small values with a negative impact on the
        performances.

        * mswindows.h [NEED_GAI_STRERROR]: remove definition for gai_strerror.

2011-05-15  Ray Satiro <raysatiro@yahoo.com>

        * connect.c (select_fd) [WINDOWS]: Ensure the socket is blocking.
        * mswindows.h: Add declaration for set_windows_fd_as_blocking_socket.
        * mswindows.c (set_windows_fd_as_blocking_socket): New function.

        * openssl.c (openssl_read): Prevent loops on read errors.

2011-04-24  Giuseppe Scrivano  <gscrivano@gnu.org>

        * html-url.c: Include "exists.h".
        * gnutls.c (wgnutls_peek): Remove local variable `ret'.

2011-04-21  Daniel Manrique <roadmr@tomechangosubanana.com> (tiny change)
        * main.c (main): Set exit status when invalid host name given in
        command line.
        * html-url.c (get_urls_file): Set exit status when invalid host
        name given in input file.

2011-04-19  Giuseppe Scrivano  <gscrivano@gnu.org>

        * gnutls.c: Do not include <fcntl.h>.
        * gnutls.c (wgnutls_peek): Ensure there is data available before attempt
        a read on the blocking socket.

        * Makefile.am (LIBS): Add $(LIB_CLOCK_GETTIME)
        * utils.c: Include <sys/stat.h>.  Do not include <sys/time.h>.
        (touch): Use `futimens' instead of `utimes'.

        * mswindows.h: Do not include <direct.h>.  Remove macro definition for
        mkdir.

2011-04-18  Giuseppe Scrivano  <gscrivano@gnu.org>

        * utils.c: Include <sys/time.h>.  Do not include <sys/utime.h>.
        (touch): Use `utimes' instead of `utime'.

        * openssl.c (openssl_read): Fix build error.

2011-04-17  Giuseppe Scrivano  <gscrivano@gnu.org>

        * wget.h [HAVE_LIBSSL32]: Define HAVE_SSL.

        * gnutls.c (wgnutls_peek): Use correctly FIONBIO codes under Mingw32.
        Reported by: Ray Satiro <raysatiro@yahoo.com>

2011-04-13  Giuseppe Scrivano  <gscrivano@gnu.org>

        * openssl.c (openssl_poll): Check if the specified timeout is zero after
        SSL_pending.
        (openssl_peek): Make the call non-blocking.

2011-04-11  Cristian Rodríguez  <crrodriguez@opensuse.org> (tiny change)

        * openssl.c (ssl_init) [! OPENSSL_NO_SSL2]: Use SSLv2 only when
        available.

2011-04-07  Giuseppe Scrivano  <gscrivano@gnu.org>

        * gnutls.c (ssl_init): Allow X509 v1 certificates.
        Suggested by: Ray Satiro <raysatiro@yahoo.com>

        (wgnutls_peek): Remove tight loop around gnutls_record_recv.

2011-04-07  Ray Satiro  <raysatiro@yahoo.com> (tiny change)

        (wgnutls_read): Check for the GNUTLS_E_AGAIN return code in the recv
        tight loop.
        (wgnutls_write): Likewise.
        (wgnutls_peek): Likewise.

2011-04-07  Giuseppe Scrivano  <gscrivano@gnu.org>

        * gnutls.c (wgnutls_peek): New local variable `read'.
        Use `read' instead of `ret' to store the number of read bytes.
        Reported by: Ray Satiro <raysatiro@yahoo.com>

2011-04-04  Giuseppe Scrivano  <gscrivano@gnu.org>

        * openssl.c [WINDOWS]: Include <w32sock.h>.
        (openssl_read): Retry the read on SSL_ERROR_WANT_READ.

        * host.c [WINDOWS]: Include <winsock2.h> and <ws2tcpip.h>.
        Suggested by: Ray Satiro <raysatiro@yahoo.com>.

        * Makefile.am (LIBS): Remove  @LIBSSL@ @W32LIBS@

2011-04-03  Giuseppe Scrivano  <gscrivano@gnu.org>

        * gnutls.c: Include <fcntl.h>.
        (wgnutls_peek): Make the socket non blocking before attempt a read.

        * gnutls.c: Include <sys/ioctl.h>.
        (wgnutls_peek) [F_GETFL]: Use fcntl.
        (wgnutls_peek) [! F_GETFL]: Use ioctl.


2011-03-31  Giuseppe Scrivano  <gscrivano@gnu.org>

        * recur.c (download_child_p): When --no-parent is used, check that the
        ports are the same only in case the same protocol is used.
        Reported by: Karl Berry <karl@freefriends.org>

        * res.c (res_parse): Add new line to debug messages.

2011-03-21  Giuseppe Scrivano  <gscrivano@gnu.org>

        * iri.h (parse_charset) [!ENABLE_IRI]: Use the parameter to avoid a
        compiler warning.

        * iri.h: Declare `dummy_iri' as extern not static.
        * main.c [!ENABLE_IRI]: Define `dummy_iri'.
        (main) [!ENABLE_IRI]: Initialize `dummy_iri'.

2011-03-11  Giuseppe Scrivano  <gscrivano@gnu.org>

        * ftp.c (getftp): Fix some memory leaks.
        * ftp-ls.c (ftp_parse_winnt_ls): Likewise.
        Reported by: Zhenbo Xu <zhenbo1987@gmail.com>.

2010-11-20  Filipe Brandenburger <filbranden@gmail.com> (tiny change)

        * http.c (gethttp): Repeat a POST request on a 307 response.
        * retr.c (retrieve_url): Use NEWLOCATION_KEEP_POST.
        * wget.h: Define NEWLOCATION_KEEP_POST.

2011-03-02  Tomasz Buchert <tomek.buchert@gmail.com> (tiny change)

        * http.c (ensure_extension): Do not adjust the extension if the file
        ends in .htm.

2011-02-22  Gilles Carry  <gilles.carry@st.com>

        * main.c (prompt_for_password): Use stderr instead of stdout
        to prompt password. This allows to use --output-document=- and
        --ask-password simultaneously. Without this, redirecting stdout
        makes password prompt invisible and mucks up payload such as in
        this example:
        wget --output-document=- --ask-password -user=foo \
                http://foo.com/tarball.tgz | tar zxf -

2011-02-22  Steven Schubiger  <stsc@member.fsf.org>

        * http.c (gethttp, http_loop): Move duplicated code which is run
        when an existing file is not to be clobbered to a function.
        (get_file_flags): New static function.

2010-12-10  Evgeniy Philippov <egphilippov@googlemail.com> (tiny change)

        * main.c (main): Initialize `total_downloaded_bytes'.

2010-12-09  Giuseppe Scrivano  <gscrivano@gnu.org>

        * main.c (main): If --no-clobber and --convert-links are used at the
        same time, use only the latter.
        Reported by: Romain Vimont <rom@rom1v.com>

2010-12-07  Jessica McKellar <jesstess@mit.edu> (tiny change)

        * main.c: Make help message clearer.

2010-12-02  Giuseppe Scrivano  <gscrivano@gnu.org>

        * build_info.c.in: Do not list md5.

2010-12-01  Giuseppe Scrivano  <gscrivano@gnu.org>

        * cmpt.c: Include <unistd.h> inconditionally.
        * connect.c: Likewise.
        * convert.c: Likewise.
        * ftp-basic.c: Likewise.
        * ftp-ls.c: Likewise.
        * ftp.c: Likewise.
        * gnutls.c: Likewise.
        * http.c: Likewise.
        * init.c: Likewise.
        * log.c: Likewise.
        * main.c: Likewise.
        * openssl.c: Likewise.
        * progress.c: Likewise.
        * ptimer.c: Likewise.
        * recur.c: Likewise.
        * retr.c: Likewise.
        * url.c: Likewise.
        * utils.c: Likewise.

        * retr.c (fd_read_body): Dinamically allocate `dlbuf'.

2010-11-27  Reza Snowdon  <vivi@mage.me.uk>

        * init.c (initialize): If 'ok' is not zero; exit, as this
        indicates there was a problem parsing 'SYSTEM_WGETRC'.
        Fixes bug #20370.

2010-11-22  Giuseppe Scrivano  <gscrivano@gnu.org>

        Revert last commit.
        * ftp.c (getftp): When count > 0, don't append to the existing file.
        * http.c (gethttp): Likewise.

2010-11-21  Giuseppe Scrivano  <gscrivano@gnu.org>

        * ftp.c (getftp): If `count' is bigger than zero, try to resume the
        download, not restart it.
        * http.c (gethttp): Likewise.
        Suggested by: Evgeny Kapun <abacabadabacaba@gmail.com>.

2010-11-19  Giuseppe Scrivano  <gscrivano@gnu.org>

        * ftp.c (getftp): Accept new argument `count'.  When `count' is
        bigger than zero, assume the file can be overwritten.
        (ftp_loop_internal): Pass new argument `count' to `getftp'.

        * http.c (gethttp): Accept new argument `count'.  When `count' is
        bigger than zero, assume the file can be overwritten.
        (http_loop): Pass new argument `count' to `gethttp'.
        Reported by: Evgeny Kapun <abacabadabacaba@gmail.com>.

2010-08-08  Reza Snowdon <vivi@mage.me.uk>

        * main.c (main): inserted 'defaults'.
          Added additional 'getopt_long' while loop to search and apply a
          user specified config file before any other options.
          New variables 'retconf', 'use_userconfig',
          'confval', 'userrc_ret', 'config_opt'.
        * init.c: Include stdbool.h.
          (commands): Added config details.
          (defaults): Removed static.
          (wgetrc): Removed static.
          (initialize): Removed 'defaults ()',
          changed 'int ok' to 'bool ok'.
        * options.h: New variable 'choose_config'.
        * init.h (defaults): exported function.
          (run_wgetrc): exported function.

2010-10-24  Jessica McKellar <jesstess@mit.edu> (tiny change)

        * main.c (main): Print the total download time as part of the
        summary for downloads using the recursive or page requisites
        options. Fixes bug #21359.

2010-10-24  Giuseppe Scrivano  <gscrivano@gnu.org>

        * gnutls.c (wgnutls_peek): Do not return an error when
        `gnutls_record_recv' fails but some data is already available.

2010-10-23  Giuseppe Scrivano  <gscrivano@gnu.org>

        * Makefile.am (LIBS): Remove @LIBGNUTLS@ and use @W32LIBS@ as last
        component.

        * gnutls.c (wgnutls_peek): Block until data is available.

2010-10-21  Giuseppe Scrivano  <gscrivano@gnu.org>

        * retr.c (retrieve_url): Do not register HTML files twice.
        Reported by: Manfred Koizar <mkoi-pg@aon.at>.

2010-10-18  Manfred Koizar <mkoi-pg@aon.at> (tiny change)

        * html-url.c (tag_handle_link): Do not assume external links type
        to be always "text/html".

2010-10-16  Giuseppe Scrivano  <gscrivano@gnu.org>

        * connect.c (socket_ip_address): Initialize `sockaddr' to zero.
        * ftp-basic.c (ftp_epsv): Remove dead assignment to `s'.
        * ftp-ls.c (ftp_parse_vms_ls): Remove dead assignment to `len'.
        * http.c (skip_short_body): Remove dead assignment to `ret'.
        * init.c (wgetrc_user_file_name): Remove dead assignment to `home'.
        * main.c (main): Silent warning reported by clang.
        (http_loop): Silent warning reported by clang.
        * retr.c (retrieve_url): Likewise.
        * url.c (init_seps): Remove dead assignment to `p'.

2010-10-11  Giuseppe Scrivano  <gscrivano@gnu.org>

        * ftp.c (getftp): Fix indentation.

2010-10-11  Steven Schubiger <stsc@member.fsf.org>

        * ftp.c (getftp): Initialize `targ'.

2010-10-08  Ivanov Anton <x86mail@gmail.com> (tiny change)

    * src/html-url.c (check_style_attr): Skip quotes when they are present.

2010-10-06  Giuseppe Scrivano  <gscrivano@gnu.org>

        * main.c (main): Remove unused variable `status'.

2010-09-25  Merinov Nikolay  <kim.roader@gmail.com>

        * init.c: Add "unlink" command into command list.
        * main.c: Add "unlink" option into option_data list.
        * options.h: Adding unlink field into struct options.
        * wget.h: Addind UNLINKERR error into uerr_t enum.
        * exits.c (get_status_for_err): define status for UNLINKERR.
        * ftp.c (getftp): unlink file if exists, instead clobbering.
        (ftp_loop_internal): processing UNLINKERR.
        * http.c (gethttp): unlink file if exists, instead clobbering.
        (http_loop): processing UNLINKERR.

2010-09-24  Dennis, CHENG Renquan <crquan@fedoraproject.org>

        Fix problem when content-disposition is used with recursive downloading.
        * url.h (url_file_name): Add a new argument `replaced_filename'.
        * url.c (url_file_name): Likewise.
        * http.c (parse_content_disposition): Do not add a prefix to the return
        value.
        (test_parse_content_disposition): Adjust tests.
        (gethttp): Pass additional parameter to `url_file_name'.
        (http_loop): Likewise.
        * ftp.c (ftp_loop_internal, ftp_get_listing, ftp_retrieve_list)
        (ftp_loop): Likewise.

2010-09-14  Giuseppe Scrivano  <gscrivano@gnu.org>

        * convert.c (local_quote_string): Accept new parameter `no_html_quote'.
        Inhibit HTML quoting when `no_html_quote'.
        (convert_links): Disable HTML quoting in CSS files.
        Reported by: Manuel Reinhardt <reinhardt@syslab.com>.

2010-09-12  Giuseppe Scrivano  <gscrivano@gnu.org>

        * main.c (print_help): Align --trust-server-names help text with
        the rest of the text.
        Suggested by: Mike Frysinger  <vapier@gentoo.org>.

2010-08-20  Giuseppe Scrivano  <gscrivano@gnu.org>

        * convert.c: Include "iri.h".
        (convert_links_in_hashtable): Parse the url, if
        necessary, before check if it is present in the dowloaded url
        map.
        Reported by: <sk.random@gmail.com>.

2010-08-09  Giuseppe Scrivano  <gscrivano@gnu.org>

        Fix a problem with HTTP/1.0 proxies.
        * http.c (gethttp): Specify the connection header when keep alive
        connections are not used.

        Use persistent connections with proxies supporting them.
        * http.c (gethttp): Specify Proxy-Connection to the HTTP proxy.

2010-08-06  Giuseppe Scrivano  <gscrivano@gnu.org>

        * css-url.c (get_uri_string): Skip empty urls.

2010-07-25  John Trengrove  <jtrengrove@gmail.com> (tiny change)

        * ftp.h: Added enum `parsetype'.  Modified struct to hold parsetype.

        * ftp-ls.c (ftp_parse_unix_ls): Default to TT_DAY. Change to TT_HOUR_MIN
        if hours/minutes parsed.
        (ftp_parse_winnt_ls): Default to TT_HOUR_MIN.
        (ftp_parse_vms_ls): Default to TT_HOUR_MIN.
        (ftp_index): Print only if fileinfo struct value ttype set to TT_HOUR_MIN.

2010-07-30  Giuseppe Scrivano  <gscrivano@gnu.org>

        * html-url.h (struct map_context): Remove member `tail'.

        * html-url.c (append_url): Append the new url ordered by `position'.
        (get_urls_html): Do not initialize `ctx.tail'.

        * css-url.c (get_urls_css_file): Do not initialize `ctx.tail'.

2010-07-29  Giuseppe Scrivano  <gscrivano@gnu.org>

        * gnutls.c (wgnutls_peek): Don't read more data if the buffered peek
        data is sufficient.

2010-07-28  Giuseppe Scrivano  <gscrivano@gnu.org>

        * http.h (http_loop): Add new argument `original_url'
        * http.c (http_loop): Add new argument `original_url'.  Use
        `original_url' to get a filename if `trustservernames' is false.

        * init.c (commands): Add "trustservernames".

        * options.h (library): Add variable `trustservernames'.

        * main.c (option_data): Add trust-server-names.
        (print_help): Describe --trust-server-names.

        * retr.c (retrieve_url): Pass new argument to `http_loop'.

2010-07-20  Alan Jenkins <alan-jenkins@tuffmail.co.uk> (tiny change)

        * http.c (gethttp): Check content-length was set before trying to
        compare it with the already downloded filesize.

2010-07-20  Leonid Petrov <nouser@lpetrov.net>

        * ftp.c (getftp): Don't attempt to retrieve the file if it is already
        completely.
        (ftp_loop_internal): Force the length to be zero for symlinks.

2010-07-18  Giuseppe Scrivano  <gscrivano@gnu.org>

        * http.c (gethttp): If -N is used, don't exit immediately if the content
        length is less or equal than the existing file size.  Specify "Range"
        only if -N is not used.
        Reported by: Caleb Cushing <xenoterracide@gmail.com>.

2010-07-14  Giuseppe Scrivano  <gscrivano@gnu.org>

        * ftp.c (max): Remove definition.
        (getftp): New variable `got_expected_bytes'.  Let `expected_bytes' be
        the value SIZE returns, otherwise use the bytes count returned by RETR.
        Suggested by Daniel Stenberg <daniel@haxx.se>.

2010-07-14  Giuseppe Scrivano  <gscrivano@gnu.org>

        * ftp.c (max): Add definition.
        (getftp): Consider for `expected_bytes' the greatest value between the
        bytes count returned by SIZE and the bytes count returned by RETR.
        Reported by: Jozua <jozua@sparky.za.net>.

2010-07-11  Giuseppe Scrivano  <gscrivano@gnu.org>

        * http.c (http_loop): New variable `force_full_retrieve'.  If the remote
        file is newer that the local one then inhibit -c.
        Reported by: Caleb Cushing <xenoterracide@gmail.com>.

2010-07-09  Giuseppe Scrivano  <gscrivano@gnu.org>

        * css-url.c (get_urls_css_file): Use `wget_read_file' instead of
        `read_file'.  Use `wget_read_file_free' instead of `read_file_free'.
        * convert.c (convert_links): Likewise.
        * html-url.c (get_urls_html, get_urls_file): Likewise.
        * res.c (res_parse_from_file): Likewise.

        * utils.h: Rename `read_file' to `wget_read_file'.  Rename
        `read_file_free' to `wget_read_file_free'.

        * utils.c (wget_read_file): Renamed from `read_file'.
        (wget_read_file_free): Renamed from `read_file_free'.

2010-07-05  Giuseppe Scrivano  <gscrivano@gnu.org>

        * gnutls.c (ssl_init): New local variables `ca_directory' and `dir'.
        Load default root certificates under the `ca_directory' directory.

2010-07-03  Giuseppe Scrivano  <gscrivano@gnu.org>

        * gnutls.c (ssl_connect_wget): New local variable `allowed_protocols'.
        Honor the --secure-protocol flag.

2010-06-20  Giuseppe Scrivano  <gscrivano@gnu.org>

        * main.c (print_help): Fix help string for --random-wait.  Its range is
        [0.5*wait, 1.5*wait) not [0, 2*wait).
        Reported by: Tom Mizutani <gombei1970@gmail.com>.

2010-06-15  Giuseppe Scrivano  <gscrivano@gnu.org>

        * gnutls.c [WIN32]: Include "w32sock.h".
        (FD_TO_SOCKET): Add definition.
        (ssl_connect_wget): Get the real socket handle by FD_TO_SOCKET.
        Define FD_TO_SOCKET if it is not yet defined.

2010-06-14  Giuseppe Scrivano  <gscrivano@gnu.org>

        * gnutls.c: Include <stdlib.h>.
        (struct wgnutls_transport_context): Remove `peekstart'.
        (ssl_connect_wget): Renamed from `ssl_connect'.
        (wgnutls_poll): New variable `ctx'.
        (wgnutls_read): Don't use `ctx->peekstart'.
        (wgnutls_peek): Likewise.  Don't attempt to read if there is not
        ready data.

2010-06-14  Giuseppe Scrivano  <gscrivano@gnu.org>
        * http.c (http_loop): Always send a HEAD request when -N is used
        together with --content-disposition.
        Reported by: Jochen Roderburg <Roderburg@Uni-Koeln.DE>.

2010-06-10  Muthu Subramanian K <muthusuba@gmail.com> (tiny change)

        * http.c (http_loop): Increase `total_downloaded_bytes' by
        `hstat.rd_size', not `hstat.len'.

2010-06-10  Giuseppe Scrivano  <gscrivano@gnu.org>

        * main.c (print_version): Drop the current maintainer line.

2010-06-10  Giuseppe Scrivano  <gscrivano@gnu.org>

        * Makefile.am (build_info.c): Generate the `build_info.c' file under
        the build directory.
        Patch by: Daniel Stenberg <daniel@haxx.se>.

2010-06-03  Giuseppe Scrivano  <gscrivano@gnu.org>

        * http.c (http_loop): Do not send a HEAD request before the GET request
        when --content-disposition is used.
        Reported by: alex_wh@mail.ru.

2010-05-31  Giuseppe Scrivano  <gscrivano@gnu.org>

        * css.l: Use option "nounput".
        (YY_NO_INPUT): Add macro definition.

2010-05-31  Giuseppe Scrivano  <gscrivano@gnu.org>

        * html-parse.c (map_html_tags): Fix condition for closed tag.  Handle
        the case '>' is not specified after '/'.

2010-05-31  Giuseppe Scrivano  <gscrivano@gnu.org>

        * sysdep.h (_SVID_SOURCE): Remove definition.
        (_BSD_SOURCE): Remove definition.

2010-05-31  Giuseppe Scrivano  <gscrivano@gnu.org>

        * recur.c (retrieve_tree): Remove variable `up_error_code'.

        * iri.c (open_locale_to_utf8): Remove function.

2010-05-30  Giuseppe Scrivano  <gscrivano@gnu.org>

        * html-parse.c (NAME_CHAR_P): Consider '<' an invalid character.
        (advance_declaration): Close the tag if '<' is found.
        (map_html_tags): Likewise.

2010-05-27  Giuseppe Scrivano  <gscrivano@gnu.org>

        * main.c (print_usage): Accept a new parameter `error'.
        (main): Print diagnostic messages to stderr, not stdout.

2010-05-27  Giuseppe Scrivano  <gscrivano@gnu.org>

        * Makefile.am (wget_SOURCES): Remove `snprintf.c'.

        * snprintf.c: Remove file.

2010-05-27  Giuseppe Scrivano  <gscrivano@gnu.org>

        * main.c (main): Exit with failure when -k is specified and -O is not
        a regular file.

2010-05-27  Giuseppe Scrivano  <gscrivano@gnu.org>

        * http.c (gethttp): Consider new cookies retrieved when the
        authorization fails.

2010-05-25  Giuseppe Scrivano  <gscrivano@gnu.org>

        * host.c (sufmatch): Do not consider zero length entries.

        * http.c (H_10X): New macro.
        (gethttp): Silently ignore 1xx responses.

2010-05-24  Giuseppe Scrivano  <gscrivano@gnu.org>

        * iri.h (dummy_iri): Define static.

        * css-tokens.h (css_tokens): Remove variable.

2010-05-23  Giuseppe Scrivano  <gscrivano@gnu.org>

        * http.c (http_atotm): Count the NUL character when copying the locale
        string.
        Reported by: Florian Weimer <fw@deneb.enyo.de>

2010-05-16  Giuseppe Scrivano  <gscrivano@gnu.org>

        * Makefile.am (LDADD): Remove MD5_LDADD.
        (MD5_LDADD): Remove definition.
        (AM_CPPFLAGS): Remove MD5_CPPFLAGS.
        (version.c): Remove dependency from MD5_LDADD.
        (../md5/libmd5.a): Remove rule.

        * ftp-opie.c: Include "md5.h".  Do not include "gen-md5.h".
        (skey_response): New variable ctx.  Use md5 functions from the gnulib
        module instead of functions defined previously in the "gen-md5.h" file.

        * gen-md5.h: Remove file.
        * gen-md5.c: Likewise.

        * http.c: Include "md5.h".  Do not include "gen-md5.h".
        (digest_authentication_encode): New variable ctx.  Use md5 functions
        from the gnulib module instead of functions defined previously in the
        "gen-md5.h" file.

2010-05-15  Giuseppe Scrivano  <gscrivano@gnu.org>

        * Makefile.am: Quote any path using $(top_srcdir) or $(top_builddir).
        (version.c): Remove dependency from configure.ac and Makefile.am.

        * css.l: Include "wget.h".

2010-05-08  Giuseppe Scrivano  <gscrivano@gnu.org>

        * Makefile.am: Update copyright years.
        * cmpt.c: Likewise.
        * connect.h: Likewise.
        * convert.c: Likewise.
        * convert.h: Likewise.
        * cookies.c: Likewise.
        * cookies.h: Likewise.
        * css-tokens.h: Likewise.
        * css-url.c: Likewise.
        * css-url.h: Likewise.
        * css.l: Likewise.
        * exits.c: Likewise.
        * exits.h: Likewise.
        * ftp-basic.c: Likewise.
        * ftp-ls.c: Likewise.
        * ftp-opie.c: Likewise.
        * ftp.c: Likewise.
        * ftp.h: Likewise.
        * gen-md5.c: Likewise.
        * gen-md5.h: Likewise.
        * gettext.h: Likewise.
        * gnutls.c: Likewise.
        * hash.c: Likewise.
        * hash.h: Likewise.
        * host.c: Likewise.
        * host.h: Likewise.
        * html-parse.c: Likewise.
        * html-parse.h: Likewise.
        * html-url.c: Likewise.
        * html-url.h: Likewise.
        * http-ntlm.c: Likewise.
        * http-ntlm.h: Likewise.
        * http.c: Likewise.
        * http.h: Likewise.
        * init.c: Likewise.
        * init.h: Likewise.
        * iri.c: Likewise.
        * iri.h: Likewise.
        * log.c: Likewise.
        * log.h: Likewise.
        * main.c: Likewise.
        * mswindows.c: Likewise.
        * mswindows.h: Likewise.
        * netrc.c: Likewise.
        * netrc.h: Likewise.
        * openssl.c: Likewise.
        * options.h: Likewise.
        * progress.c: Likewise.
        * progress.h: Likewise.
        * ptimer.c: Likewise.
        * ptimer.h: Likewise.
        * recur.c: Likewise.
        * recur.h: Likewise.
        * res.c: Likewise.
        * res.h: Likewise.
        * retr.c: Likewise.
        * retr.h: Likewise.
        * spider.c: Likewise.
        * spider.h: Likewise.
        * ssl.h: Likewise.
        * sysdep.h: Likewise.
        * test.c: Likewise.
        * test.h: Likewise.
        * url.c: Likewise.
        * url.h: Likewise.
        * utils.c: Likewise.
        * utils.h: Likewise.
        * wget.h: Likewise.

2010-05-07  Giuseppe Scrivano  <gscrivano@gnu.org>

        * gnutls.c (wgnutls_close): Use always `close', not `closesocket'.
        * openssl.c (openssl_close): Use always `close', not `closesocket'.
        (ssl_connect_wget): Get the real socket handle by FD_TO_SOCKET.
        Define FD_TO_SOCKET if it is not yet defined.
        * Makefile.am (libunittest_a_CPPFLAGS): Add -I$(top_builddir)/lib.
        * mswindows.h: Always include <winsock2.h> and <ws2tcpip.h>.  Do not
        include <winsock.h>.
        [! INHIBIT_WRAP]: Remove macro's socket, bind, connect, accept, recv,
        send, select, getsockname, getpeername, setsockopt, closesocket.
        Remove wrapped_socket, wrapped_bind, wrapped_connect, wrapped_listen,
        wrapped_accept, wrapped_recv, wrapped_send, wrapped_select,
        wrapped_getsockname, wrapped_getpeername, wrapped_setsockopt,
        wrapped_closesocket prototypes.
        * mswindows.c:  Remove wrapped_socket, wrapped_bind, wrapped_connect,
        wrapped_listen, wrapped_accept, wrapped_recv, wrapped_send,
        wrapped_select, wrapped_getsockname, wrapped_getpeername,
        wrapped_setsockopt, wrapped_closesocket functions.  Remove WRAP macro.
        * host.h [WINDOWS]: Include <winsock2.h> not <winsock.h>.
        * connect.c: Include <sys/socket.h> and <sys/select.h> on any platform,
        gnulib ensures they exist.  Remove `read', `write', `close' macros.
        * Makefile.am: Copy build_info.c.in only if we are working in a VPATH.
        (AM_CPPFLAGS): Add directory with generated gnulib files.

2010-05-06  Giuseppe Scrivano  <gscrivano@gnu.org>

        * Makefile.am (build_info.c): Generate build_info.c in the builddir,
        not srcdir.

2010-05-05  Giuseppe Scrivano  <gscrivano@gnu.org>

        * http.c (gethttp): Give a nicer message on a malformed status line.

2010-05-04  Giuseppe Scrivano  <gscrivano@gnu.org>

        * http.c (gethttp): Check `resp_status' return code and handle
        errors.

2010-05-01  Giuseppe Scrivano <gscrivano@gnu.org>

        * http.c (request_send): Specify 1.1 as HTTP version for requests.
        (skip_short_body): Accept new parameter `chunked'.  New variable
        `remaining_chunk_size'.  Handle the chunked transfer encoding.
        (gethttp): New variable `chunked_transfer_encoding`.  Set `keepalive'
        by default to true.  Check if the server is using the chunked transfer
        encoding.

        * retr.h: Define `rb_chunked_transfer_encoding'.

        * retr.c (fd_read_body): New variable `chunked'.  New variable
        `remaining_chunk_size'.  Handle the chunked transfer encoding.

2010-03-04  Steven Schubiger  <stsc@member.fsf.org>

        * ftp.c (ftp_loop_internal): Omit input file from being
        deleted after retrieval.

        * retr.c (input_file_url): New function.

        * retr.h: Add declaration for input_file_url.

2010-03-02  Steven Schubiger  <stsc@member.fsf.org>

        * retr.c (retrieve_from_file): Improve checking for a URL
        by invoking url_valid_scheme instead of url_has_scheme.

        * url.c (url_valid_scheme): New function.

        * url.h: Add declaration for url_valid_scheme.

2010-03-02  Steven Schubiger  <stsc@member.fsf.org>

        * retr.c (retrieve_from_file): Free memory of input file.

2010-03-01  Steven Schubiger  <stsc@member.fsf.org>

        * retr.c (retrieve_url): Retrieve the local filename from ftp_loop.
        (retrieve_from_file): Return if there's no input file.

        * ftp.c (ftp_loop_internal): Duplicate the local filename into
        retrieve_url's scope when a valid reference is being passed.
        (ftp_loop): Call ftp_loop_internal here with passing a
        reference to the local filename, elsewhere with NULL.

        * ftp.h: Adjust declaration of ftp_loop.

2010-01-27  Paul Townsend  <aab@purdue.edu>  (tiny change)

        * retr.c (fd_read_body): Be sure to measure timer when time has
        elapsed, too, not just when we've made progress.

2010-01-13  Micah Cowan  <micah@cowan.name>

        * openssl.c: Fixed some mixed declarations-and-code.

2010-01-09  Micah Cowan  <micah@cowan.name>

        * init.c, main.c, http.c, ftp.c, options.h: Renamed
        --no-match-server-timestamps to --no-use-server-timestamps, and
        add it to print_help.

2010-01-09  David Holman  <holman.david@gmail.com>  (tiny change)

        * init.c, main.c, http.c, ftp.c, options.h: Added support for
        --no-match-server-timestamps.

2009-12-03  Peter Rosin  <peda@lysator.liu.se>

        * snprintf.c (dopr): Output %p as unsigned.

2010-01-09  Jeremy Olexa  <darkside@gentoo.org>  (tiny change)

        * init.c: Deal with systems which provide PATH_MAX in
        sys/param.h rather than limits.h.

2009-10-09  Steven Schweda  <sms@antinode.info>

        * utils.c: Added characters " : \ | to the list of normal
        caret-escaped (ODS5) characters in the char_prop[] table.

2009-09-22  Arvind Jamuna Dixit  <ardsrk@gmail.com>

        * http.c (extract_param, parse_content_disposition): Support
        RFC 2231 while parsing Content-Disposition header

2009-10-24  Petr Pisar  <petr.pisar@atlas.cz>

        * openssl.c: Implement support for (multiple) subjectAltNames in
        X509 certificates, not just the commonName.

2009-10-09  Micah Cowan  <micah@cowan.name>

        * main.c: Fix declaration of compiled_features.

        * build_info.c.in: Adapt to new input format. Added a check for
        large-file support. Replaced the "openssl" and "gnutls"
        advertisements with a single "ssl/foo" advertisement.

2009-09-30  Micah Cowan  <micah@cowan.name>

        * sysdep.h: Unconditionally include stdbool.h (gnulib has it for
        systems that don't supply it.)

        * vms.c: Added functions vms_basename(), used to extract the
        bare executable name from argv[0], and vms_getpass(), a
        VMS-specific replacement for GNU getpass().

         vms.c: Added global string constants: compilation_string
        (NULL), link_string (NULL), and version_string (real).

2009-09-24  Micah Cowan  <micah@cowan.name>

        * vms.c: Moved from vms/vms.c.

        * sysdep.h: Use proper prototypes for snprintf, vsnprintf (thanks
        to Steven Schweda).

2009-09-24  Steven Schweda  <sms@antinode.info>

        * main.c (print_version): Remove VMS-conditional build info
        string; the new VMS builders use OS_TYPE.

        * ftp.c (getftp): Fix accidental use of target -> targ.

2009-09-24  Micah Cowan  <micah@cowan.name>

        * host.c (host_errstr): host_errstr should return const char *.

2009-09-22  Micah Cowan  <micah@cowan.name>

        * Makefile.am (version.c): Explicitly tell Mercurial where the
        top-source repository should be, so it doesn't accidentally use
        the repository for a containing directory (for instance, if the
        user's home directory is managed by a Mercurial repo). Also
        ensures we find the repository, even if the build directory is
        outside the source directory.

        * wget.h: define WINDOWS if _WIN32 or __WIN32__ is defined, but
        not __CYGWIN__.

        * mswindows.c (xsleep): Check for availability of the sleep
        function, in addition to the usleep function.
        (get_winsock_error, windows_strerror): Removed (gnulib already
        supplies this functionality).

        * mswindows.h [NEED_GAI_STRERROR]: define gai_strerror
        to (gnulib's) strerror, rather than windows_strerror. Removed
        error macro definitions provided by gnulib.
        (windows_strerror): Removed (gnulib already supplies this
        functionality).

        * host.c: Don't declare h_errno when building on Windows.

        * Makefile.am (LIBS): Added @W32LIBS@.
        (EXTRA_wget_SOURCES): Removed (it's in LIBOBJ now).
        (version.c): Removed dependency on $(LDADD), since it may include
        dependencies that are not part of the Wget sources (-lwsock32, for
        instance).

        * openssl.c (ssl_check_certificate): Avoid reusing the same buffer
        space for successive quoted arguments. Thanks to Steven Schweda
        for pointing out the problem.

2009-09-21  Micah Cowan  <micah@cowan.name>

        * progress.c (update_speed_ring): "the the" -> "the".

        * css-url.c, iri.c, mswindows.c: Removed assert.h inclusion (not
        using it).

2009-09-11  Steven Schweda  <sms@antinode.info>

        * utils.c, utils.h (fopen_excl): Make second argument an int,
        rather than a bool (so it can handle the appropriate VMS version
        of the flag).

        * main.c (print_version): Don't print LOCALEDIR unless NLS is
        enabled.

        * http.c (gethttp): Pass FOPEN_BIN_FLAG, instead of true.

        * ftp.c (ftp_retrieve_glob): Cast strcmp to assign to cmp, for a
        silly HP build environment.

2009-09-08  Steven Schubiger  <stsc@member.fsf.org>

        * main.c, init.c: Mark the --preserve-permissions and
        --html-extension option as deprecated.

2009-09-06  Micah Cowan  <micah@cowan.name>

        * ftp.c (getftp, ftp_loop_internal): Separate "len" input/output
        parameter (with different meanings for input and output), into two
        separate parameters, one input (passed_expected_bytes) and one
        output (qtyread). Fixes bug #26870.

2009-09-05  Steven Schubiger  <stsc@member.fsf.org>

        * retr.h: Declare set_local_file() to avoid build warnings.

2009-09-05  Gisle Vanem  <gvanem@broadpark.no>

        * connect.c, init.c, main.c, openssl.c, options.h:  Replace
        "ifdef MSDOS" with "ifdef USE_WATT32" since DOS-targets in fact
        use the Watt-32 tcp/ip stack.

2009-09-04  Micah Cowan  <micah@cowan.name>

        * Makefile.am: Move build_info.c to wget_SOURCES from
        nodist_wget_SOURCES, reduce dependencies, and invoke build_info.pl
        in its new home, $(top_srcdir)/build-aux.

2009-09-03  Micah Cowan  <micah@cowan.name>

        * ftp-ls.c (ftp_parse_vms_ls): Replace use of localtime_r with
        localtime, as not all platforms have localtime_r.

        * Makefile.am (wget_SOURCES): Rearranged some of the file order,
        so .c files and .h files are apart. Added gettext.h, so that it
        shows up in the dist.

2009-09-02  Micah Cowan  <micah@cowan.name>

        * gettext.h: Refreshed from gettext 0.17.

        * test.c: Added definition of program_name variable, required by
        lib/error.c (libgnu.a). Doesn't cause problems until you try to
        build on a non-GNU system...

        * build_info.c.in: Removed useless "+gettext" feature ad.

2009-08-29  Steven Schubiger  <stsc@member.fsf.org>

        * convert.c (local_quote_string): Percent-encode semicolons
        in local file strings.

2009-08-27  Micah Cowan  <micah@cowan.name>

        * wget.h (uerr_t): added new VERIFCERTERR code for SSL certificate
        problems. Marked exit codes that are defined but never used (at
        least, the ones I could find).

        * retr.c, retr.h (retrieve_url): Added a new boolean argument to
        determine whether an exit status should be recorded.
        (retrieve_from_file): Adjust to new retrieve_url signature.

        * res.c (res_retrieve_file): Don't have retrieve_url record an
        exit status for robots.txt.

        * recur.c (retrieve_tree): Adjust to new retrieve_url signature.

        * main.c (main): Use the exit status stored by retrieve_url.

        * http.c (gethttp): Distinguish certificate verification problems
        from SSL connection issues.
        (http_loop): Handle newly-created VERIFCERTERR error code.

        * exits.c, exits.h: Newly added.

        * Makefile.am (wget_SOURCES): Add exits.c and exits.h.

2009-08-27  Micah Cowan  <micah@cowan.name>

        * http.c (gethttp): Make sure Wget heeds cookies when they
        are sent with a 401 response; or any other sort of response for
        that matter (#26775).

2009-08-19  Micah Cowan  <micah@cowan.name>

        * openssl.c (ssl_check_certificate): Only warn about an attack if
        the hostname would otherwise have matched. Also some formatting
        cleanup.

2009-08-19  Joao Ferreira  <joao@joaoff.com>

        * openssl.c (ssl_check_certificate): Detect embedded NUL
        characters in the SSL certificate common name.

2009-08-17  Tony Lewis  <tlewis@exelana.com>

        * http.c (gethttp): Ensure that we parse Content-Length before we
        attempt to refer to its value. Without this fix, NTLM support was
        completely buggered. #27192

2009-08-09  Michael Baeuerle  <michael.baeuerle@gmx.net>

        * ftp.c: #include <strings.h> for strcasecmp.

2009-07-28  Micah Cowan  <micah@cowan.name>

        * main.c (option_data): Rename --html-extension to
        --adjust-extension.
        (print_help): Ditto.

        * options.h (struct option): Rename html_extension to
        adjust_extension.
        * http.c (gethttp): Ditto.
        * convert.c (local_quote_string): Ditto.

        * init.c (commands): Add "adjustextension", and reflect rename
        change for opt.adjust_extension, for both "adjustextension" and
        "htmlextension".

2009-07-27  Micah Cowan  <micah@cowan.name>

        * options.h (struct options): Added restrict_files_nonascii
        boolean field.

        * url.c (FILE_CHAR_TEST): Add check for chars outside the ASCII
        range.

        * init.c (defaults): Add restrict_files_nonascii to initialization.
        (cmd_spec_restrict_file_names): Allow parsing of "ascii" keyword.

2009-07-27  Marcel Telka  <marcel@telka.sk>

        * iri.c (do_conversion): Typo: invalide -> invalid

2009-07-27  Petr Pisar  <petr.pisar@atlas.cz>

        * main.c (print_help): Fixed a couple typos.

2009-07-26  Micah Cowan  <micah@cowan.name>

        * main.c (option_data): Rename --locale option to --local-encoding
        (print_help): Document --no-iri, --local-encoding, and
        --remote-encoding, within usage message. Remove defunct
        --preserve-permissions.

2009-07-23  Micah Cowan  <micah@cowan.name>

        * progress.c (get_eta): Change "Translation note" in comment to
        "TRANSLATORS", so it actually appears in wget.pot.

2009-07-06  Micah Cowan  <micah@cowan.name>

        * main.c (print_help): Improve documentation of --base.

2009-07-05  Micah Cowan  <micah@cowan.name>

        * html-url.c (tag_handle_meta): Handle meta name="robots"
        properly: deal with whitespace, commas after...

        * netrc.c (parse_netrc): Rename local-scope variable "quote" to
        "qmark", to avoid conflict with the function name.

2009-07-05  Petr Pisar  <petr.pisar@atlas.cz>

        * main.c (print_version): Mark initial line for translation, along
        with (env), (user), and (system). Change copyright year to 2009.

        * http.c (http_loop): Space after colon.

        * gnutls.c (ssl_check_certificate): Use quote function, rather
        than explicit quotes.

2009-07-05  Micah Cowan  <micah@cowan.name>

        * Makefile.am (version.c): Add dependency on configure.ac.

        * iri.c: Mark some strings for translation.

2009-07-04  Steven Schweda  <sms@antinode.info>

        * wget.h (ORIG_SFX): Macro added, to supply an alternative "_orig"
        suffix on VMS.

        * connect.c, host.c, host.h, main.c: Include "vms_ip.h" rather
        than <netdb.h> on VMS systems.

        * convert.c (write_backup_file): Use "_orig" rather than ".orig"
        on VMS.

        * ftp-basic.c (ftp_list): Don't use LIST -a on VMS servers.

        * ftp.c [__VMS]: Include "vms.h"
        * ftp.c (getftp): Disable some unhelpful "for VMS" code. Pass the
        OS type to ftp_list.
        (getftp) [__VMS]: Alter the filename as required, and invoke fopen
        with extra optional arguments.
        (ftp_retrieve_list): Set permissions before setting the times.

        * ftp-ls.c [__VMS]: Various improvements.

        * http.c (SET_USER_AGENT): Added. Include operating-system info in
        the User-Agent header.
        (gethttp): Use ORIG_SFX macro.
        (gethttp) [__VMS]: invoke fopen with extra arguments to
        communicate file type.
        (http_loop): Add cast to time_t.

        * init.c (wgetrc_user_file_name) [__VMS]: Adjustments for where to
        find the .wgetrc.

        * log.c: Adjustments to improve handling of log files on VMS.

        * main.c [__VMS]: Added --ftp-stmlf option (and associated
        documentation). Adjust description of backup-suffixes, as they now
        differ for VMS.
        (print_help, print_version): Include OS type in version
        information.
        (main) [__VMS]: Invoke fopen with extra options, to specify file
        type information.

        * netrc.c (search_netrc) [__VMS]: Fix .netrc-finding.

        * openssl.c, openssl.h (ssl_connect_wget): Renamed from ssl_connect.

        * options.h (struct options): Add ftp_stmlf field.

        * retr.c (write_data) [__VMS]: Avoid fflush.

        * url.c [__VMS]: Include vms.h.
        * url.c (url_file_name) [__VMS]: Handle naming as required for VMS.

        * utils.c [__VMS]: Include vms.h. Various added facilities for VMS
        needs.

2009-07-04  Micah Cowan  <micah@cowan.name>

        * main.c (print_version): Allow localization of the version-info
        labels, eschew attempts at alignment (which is complicated when
        handling translated strings), and avoid using printf() with
        variable-stored format strings that lack conversion
        specifications.
        (format_and_print_line): For similar reasons, don't calculate
        line-continuation tabulation based on the number of bytes in a
        string.

2009-07-04  Steven Schubiger  <stsc@member.fsf.org>

        * url.c (url_parse): If an URL scheme is invalid, distinguish
        between an unsupported or missing scheme.

        * url.c: Add a "missing scheme" entry to parse_errors.

2009-07-03  Micah Cowan  <micah@cowan.name>

        * iri.h (iri_dup): Provide macro definition for when IRIs are
        disabled.

        * Makefile.am (LIBS): Added @LIBICONV@.
        (wget_SOURCES): Added iri.h.
        (EXTRA_wget_SOURCES): Added iri.c, so it gets packaged even if IRI
        support was disabled.

2009-07-02  Micah Cowan  <micah@cowan.name>

        * recur.c (url_enqueue): Quote enqueue/dequeue debug messages.

        * html-url.c (append_url): Change "merge()" quoting style from
        locale_quoting_style to escape_quoting_style.

2009-07-01  Micah Cowan  <micah@cowan.name>

        * retr.c (retrieve_url): Use the existing "redirect" label,
        instead of superfluous "second_try". Removed no-longer-accurate
        debug statement. Use the "newloc" parameter to store the fallback
        URL, when IRI version was rejected.

        * recur.c (retrieve_tree): Always use the parsed URL for tracking
        the Referer, since that's the one we actually requested (if
        there's a difference in terms of percent-encodings and such).

2009-07-01  Steven Schubiger  <stsc@member.fsf.org>

        * Makefile.am: Add a rule to generate build_info.c and list
        the build_info.c.in file in EXTRA_DIST. Adjust elsewhere
        where needed.

        * build_info.c: Remove this static source file.

        * build_info.c.in: Data for generation of build_info.c.

2009-06-29  Micah Cowan  <micah@cowan.name>

        * html-url.c (append_url): Quote some more arguments that might
        contain characters that are inappropriate to display for the
        current locale.

        * retr.c (retrieve_from_file): Be sure to pass iri information
        when parsing an input-fle url, and be sure to hand a clean iri
        struct, off to retrieve_tree and retrieve_url.

        * iri.c, iri.h (iri_dup): Added.

        * retr.c (retrieve_url): Re-parse for IRI fallback.

        * main.c (main): Set up iri before the url_parse invocation (so we
        can use it).

2009-06-20  Jay Krell  <jay.krell@cornell.edu>

        * sysdep.h (_ALL_SOURCE): (small change) Define the _ALL_SOURCE
        macro on INTERIX systems. (I switched the location from ftp.c to
        sysdep.h --mjc)

2009-06-15  Micah Cowan  <micah@cowan.name>

        * ftp.c (getftp): If we can't accept the connection, return
        CONERROR, not whatever the contents of err happens to be. Fixes
        bug #25015.

        * retr.c (fd_read_body): Make both args to progress_create
        consistent, resulting in an accurate progress display. Fixes bug
        #24948.

2009-06-14  Micah Cowan  <micah@cowan.name>

        * Makefile.am (wget_SOURCES): css-tokens.h needs to ship with
        dist, too.

2009-06-13  Micah Cowan  <micah@cowan.name>

        * init.c: Rename setval_internal_wrapper to setval_internal_tilde,
        ensure we don't "replace" the tilde unless it's actually
        present. Clean up some minor GNU style issues.

2009-06-13  Julien Pichon  <julienpichon7@gmail.com>

        * init.c: Handle tilde-expansion in wgetrc commands, without
        resorting to setting/unsetting globals to change behavior in one
        call location.

2009-06-12  Micah Cowan  <micah@cowan.name>

        * host.c: Include <sys/types.h> before <sys/socket.h>. Not
        required by POSIX any more, but some older systems (such as
        FreeBSD 4.1) still need it, and it doesn't seem like it could
        hurt...

        * build_info.c (library): Handle "https" as a feature in its own
        right, apart from "gnutls" and "openssl".

        * host.c: Declare h_errno if no declaration is provided. Idea
        thanks to Maciej W. Rozycki.

2009-06-11  Xin Zou  <zouxin2008@gmail.com>

        * http.c (gethttp): Fix some memory leaks.

2009-06-11  Micah Cowan  <micah@cowan.name>

        * http.c (http_atotm): Handle potential for setlocale's return
        value to be static storage. Thanks to Benjamin Wolsey
        <bwy@benjaminwolsey.de>.

        * sysdep.h: Need NAMESPACE_TWEAKS on non-Linux glibc-based
        systems, too. Thanks to Robert Millan.

2009-05-28  Steven Schubiger  <stsc@member.fsf.org>

        * ftp.c (ftp_get_listing): Update the "listing file"
        string after calling ftp_loop_internal().

2009-05-27  Steven Schubiger  <stsc@member.fsf.org>

        * ftp.c (ftp_get_listing): Duplicate the "listing file"
        string to avoid memory corruption when FOPEN_EXCL_ERR is
        encountered.

2009-05-17  Steven Schubiger  <stsc@member.fsf.org>

        * progress.c (eta_to_human_short): Fix the remaining hours
        to be displayed. Spotted by Tadeu Martins (#26411).

2009-04-24  Micah Cowan  <micah@cowan.name>

        * hash.c: Change stdint.h inclusion to use HAVE_STDINT_H, not C99
        check.

        * connect.c: stdint.h inclusion added.

        Thanks to Markus Duft <mduft@gentoo.org> for a similar patch.

2009-04-20  Micah Cowan  <micah@cowan.name>

        * Makefile.am (version.c): Fix unportable use of "echo -n".

2009-04-13  Steven Schubiger  <stsc@member.fsf.org>

        * ftp.c (ftp_retrieve_list): Move the duplicated code that
        determines the local file to a function.

        * http.c (http_loop): Likewise.

        * retr.c (set_local_file): New function.

2009-04-11  Steven Schubiger  <stsc@member.fsf.org>

        * init.c (initialize): Run a custom SYSTEM_WGETRC when
        provided as an environment variable.

2009-02-27  Gisle Vanem  <gvanem@broadpark.no>

        * main.c (main): "freopen (NULL,.." causes an assertion in MSVC
        debug-mode.  I.e. NULL isn't legal. But the "CONOUT$" device works
        fine.

2009-02-27  Steven Schubiger  <stsc@member.fsf.org>

        * ftp.c (ftp_loop_internal): Don't claim for FTP retrievals
        when writing to standard output either that the document
        has been saved. Addresses bug #20520 again.

2009-02-21  Steven Schubiger  <stsc@member.fsf.org>

        * http.c (http_loop): When a document is written to
        standard output, don't claim it has been saved to a file.
        Addresses bug #20520.

2009-02-18  Steven Schubiger  <stsc@members.fsf.org>

        * recur.h: Remove the dangling declaration for recursive_cleanup().

2009-02-01  Gerardo E. Gidoni  <gerel@gnu.org>

        * main.c, recur.c, recur.h, res.c, retr.c, retr.h: restructured code to
        avoid multiple 'url_parse' calls.

2008-11-13  Micah Cowan  <micah@cowan.name>

        * http.c (gethttp): Don't do anything when content-length >= our
        requested range.

2008-11-27  Saint Xavier  <wget@sxav.eu>

        * http.c (gethttp): Move authentication code before filename
        allocation avoiding fallbacking on default filename because
        "Content-Disposition" header wasn't present before authentcation
        has been completed. Fixes bug #24862.

2008-11-16  Steven Schubiger  <stsc@members.fsf.org>

        * main.c: Declare and initialize the numurls counter.

        * ftp.c, http.c: Make the counter visible here and use it.

        * options.h: Remove old declaration from options struct.

2008-11-15  Steven Schubiger  <stsc@members.fsf.org>

        * init.c (defaults): Set default waitretry value.

2008-11-14  Steven Schubiger  <stsc@members.fsf.org>

        * main.c (format_and_print_line): Use a custom format
        string for printing leading spaces.

2008-11-12  Micah Cowan  <micah@cowan.name>

        * ftp-ls.c (ftp_index): HTML-escape dir name in title, h1, a:href.

2008-11-12  Alexander Belopolsky  <alexander.belopolsky@gmail.com>

        * url.c, url.h (url_escape_unsafe_and_reserved): Added.

        * ftp-ls.c (ftp_index): URL-escape, rather than HTML-escape, the
        filename appearing in the link.

2008-11-12  Steven Schubiger  <stsc@members.fsf.org>

        * main.c (print_version): Hand the relevant
        xstrdup/xfree calls back to format_and_print_line().

2008-11-11  Steven Schubiger  <stsc@members.fsf.org>

        * main.c (format_and_print_line): Move both the memory
        allocating and freeing bits upwards to print_version().

2008-11-10  Saint Xavier  <wget@sxav.eu>

        * http.c: Make --auth-no-challenge works with user:pass@ in URLs.

2008-11-05  Micah Cowan  <micah@cowan.name>

        * ftp.c (print_length): Should print humanized "size remaining"
        only when it's at least 1k.

2008-10-31  Micah Cowan  <micah@cowan.name>

        * main.c (print_version): Add information about the mailing list.

2008-10-31  Alexander Drozdov  <dzal_mail@mtu-net.ru>

        * retr.c (fd_read_hunk): Make assert deal with maxsize == 0.

        * ftp-ls.c (clean_line): Prevent underflow on empty lines.

2008-10-26  Gisle Vanem  <gvanem@broadpark.no>

        * main.c (format_and_print_line): Put variables on top of
        blocks (not all compilers are C99). Add an extra '\n' if
        SYSTEM_WGETRC isn't defined and printed.

2008-09-09  Gisle Vanem  <gvanem@broadpark.no>

        * url.c (url_error): Use aprintf, not asprintf.

2008-09-09  Micah Cowan  <micah@cowan.name>

        * init.c (home_dir): Save the calculated value for home,
        to avoid duplicated work on repeated calls.
        (wgetrc_file_name) [WINDOWS]: Define and initialize home var.

        * build_info.c, main.c: Remove unnecessary extern vars
        system_wgetrc and locale_dir.

        * main.c: Define program_name for lib/error.c.

2008-09-02  Gisle Vanem  <gvanem@broadpark.no>

        * mswindows.h: Must ensure <stdio.h> is included before
        we redefine ?vsnprintf().

2008-08-08  Steven Schubiger  <stsc@members.fsf.org>

        * main.c, utils.h: Removed some dead conditional DEBUG_MALLOC code.

2008-08-03  Micah Cowan  <micah@cowan.name>

        * main.c (print_help): Added --default-page.

2008-08-01  Joao Ferreira  <joao@joaoff.com>

        * init.c, main.c, options.h, url.c: Added option --default-page
        to support alternative default names for index.html

2008-08-03  Micah Cowan  <micah@cowan.name>

        * build_info.c, css-url.c: #include wget.h, not config.h.

2008-08-03  Steven Schubiger  <stsc@members.fsf.org>

        * url.c, url.h (url_error): Better messages for unsupported
        schemes, especially https.

        * html-url.c, recur.c, retr.c: Adjust to new url_error
        invocation, and free result.

2008-07-17  Steven Schubiger  <stsc@members.fsf.org>

        * retr.c (retrieve_from_file): When given an URL as input file,
        use it as baseref if none was specified and treat the input file
        as HTML if its content type is text/html.

        * init.c (cleanup): Free the memory associated with the base
        option (when DEBUG_MALLOC is defined).

2008-07-02  Xavier Saint  <wget@sxav.eu>

        * iri.c, iri.h  : New function idn_decode() to decode ASCII
        encoded hostname to the locale.

        * host.c : Show hostname to be resolved both in locale and
        ASCII encoded.

2008-06-28  Steven Schubiger  <stsc@members.fsf.org>

        * retr.c (retrieve_from_file): Allow for reading the links from
        an external file (HTTP/FTP).

2008-06-26  Xavier Saint  <wget@sxav.eu>

        * iri.c, iri.h : New functions locale_to_utf8() and
        idn_encode() adding basic capabilities of IRI/IDN.

        * url.c : Convert URLs from locale to UTF-8 allowing a basic
        support of IRI/IDN

2008-06-25  Steven Schubiger  <stsc@members.fsf.org>

        * ftp.c (getftp): When spidering a FTP URL, emit a diagnostic
        message if the remote file exists.

2008-06-24  Steven Schubiger  <stsc@members.fsf.org>

        * http.c (http_loop): Replace escnonprint() occurence with
        a quotearg_style() call.

2008-06-24  Micah Cowan  <micah@cowan.name>

        * ftp-ls.c (ftp_index): Don't assume time_t* is compatible with
        long*. Fixes crash on Windows, and probably other systems.

2008-06-22  Steven Schubiger  <stsc@members.fsf.org>

        * http.c: Explicitly initialize and deallocate the message
        string used by the -nv --spider functionality.

2008-06-22  Steven Schubiger  <schubiger@gmail.com>

        * http.c: Make -nv --spider include the file's name when it
        exists.

2008-06-22  Micah Cowan  <micah@cowan.name>

        * Makefile.am (version.c): Fixed version string invocation so it
        once again can't result in unterminated strings, made all the
        string vars pointers-to-const, and moved line lengths
        below 80 (in Makefile.am, not in version.c).

2008-06-19  Xavier Saint  <wget@sxav.eu>

        * iri.c, iri.h : New function check_encoding_name() as
        a preliminary encoding name check.

        * main.c, iri.c : Make use of check_encoding_name().

2008-06-19  Xavier Saint  <wget@sxav.eu>

        * iri.c : Include missing stringprep.h file and add a
        cast.

        * init.c : set a default initial value for opt.enable_iri,
        opt.locale and opt.encoding_remote.

2008-06-19  Xavier Saint  <wget@sxav.eu>

        * iri.c, iri.h : Add a new function find_locale() to find
        out the local system encoding.

        * main.c : Make use of find_locale().

2008-06-19  Xavier Saint  <wget@sxav.eu>

        * html-url.c : Add "content-type" meta tag parsing for
        retrieving page encoding.

        * iri.h : Make no-op version of parse_charset() return
        NULL.

2008-06-16  Micah Cowan  <micah@cowan.name>

        * http.c (http_loop): When hstat.len is higher than the
        successfully completed content's length, but it's because we
        _set_ it that way, don't abort.

2008-06-14  Xavier Saint  <wget@sxav.eu>

        * iri.c, iri.h : New files.

        * Makefile.am : Add files iri.h and conditional iri.c.

        * build_info.c : Add compiled feature "iri".

        * http.c : include iri.h and parse charset from Content-Type
        header.

        * init.c, main.c, options.h : if an options isn't supported
        at compiled time, don't get rid off it and show a dummy
        message instead if they are used.

2008-06-13  Micah Cowan  <micah@cowan.name>

        * build_info.c: ENABLE_NTLM, not HAVE_NTLM; distinguish OpenSSL
        from "ssl".

2008-06-13  Madhusudan Hosaagrahara <com.gmail.hrmadhu>

        * Makefile.am, main.c, init.c, init.h, build_info.c: Adds build
        information to the --version command line option. Fixes bug
        #20636.

2008-06-01  Micah Cowan  <micah@cowan.name>

        * main.c [WINDOWS]: Reopen stdout in binary mode, when -O - is
        given.

2008-05-31 Micah Cowan  <micah@cowan.name>

        * html-url.c, http.c: Avoid casts in a couple spots.

2008-05-30 Henri Häkkinen  <henux@users.sourceforge.net>

        * cookies.c, ftp-basic.c, hash.c, html-url.c, http-ntlm.c, http.c,
        init.c, log.c, main.c, progress.c, ptimer.c, spider.c, url.c,
        utils.c: Minor changes to silence warnings when using -Wall.

2008-05-26  Steven Schubiger  <schubiger@gmail.com>

        * ftp.c (getftp): Replace last remaining invocation of escnonprint
        with gnulib quote.

2008-05-19  Micah Cowan  <micah@cowan.name>

        * main.c (main): Password prompt should be done only once (not
        once per argument), and should be done prior to the background
        fork.

2008-05-17  Steven Schubiger  <schubiger@gmail.com>

        * init.c (defaults): Set the preferred IP family to `none' by
        default.

2008-05-17  Kenny Parnell  <k.parnell@gmail.com>

        (cmd_spec_prefer_family): Initialize prefer_family to prefer_none.

2008-05-17  Micah Cowan  <micah@cowan.name>

        * main.c (main): Handle Ctrl-D on command-line.

2008-05-15  Steven Schubiger  <schubiger@gmail.com>

        * ftp.c (getftp): Verify that the file actually exists in FTP, by
        checking it against the listing.

2008-05-15  Micah Cowan  <micah@cowan.name>

        * main.c (prompt_for_password): Use the quote module.

2008-05-14  Micah Cowan  <micah@cowan.name>

        * ftp.c (ftp_retrieve_list): Symlinks and other filenames
        should be fully quoted.

2008-05-12  Micah Cowan  <micah@cowan.name>

        * main.c (main): Downgrade "-N with -O" to a warning, and switch
        it off to avoid confusing messages.

2008-04-30  Micah Cowan  <micah@cowan.name>

        * progress.c (create_image): Fix glitch where too many spaces are
        printed on lines that don't display the ETA, in multibyte
        locales.

2008-04-30  Steven Schubiger  <stsc@members.fsf.org>

        * main.c (main): New code that handles prompting for passwords
        when specified explicitly via command-line option (using gnulib's
        getpass-gnu module).
        (main): Include the getpass header.

        * init.c: Add "ask-password" to the list of recognized commands.

        * options.h: Add an according boolean member to the options
        struct.

        * sysdep.h: Comment the defines __EXTENSIONS__ and _GNU_SOURCE
        out, because they're now defined independently by config.h.

2008-04-27  Rabin Vincent  <rabin@rab.in>

        * http.c (http_loop): Fix return for the case where we don't
        download a file because of -nc.

2008-04-27  Micah Cowan  <micah@cowan.name>

        * url.c (path_simplify): Go back to allowing leading ".." in
        paths, but only for FTP URLs.
        (test_path_simplify): Add scheme-specificness to tests, adapt for
        mu_run_test.

        * test.c (all_tests): Add test_path_simplify.

        * main.c (main): Downgrade -r, -p with -O to a warning rather than
        an error; elaborate just a bit more for other -O combination
        cases.

2008-04-26  Micah Cowan  <micah@cowan.name>

        * http.c (gethttp): Move proxy CONNECT handling to below the
        retry_with_auth label, to deal with properly reconnecting to
        proxies when we need to authenticate.

2008-04-25  Micah Cowan  <micah@cowan.name>

        * Makefile.am: -I foo -> -Ifoo.

2008-04-24  Micah Cowan  <micah@cowan.name>

        * main.c: Revised usage description of --convert-links to apply
        to CSS as well as to HTML.

2008-04-23  Micah Cowan  <micah@cowan.name>

        * utils.c (test_dir_matches_p): Added a test for the case
        described in issue #20518.

2008-04-22  Micah Cowan  <micah@cowan.name>

        * Makefile.am, css.lex, css.l: Renamed css.lex to css.l.
        * recur.c (retrieve_tree): Fix typo to allow text/css files to
        be parsed.

2008-04-22  Ted Mielczarek  <ted.mielczarek@gmail.com>

        * css.lex, css-url.c, css-url.h: Added to implement support for
        parsing CSS in Wget.
        * convert.c: Convert links in CSS files, too.
        * convert.h (convert_options): Added for options link_css_p,
        link_expect_css.
        * convert.h: Added prototype for new register_css function.
        * html-parse.c: Added support for parsing element content, in
        addition to tag starts and ends.
        * html-parse.h (taginfo): Added delimiter fields for element
        content.
        * html-url.h: Added.
        * html-url.c (append_url): No longer internal-linkage only. Now
        takes position and size as explicit parameters.
        * html-url.c: Use new html-url.h header, add support for
        handling of "style" HTML attributes. Mark URIs obtained from
        link tags with rel="stylesheet" with link_expect_css. Adapt
        uses of append_url to supply the newly-added parameters for
        position and size.
        * http.c: Add detection for when the content-type is text/css;
        and ensure that such files have the ".css" filename extension,
        when --convert-links is active.
        * recur.h: Remove declarations for functions found in
        html-url.c (moved to html-url.h).
        * recur.c: Add support for culling links from CSS files, too,
        and tracking for when we're expecting the file to be CSS (even
        when its content type isn't text/css).
        * retr.c (retrieve_url): Add registration of CSS files.
        * wget.h: Added TEXTCSS to dt flags enum.
        * Makefile.am: Added css.lex, css-url.c, css-url.h, html-url.h
        to wget_SOURCES.

2008-04-22  Jim Paris  <jim@jtan.com>

        * openssl.c (ssl_init): Enable combined certificate/key in
        single file (apparent regression from ~1.9). Resolves issue
        #22767.

2008-04-22  Steven Schubiger  <schubiger@gmail.com>

        * http.c (print_response_line): Changed to make responses always
        be logged, even in --quiet mode, if --server-response was
        specified. This is to bring http.c's handling of the situation
        in line with ftp.c's.

2008-04-22  Pranab Shenoy  <pranab.loosinit.shenoy@gmail.com>

        * init.c: Added test_commands_sorted unit test to check is
        commands are sorted.  Fixes bug #21245.

        * test.c: Added test_commands_sorted to the test suite.

2008-04-22  Rabin Vincent  <rabin@rab.in>

        * ftp.c (ftp_get_listing): Only remove .listing if it has been
        created.

2008-04-22  Alain Guibert  <alguibert+bts@free.fr>

        * test.h (mu_run_test): Move declaration before statements, for
        C90 conformance. Fixes bug #22789.

2008-04-22  Mike Frysinger  <vapier@gentoo.org>

        * Makefile.am: Move @LIBS@ after other libraries, for better
        static-linking support. Fixes bug #22143.

2008-04-16  Steven Schubiger  <schubiger@gmail.com>

        * ftp.c: Use Gnulib's quote function for printing filenames and
        such.
        * connect.c: Likewise.
        * convert.c: Likewise.
        * cookies.c: Likewise.
        * ftp-opie.c: Likewise.
        * gnutls.c: Likewise.
        * init.c: Likewise.
        * log.c: Likewise.
        * mswindows.c: Likewise.
        * openssl.c: Likewise.
        * progress.c: Likewise.
        * recur.c: Likewise.
        * res.c: Likewise.
        * utils.c: Likewise.

2008-04-16  Steven Schubiger  <schubiger@gmail.com>

        * sysdep.h: Comment the defines __EXTENSIONS__ and _GNU_SOURCE
        out, because they're now defined independently by config.h.

2008-04-14  Steven Schubiger  <schubiger@gmail.com>

        * http.c: Use Gnulib's quote function for printing filenames and
        such.
        * wget.h: #include "quote.h".

2008-04-12  Rabin Vincent  <rabin@rab.in>

        * mswindows.c (fake_fork_child): Don't create a logfile for
        --background when --quiet is used, but not --server-response.
        Fixes bug #20917.

        * utils.c (fork_to_background): Likewise.

2008-04-12  Micah Cowan  <micah@cowan.name>

        * utils.c (aprintf): Minor formatting changes to Alex's code (80-
        column limit, concatenated string literals, avoiding nesting
        levels), and removed invocation of free (since we're aborting
        anyway).

2008-04-11  Alexander Dergachev  <cy6erbr4in@gmail.com>

        * utils.c (aprintf): Now we are setting limits (1 Mb) for text
        buffer when we use non-C99 vsnprintf.

2008-04-11  Micah Cowan  <micah@cowan.name>

        * ftp.c (getftp, ftp_loop_internal): Don't append to an existing
        .listing when --continue is used.  Fixes bug #22825. Thanks to
        Rabin Vincent <rabin@rab.in> for pointing the way with a
        suggested fix!

2008-04-10  Alexander Dergachev  <cy6erbr4in@gmail.com>

        * xmalloc.c, xmalloc.h (memfatal): Now exported; accepts an
        "unknown" value for the attempted allocation size.
        * utils.c (aprintf): Now calls memfatal, instead of aborting.

2008-03-19  Micah Cowan  <micah@cowan.name>

        * utils.c (test_dir_matches_p): More tests related for
        dir_matches_p.

2008-03-17  Micah Cowan  <micah@cowan.name>

        * connect.c: Include sys/time.h to support use of the select
        function on older systems.

2008-02-11  Benno Schulenberg  <bensberg@justemail.net>

        * http.c: More accurate and descriptive messages for when a file
        won't be retrieved during spider-mode.

2008-02-10  Micah Cowan  <micah@cowan.name>

        * http.c: Added existence_checked member to the http_stat
        struct.
        (gethttp): Mark hs->existence_checked when we've checked whether
        a file-to-download exists; so we don't check it again if the
        connection gets lost (and potentially pick a new "unique" name).
        This fixes bug 22251.
        * progress.c (create_image): Add space for an extra column in
        the "eta" portion of the progress bar image; to deal with
        too-long Czech translation.
        * main.c, http.c, init.c: Added --auth-no-challenge option, to
        bring back 1.10.2 unsafe auth behavior when needed. This fixes
        bug #22242.

2008-02-07  Micah Cowan  <micah@cowan.name>

        * progress.c (create_image): Remove assertion on exceeding
        screen width, which given the less-than-robust code there, can
        be broken by a number of factors (such as large file downloads).

2008-02-06  Micah Cowan  <micah@cowan.name>

        * progress.c (countcols): Use strlen() when mbtowc or wcwidth
        not available (or not using NLS).
        * utils.c: Ensure we use single-byte separators when not doing
        NLS progress-bars.
        * wget.h: Determine whether to use NLS for progress-bars, based
        on whether wcwidth and mbtowc are available.

2008-02-03  Micah Cowan  <micah@cowan.name>

        * progress.c (create_image): Use number of characters/columns
        consumed, rather than number of bytes, to determine how much of
        a line we've used. Fixes assertion errors and field alignment
        bugs (#22161, #20481)
        (get_eta, count_cols): Added to support the changes for
        create_image.
        * http.c (http_loop): Put no-clobber logic back into http_loop,
        before starting to fetch, for when we're not doing
        content-disposition.

2008-01-31  Micah Cowan  <micah@cowan.name>

        * http.c (gethttp): Don't derive hs->contlen from possibly
        invalid/missing Content-Length; instead, get the appropriate
        value from the Content-Range header values.
        (parse_content_range): Handle '*' instance-length field.

2008-01-25  Micah Cowan  <micah@cowan.name>

        * main.c: Added notes to translators regarding (C), diacritics
        in names.
        * Makefile.am, cmpt.c, connect.c, connect.h, convert.c,
        cookies.c, cookies.h, ftp-basic.c, ftp-ls.c, ftp-opie.c, ftp.c,
        ftp.h, gen-md5.c, gen-md5.h, gnutls.c, hash.c, hash.h, host.c,
        host.h, html-parse.c, html-parse.h, html-url.c, http-ntlm.c,
        http-ntlm.h, http.c, http.h, init.c, init.h, log.c, log.h,
        main.c, mswindows.c, mswindows.h, netrc.c, netrc.h, openssl.c,
        options.h, progress.c, progress.h, ptimer.c, ptimer.h, recur.c,
        recur.h, res.c, res.h, retr.c, retr.h, spider.c, spider.h,
        ssl.h, sysdep.h, test.c, test.h, url.c, url.h, utils.c,
        utils.h, wget.h, xmalloc.c, xmalloc.h: Updated copyright year.

2007-12-10  Micah Cowan  <micah@cowan.name>

        * main.c: The option is --content-disposition, not
        --no-content-disposition (at the moment).

2007-12-08  Hrvoje Niksic  <hniksic@xemacs.org>

        * ftp.c (ftp_retrieve_glob): Print both arguments of fnmatch in
        fnmatch error message.
        (ftp_retrieve_glob): Don't match with fnmatch if we're only
        supposed to get one file.

2007-12-07  Micah Cowan  <micah@cowan.name>

        * Makefile.am: Plug in vars to include stuff from
        $(top_srcdir)/md5 when appropriate.

2007-12-05  Micah Cowan  <micah@cowan.name>

        * utils.c (subdir_p): Handle the case where d1 is "".
        * convert.c (convert_all_links): Don't return without
        deallocating timer.

2007-11-28  Micah Cowan  <micah@cowan.name>

        * Makefile.am, cmpt.c, connect.c, connect.h, convert.c,
        convert.h, cookies.c, cookies.h, ftp-basic.c, ftp-ls.c,
        ftp-opie.c, ftp.c, ftp.h, gen-md5.c, gen-md5.h, gnutls.c,
        hash.c, hash.h, host.c, host.h, html-parse.c, html-parse.h,
        html-url.c, http-ntlm.c, http-ntlm.h, http.c, http.h, init.c,
        init.h, log.c, log.h, main.c, mswindows.c, mswindows.h,
        netrc.c, netrc.h, openssl.c, options.h, progress.c, progress.h,
        ptimer.c, ptimer.h, recur.c, recur.h, res.c, res.h, retr.c,
        retr.h, safe-ctype.c, safe-ctype.h, spider.c, spider.h, ssl.h,
        sysdep.h, test.c, test.h, url.c, url.h, utils.c, utils.h,
        wget.h, xmalloc.c, xmalloc.h: Updated license exception for
        OpenSSL, per the SFLC.

2007-10-30  Micah Cowan  <micah@cowan.name>

        * main.c (main): Declare argv parameter as char **argv, rather
        than char *const *argv. This fixes usage of getopt_long,
        regardless of whether getopt_long has a constified argv or not.

2007-10-22  Gisle Vanem  <gvanem@broadpark.no>

        * mswindows.c: Move INHIBIT_WRAP macro definition up with wget.h
        inclusion.

2007-10-18  Steven Schweda  <sms@antinode.org>

        * sysdep.h: #include <stdint.h> as well as <inttypes.h>, to work
        around a glitch on Tru64 systems.

2007-10-18  Micah Cowan  <micah@cowan.name>

        * Makefile.am: version.c should not be distributed. Removed
        config-post.h. Add version.c dependency and gnulib include path
        for libunittest.a.
        * sysdep.h: Got contents of config-post.h
        * config-post.h: Removed.
        * wget.h: #include "config.h".
        * alloca.c, cmpt.c, connect.c, convert.c, cookies.c,
        ftp-basic.c, ftp-ls.c, ftp-opie.c, ftp.c, gen-md5.c, gnutls.c,
        hash.c, host.c, html-parse.c, html-url.c, http-ntlm.c, http.c,
        init.c, log.c, main.c, mswindows.c, netrc.c, openssl.c,
        progress.c, ptimer.c, recur.c, res.c, retr.c, spider.c, url.c,
        utils.c, xmalloc.c: Use wget.h at very top, and instead of
        config.h.

2007-10-15  Micah Cowan  <micah@cowan.name>

        * Makefile.am: Remove intermediary hg-id file generation, make
        version.c-generation more portable.

2007-10-14  Micah Cowan  <micah@cowan.name>

        * cmpt.c, cookies.c, ftp-basic.c, ftp-ls.c, ftp.c, hash.c,
        host.c, html-parse.c, html-url.c, http-ntlm.c, http.c, init.c,
        log.c, main.c, netrc.c, openssl.c, res.c, url.c, utils.c,
        wget.h: Replace uses of ISSPACE, etc with c_isspace, etc.
        * gnu-md5.c, gnu-md5.h: Removed, in deference to gnulib.
        * Makefile.am: Removed gnu-md5.h from wget_SOURCES.
        * gen-md5.c: Changed #inclusion of gnu-md5.h to md5.h (gnulib's).
        * recur.c (download_child_p): Print error if unlink of
        robots.txt fails.
        * main.c (main): --spider or --delete-after now implies
        --no-directories (thanks, Josh Williams).

2007-10-14  Joshua David Williams  <yurimxpxman@gmail.com>

        * recur.c (download_child_p): Remove robots.txt if
        --delete-after or --spider is on.

2007-10-13  Micah Cowan  <micah@cowan.name>

        * Makefile.am: Make version.c depend on Wget dependencies (source
        files, plus such things as LIBOBJS so we get things like
        http-ntlm.c). Removed getopt.[ch], as we're now using gnulib for
        these.

2007-10-10  Micah Cowan  <micah@cowan.name>

        * http-ntlm.c: Include openssl/opensslv.h explicitly, instead of
        hoping it'll be included by accident in openssl/des.h.

2007-10-09  Gisle Vanem  <gvanem@broadpark.no>

        * mswindows.c: 'argc' and 'argv' in 'windows_main()' are no longer
        needed.  Hence simply the prototype. Free 'exec_name' at exit.

2007-10-09  Micah Cowan  <micah@cowan.name>

        * gettext.h: Imported from /usr/share/gettext, fuller handling
        of --disable-nls.
        * wget.h: Remove logic for handling lack of NLS (now in
        gettext.h).
        * main.c: Use gettext's ENABLE_NLS rather than HAVE_NLS.
        * Makefile.am: added @LIBINTL@ to LIBS (though it probably
        belongs in LDADD, along with everything else currently assigned
        to LIBS).

2007-10-08  Micah Cowan  <micah@cowan.name>

        * http.c (http_loop): Add send_head_first conditional back
        around code that needs it, but not around the last-modified
        header-parsing stuff this time. Removed no-longer-useful (was it
        ever?) restart_loop boolean, continuing unconditionally at end
        of send_head_first conditional block (if we haven't jumped out).

2007-10-04  Micah Cowan  <micah@cowan.name>

        * http.c (http_loop): We've got_name if content_disposition
        support isn't on; make sure we continue properly in that case,
        even though we're not sending HEAD.
        * Makefile.in: Removed, replaced by Makefile.am.
        * Makefile.am: Converted from Makefile.in.

2007-10-02  Gisle Vanem  <gvanem@broadpark.no>

        * ftp.c: Use "_listing" for MSDOS (".listing" is illegal).

        * url.c: Update comment for 'filechr_not_windows'.

        * utils.c: Include <process.h> for 'getpid()' on Watcom.

2007-10-02  Micah Cowan  <micah@cowan.name>

        * ftp.c (getftp, ftp_loop_internal), http.c (http_loop), main
        (main): Use datetime_str instead of time_str, for those who have
        potentially long-running sessions. Based on suggestions by Saso
        Tomat <miskox@hotmail.com> and Steven M. Schweda
        <sms@antinode.org>.
        * http.c (gethttp): Warn about host lookup failures. Adjusted
        from Stephen Gildea's patch.

2007-10-02  Stephen Gildea  <stepheng+wget@gildea.com>

        * connect.c (connect_to_host): Warn about host lookup failures.

2007-09-25  Micah Cowan  <micah@cowan.name>

        * Makefile.in: Use EXEEXT instead of exeext.

2007-09-24  Gisle Vanem  <giva@bgnett.no>

        * connect.c, init.c, main.c, openssl.c, options.h, sysdep.h,
        url.c, utils.c: Added support for building on MS-DOS.

2007-09-24  Jochen Roderburg  <roderburg@uni-koeln.de>

        * http.c (http_zero): Remove no-longer-used local_size variable.
        Fixes bug #21057.

2007-09-12  Micah Cowan  <micah@cowan.name>

        * http.c (http_loop): Remove send_head_first from condition for
        parsing timestamp.

2007-08-29  Micah Cowan  <micah@cowan.name>

        * openssl.c (ssl_init): Re un-const-ified the meth local
        variable, to match current versions of openssl.
        * spider.c: Removed visited_url function, as it may be very
        inefficient.
        (print_broken_links): Removed traversal of referrers, until such
        time as a more efficient implementation can be written.
        * spider.h: Replaced declaration of visited_url with an
        empty-bodied, function-like macro.

2007-08-27  Gisle Vanem  <giva@bgnett.no>

        * mswindows.c (run_with_timeout): Ensure that the correct
        conversion specification is used for the return result of
        the GetLastError function.
        * getopt.c: Fix missing (but, accidentally, legal) comment
        delimiter after licensing text.
        * recur.c (retrieve_tree): Inserted missing cast for strip_auth.
        Includes adjustment by Ralf Wildenhues.
        * openssl.c (ssl_init): const-ified the meth local variable.
        * main.c: Include all the static function definitions in the
        "#ifndef TESTING" clause, leaving just the definitions for
        exec_name (not set), and opt.
        * utils.c (run_with_timeout): Now returns bool, to align with
        declaration in utils.h.

2007-08-27  Micah Cowan  <micah@cowan.name>

        * wget.h: Added macro replacement for ngettext, for environs
        that lack NLS.

2007-08-26  Micah Cowan  <micah@cowan.name>

        * spider.c (print_broken_links): Fixed incorrect plurals msgid
        usage, switched to use ngettext function.

2007-08-24  Micah Cowan  <micah@cowan.name>

        * http.c (http_loop): Introduced time_came_from_head boolean
        flag, to help avoid parsing the same Last-Modified header twice.
        Replaced spidering returns of RETRUNNEEDED for some situations,
        to RETROK, as otherwise it will be interpreted as an error.
        RETRUNNEEDED appears never to be referenced outside of
        http.c (and wget.h), and, when returned by gethttp, is
        translated by http_loop to RETROK.
        * url.c (are_urls_equal): Don't call getchar_from_escaped_string
        if u2 is shorter than u1.
        (getchar_from_escaped_string): Don't decode reserved characters.
        Handle illegally appearing '%'s as literal '%'s. Ensure hex
        digits before attempting to decode.
        (test_are_urls_equal): Added tests to handle u2 shorter than u1,
        and %2f not treated the same as /.
        * spider.c (in_url_list_p): Don't call are_urls_equal if one of
        them is NULL.

2007-08-23  Joshua David Williams  <yurimxpxman@gmail.com>

        * spider.c (in_url_list_p): Removed the bool verbose argument

2007-08-22  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * http.c (http_loop): Fall back to GET if HEAD fails with a 500 or 501
        error code.

2007-08-21  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * http.c (http_loop): Send preliminary HEAD request if -N is given and
        the destination file exists already.

2007-08-10  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * http.c (http_loop): Fixed HTTP HEAD requests logic when --spider is
        given.

2007-08-10  Ralf Wildenhues  <Ralf.Wildenhues@gmx.de>

        * url.c (append_uri_pathel): Do not assume dest string to be
        zero-terminated.
        (test_append_uri_pathel): Terminate string to fix test failure.

2007-08-09  Ralf Wildenhues  <Ralf.Wildenhues@gmx.de>

        * url.c (url_string): Use comparison, not assignment, in
        check for auth_mode == URL_AUTH_HIDE_PASSWD.

2007-08-09  Micah Cowan  <micah@cowan.name>

        * http.c (http_loop): If we got a HEAD and then a GET, and the
        GET had a timestamp, use that one, not any we may have gotten
        from the HEAD.

2007-08-08  Micah Cowan  <micah@cowan.name>

        * init.c (defaults): Content disposition will not be default,
        since it currently results in extra round-trips.

2007-07-31  Micah Cowan  <micah@cowan.name>

        * http.c (gethttp): Set contlen = -1 when we encounter a
        negative-valued Content-Length header, so we don't consider it
        an internal error later on and call abort().

2007-07-29  Micah Cowan  <micah@cowan.name>

        * url.h, url.c (url_string): Replaced bool arg of the url_string
        function with enum url_auth_mode, with added option to
        completely remove user/pass auth information.
        * http.c, ftp.c, url.c, recur.c: Adapted call to url_string
        function to fit new usage.
        * recur.c (retrieve_tree): Remove auth info from Referer header.

2007-07-28  Micah Cowan  <micah@cowan.name>

        * options.h, init.c, retr.c, main.c: renamed opt maxredirect
        field to max_redirect, for improved consistency.
        * init.c: changed max_redirect parser from cmd_number_inf to
        cmd_number, as infinite redirects may not be appropriate.
        Alternatively, if cmd_number_inf should be used, then
        opt.max_redirect's value should be checked a bit differently in
        retr.c, to allow for the "infinite" meaning of zero.

2007-07-25  Micah Cowan  <micah@cowan.name>

        * http.c (create_authorization_line)
        (basic_authentication_encode, known_authentication_scheme_p)
        (load_cookies): Moved declarations up.
        (basic_authed_hosts): Added. Tracks what hosts have issued Basic
        challenge and been given the global username, password.
        (maybe_send_basic_creds): Added. Sends Basic creds for hosts that
        have issued Basic challenges.
        (register_basic_auth_host): Added. Instantiates
        basic_authed_hosts if necessary, then registers the host that
        has issued a challenge.
        (gethttp) <auth>: Only send authentication credentials after
        we've received a challenge from that host. This is a stop-gap
        fix until a proper fix can be implemented; still isn't quite
        right, as we should only be sending credentials automatically
        for authenticated paths and below, and not for the entire host.

2007-07-16  Joshua David Williams  <yurimxpxman@gmail.com>

        * options.h: added maxredirect to options struct
        * init.c: added maxredirect to list of variables
        * retr.c (retrieve_url): replaced MAX_REDIRECTIONS with opt.maxredirect
        * main.c: added option --max-redirect

2007-07-16  Joshua David Williams  <yurimxpxman@gmail.com>

        * test.h: tests made more verbose; now displays the name
        of each test run.

2007-07-10  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * http.c (http_loop): Fixed the HTTP requests logic. Now it skips the
        preliminary HEAD request if either -O or --no-content-disposition are
        given, and neither --spider and -N are given.

2007-07-05  Micah Cowan  <micah@cowan.name>

        * cmpt.c, connect.c, connect.h, convert.c, convert.h:
        * cookies.c, cookies.h, ftp-basic.c, ftp.c, ftp.h, ftp-ls.c:
        * ftp-opie.c, gen-md5.c, gen-md5.h, getopt.c, getopt.h, gnu-md5.c:
        * gnu-md5.h, gnutls.c, hash.c, hash.h, host.c, host.h:
        * html-parse.c, html-parse.h, html-url.c, http.c, http.h:
        * http-ntlm.c, http-ntlm.h, init.c, init.h, log.c, log.h, main.c:
        * Makefile.in, mswindows.c, mswindows.h, netrc.c, netrc.h:
        * openssl.c, options.h, progress.c, progress.h, ptimer.c:
        * ptimer.h, recur.c, recur.h, res.c, res.h, retr.c, retr.h:
        * safe-ctype.c, safe-ctype.h, spider.c, spider.h, ssl.h, sysdep.h:
        * test.c, test.h, url.c, url.h, utils.c, utils.h, wget.h:
        * xmalloc.c, xmalloc.h:
        Updated GPL reference to version 3 or later, removed FSF
        address.

2007-07-04  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * http.c (http_loop): Skip HEAD request and start immediately with GET
        if -O is given.

2007-02-02  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (print_server_response): Escape non-printable characters
        in server respone.

2007-02-02  Hrvoje Niksic  <hniksic@xemacs.org>

        * netrc.c: Don't make netrc_list static, as it prevents
        compilation with DEBUG_MALLOC.

        * utils.c (aprintf): Don't use vasprintf when DEBUG_MALLOC is
        requested because, in that case, we want the calls to malloc to be
        coming from us.

2007-01-23  Hrvoje Niksic  <hniksic@xemacs.org>

        * cookies.c (parse_set_cookie): Would erroneously discard cookies
        with unparsable expiry time.

2007-01-23  Hrvoje Niksic  <hniksic@xemacs.org>

        * progress.c (create_image): Check for ETA overflow.
        (print_row_stats): Ditto.

2007-01-09  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * init.c (cmd_spec_prefer_family): Small fix to get rid of a gcc
        warning about strict-aliasing violation.

2007-01-09  Steven M. Schweda  <sms@antinode.org>

        * ftp-basic.c (ftp_syst): Fixed segfault if response text is missing.

2006-12-29  Gisle Vanem  <giva@bgnett.no>

        * mswindows.c: Avoid a warning if 'ws_hangup()' is unused.

2006-12-27  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * http.c (parse_content_disposition): Consider directory prefix, if
        specified.

2006-11-21  Hrvoje Niksic  <hniksic@xemacs.org>

        * retr.c (retrieve_from_file): Ditto.
        (url_uses_proxy): New function.

        * main.c (main): Don't check for opt.use_proxy when deciding
        whether to call retrieve_url or retrieve_tree; check whether the
        proxy would be used for *this* URL.

2006-10-17  Mike Grant  <mggr@pml.ac.uk>

        * ftp.c (ftp_loop_internal): Would incorrectly skip changing
        working directory when retrying after a failed FTP attempt.
        Originally reported by Nate Eldredge.

2006-10-12  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * convert.c (downloaded_file): Fixed bug which used to break -E -k -K
        mode.

2006-08-28  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * http.c: #include'd spider.h to get rid of compiler warnings.

        * main.c: Ditto.

        * recur.c: Ditto.

2006-08-24  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * Makefile.in: Added spider.c to the list of files to compile and
        spider.h to the list of header files. Updated copyright information.

        * http.c: Major changes to recursive spider mode. Now for every
        resource we are supposed to check, we send a HEAD request to find out
        if it exists. If the resource is a HTML file, we retrieve it and parse
        it to discover links to other resources.

        * recur.c: Ditto.

        * res.c (res_retrieve_file): Disable opt.timestamping and opt.spider
        when retrieving robots.txt. Updated copyright information.

        * convert.c: Moved code tracking broken links to spider.c.

        * convert.h: Ditto.

        * spider.c: Created new file to keep track of visited URLs in spider
        mode.

        * spider.h: Ditto.

2006-08-21  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * http.c: Fixed timestamping-related bug.

2006-08-16  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * http.c: Fixed bug which broke --continue feature. Now if -c is
        given, http_loop sends a HEAD request to find out the destination
        filename before resuming download.

2006-08-08  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (datetime_str): Avoid code repetition with time_str.

2006-07-21  Hrvoje Niksic  <hniksic@xemacs.org>

        * init.c (commands): Correctly place "contentdisposition".

2006-07-14  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * sysdep.h: If intptr_t isn't defined, simply typedef it to long.

        * http.c: Added explicit cast to int in logprintf call to remove
        compiler warnings on 64-bit platforms.

        * connect.c: Added a few casts to intptr_t to remove compiler warnings
        on 64-bit platforms.

        * main.c: Disable -r, -p and -N when -O is used. Disable -k when -O is
        used and multiple URLs are given. Update maintainer information.

        * all: Update copyright information.

2006-07-10  KJKHyperion  <hackbunny@reactos.com>

        * url.c (filechr_table): Mark DEL (0x7f) as a control character
        and | as a character Windows can't handle.

2006-06-28  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * res.c: Implemented is_robots_txt_url function for detection of
        robots.txt URLs and related test routine.

        * res.h: Ditto.

        * url.c: Implemented are_urls_equal function for URL comparison and
        related testing routine.

        * url.h: Ditto.

        * convert.c: Fixes for recursive spider mode: don't consider
        non-existing robots.txt as a broken link, and use are_urls_equal
        instead of strcasecmp for referrer URLs comparison.

        * test.c: Call tests routines for are_urls_equal and
        is_robots_txt_url.

2006-06-26  Hrvoje Niksic  <hniksic@xemacs.org>

        * wget.h (wgint): Typedef to any 64-bit (or larger) type we can
        find, not necessarily off_t or long.

2006-06-26  Hrvoje Niksic  <hniksic@xemacs.org>

        * cmpt.c (strtoll): Check for overflow and underflow without
        relying on (technically) undefined behavior.  Don't assume that
        strtoll_type is 64 bits wide.

2006-06-21  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (base64_encode): Cast void pointer to char * before
        doing arithmetic.

2006-06-20  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (base64_encode): Made TBL const.
        (base64_decode): Made the base64_char_to_value table const.

2006-06-19  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (base64_encode): Made the DATA pointer void * so the
        callers can pass it any kind of pointer (including both signed and
        unsigned char pointers).
        (base64_decode): Ditto for DEST.

2006-06-19  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (base64_encode): Would read past end of STR.
        Reported by rick@eckle.org.

2006-06-13  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * options.h (struct options): Introduced member restrict_files_case to
        keep track of preferences on character case restrictions for
        filenames.

        * init.c: Modified defaults and cmd_spec_restrict_file_names to
        support character case restrictions for filenames. Added
        test_cmd_spec_restrict_file_names unit test.

        * url.c: Modified append_uri_pathel to support character case
        restrictions for filenames. Added test_append_uri_pathel unit test.

        * test.c: Added test_cmd_spec_restrict_file_names and
        test_append_uri_pathel to the list of unit tests to run.

2006-06-12  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * retr.c (retrieve_from_file): Use retrieve_tree and automatically
        turn on opt.follow_ftp in case of recursive FTP retrieval through HTTP
        proxy.

        * main.c: Automatically turn on opt.follow_ftp in case of recursive
        FTP retrieval through HTTP proxy.

2006-06-12  Tony Lewis  <tlewis@exelana.com>

        * main.c: Improved CHEN Peng's patch by proposing a simpler logic.

2006-06-12  CHEN Peng  <chenpeng@alumni.nus.edu.sg>

        * main.c: Use retrieve_tree in case of recursive FTP retrieval through
        HTTP proxy.

2006-05-25  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * convert.c: Added mechanisms to keep track broken links.

        * convert.h: Ditto.

        * wget.h: Reordered and enumerated uerr_t constants.

        * recur.c: Fixes to support recursive spider mode.

        * http.c: Ditto.

        * main.c: Print broken links in case of recursive spider mode.

        * retr.c: Changed interface of retrieve_url.

        * retr.h: Ditto.

        * ftp.c: Changed interface of ftp_loop.

        * ftp.h: Ditto.

        * res.c: Minor change to reflect changes in interface of retrieve_url.

2006-05-18  Lawrence Jones  <lawrence.jones@ugs.com>

        * ftp-ls.c (ftp_parse_unix_ls): Correct size parsing, add size
        and filename debugging output.

2006-04-28  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * http.c: If Content-Disposition header is present, allow unique
        filename generation unless -nc is given. Permit to disable parsing of
        Content-Disposition header.

        * options.h: Added option --no-content-disposition to disable parsing
        of HTTP Content-Disposition header.

        * init.c: Ditto.

        * main.c: Ditto.

2006-04-11  Hrvoje Niksic  <hniksic@xemacs.org>

        * hash.c (TOLOWER): Wrap macro arg in parentheses.

2006-04-08  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (parse_content_disposition): Doc fix.

2006-03-15  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * utils.c: Restricted operational semantics of frontcmp and proclist
        from generic strings to directory names and them to subdir_p and
        dir_matches_p respectively.  Applied George Ogata's one line patch to
        restrict algorithm of subdir_p to full directory name matching.  Added
        testcases for subdir_p and dir_matches_p.

        * utils.h: Changed all frontcmp occurrences to subdir_p.

        * recur.c: Ditto.

        * test.c: Changed type returned by test functions from char * to const
        char *.  Added test_subdir_p and test_dir_matches_p to the list of
        tests to run.

        * http.c (test_parse_content_disposition): Changed return type from
        char * to const char *.

2006-03-14  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * recur.c (struct queue_element): Changed type of html_allowed member
        to bool.

2006-03-09  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * ftp.c (ftp_list): Try `LIST -a' command first and revert to `LIST'
        in case of failure.

2006-03-06  Hrvoje Niksic  <hniksic@xemacs.org>

        * hash.c (TOLOWER): Fix definition when STANDALONE.
        Reported by Beni Serfaty.

2006-03-02  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * http.c (http_loop): Fixed recursive HTTP retrieval.

2006-02-28  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (extract_param): Declare extern so it can be used from
        other files.
        (extract_param): Return error for empty name.

2006-02-28  Hrvoje Niksic  <hniksic@xemacs.org>

        * url.c (find_last_char): Define in terms of memrchr.

        * cmpt.c (memrchr): Define it on systems that don't have it.

        * http.c (extract_param): New function for parsing header values
        with parameters.
        (parse_content_disposition): Use it.  Don't allow slashes and
        backslashes in the file name.

2006-02-27  Hrvoje Niksic  <hniksic@xemacs.org>

        * url.c (path_simplify): Don't preserve ".." at beginning of path.
        Suggested by Frank McCown.

2006-02-25  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (gethttp): Only use FILE.N.html if FILE.html exists.

2006-02-09  Hrvoje Niksic  <hniksic@xemacs.org>

        * mswindows.c (run_with_timeout): Made thread_hnd non-static.

2006-02-05  Hrvoje Niksic  <hniksic@xemacs.org>

        * retr.c (sleep_between_retrievals): Sleep at a minimum of 1/2 of
        the specified wait period.

2006-02-03  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (number_to_string): Don't use sprintf for printing
        WGINT_MIN; simply divide n by 10 and defer printing the last
        digit.
        (number_to_string): Removed the SPRINTF_WGINT macro.

2006-02-03  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * http.c: Fixed support for Content-Disposition header.

        * test.c: Added test_parse_content_disposition to the list of unit
        tests to run.

2006-02-02  Hrvoje Niksic  <hniksic@xemacs.org>

        * hash.c: Don't define countof if it's already defined.

        * hash.c: Obtain the definition of uintptr_t when standalone.

2006-01-30  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * http.c: Changed output format. Removed excessively verbose debugging
        output.

2005-12-07  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * http.c: Fixed pre-download verbose output which was broken by
        HTTP code refactoring.

2005-11-23  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * http.c: Refactored HTTP code.  If -O is not used, the new code
        delays the choice of the file name where the downloaded resource
        will be saved until the HTTP headers have been retrieved.
        Added support for Content-Disposition header.

2005-11-19  Hrvoje Niksic  <hniksic@xemacs.org>

        * hash.c (INVALID_PTR): Use uintptr_t instead of unsigned long.
        (hash_pointer): Don't assume a pointer fits in `unsigned long'.

2005-11-02  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * Makefile.in: Removed support for unit testing (now it is in
        tests/Makefile.in).

2005-10-27  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * Makefile.in: Added basic support for unit testing.

        * test.c: Ditto.

        * test.h: Ditto.

2005-10-13  Daniel Stenberg  <daniel@haxx.se>

        * http-ntlm.c (ntlm_output): Fixed buffer overflow vulnerability.

2005-10-09  Russ Allbery  <rra@stanford.edu>

        * snprintf.c: Remove round to round_int and pow10 to pow10_int, to
        avoid warnings from GCC 4.0.

2005-10-05  Mauro Tortonesi  <mauro@ferrara.linux.it>

        * retr.c: Changed semantics of no_proxy_match.

2005-09-17  Hrvoje Niksic  <hniksic@xemacs.org>

        * main.c (main): Don't print the summary if nothing has been downloaded.

2005-09-17  Hrvoje Niksic  <hniksic@xemacs.org>

        * retr.c (retr_rate): Rename parameter from MSECS to SECS since it
        no longer holds milliseconds.

2005-09-01  Hrvoje Niksic  <hniksic@xemacs.org>

        * progress.c: Introduce symbolic constants for "magic" values of
        0.2 and 0.9, REFRESH_INTERVAL and ETA_REFRESH_INTERVAL.

2005-08-27  Hrvoje Niksic  <hniksic@xemacs.org>

        * cmpt.c (strtoll): Correctly handle strtoll("0x", ptr, 0) and
        strtoll("0x<nonhexchar>", ptr, 0) -- in both cases *ptr must be
        set to the position of 'x', not after it.

2005-08-27  Hrvoje Niksic  <hniksic@xemacs.org>

        * hash.c (hash_table_map): Rename to hash_table_for_each and
        update callers.
        Document the meaning of the callback's return value.
        (hash_table_iterate): New function.
        (hash_table_iter_next): Likewise.
        Update most places that used hash_table_for_each to use the
        iteration, which doesn't require a temporary function with
        explicit state management.

2005-08-26  Albert Chin  <wget@mlists.thewrittenword.com>

        * Makefile.in: Use @datadir@.  Define localedir as $(datadir)/locale.

2005-08-26  Jeremy Shapiro  <jnshapiro@gmail.com>

        * openssl.c (ssl_init): Set SSL_MODE_AUTO_RETRY.

2005-08-23  Hrvoje Niksic  <hniksic@xemacs.org>

        * host.c (address_list_from_ipv4_addresses): Use IP_INADDR_DATA.

2005-08-12  Hrvoje Niksic  <hniksic@xemacs.org>

        * wget.h: Renamed strtoll_return to strtoll_type.

2005-08-11  Hrvoje Niksic  <hniksic@xemacs.org>

        * progress.c (eta_to_human_short): Switch to days when printing
        more than 48h rather than 100h.  (It's not immediately apparent
        how many days there are in 83h.)

2005-08-11  Hrvoje Niksic  <hniksic@xemacs.org>

        * cmpt.c (strtoll): Define it if missing on the system and if Wget
        needs it.

        * mswindows.c (str_to_int64): Move to cmpt.c and rename to strtoll.

2005-08-10  Hrvoje Niksic  <hniksic@xemacs.org>

        * host.c (print_address): Always use inet_ntop when IPv6 is
        enabled.

        * host.h (ip_address): Simplify the data union.

2005-08-09  Hrvoje Niksic  <hniksic@xemacs.org>

        * mswindows.c (inet_ntop): Also handle IPv4 addresses for
        completeness.

2005-08-09  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (gethttp): Don't read more than the amount of data
        specified by the content-length header.

2005-08-09  Vasil Dimov  <vd@datamax.bg>

        * ftp.c (getftp): Don't free RESPLINE if ftp_response returns a
        status other than FTPOK.

2005-08-04  Giuseppe Bonacci  <g.bonacci@libero.it>

        * ftp-ls.c (ftp_parse_unix_ls): Remember the position of the
        previous token instead of backtracking back to it.

2005-07-08  Gisle Vanem  <giva@bgnett.no>

        * mswindows.h: Include process.h to get getpid() declaration.

2005-07-08  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (aprintf): Use vasprintf where available.

2005-07-08  Hrvoje Niksic  <hniksic@xemacs.org>

        * url.c (rewrite_shorthand_url): Simplify code using aprintf and
        strspn.

2005-07-07  Hrvoje Niksic  <hniksic@xemacs.org>

        * gnutls.c (ssl_check_certificate): Check for the validity of the
        presented X509 certificate.

2005-07-07  Hrvoje Niksic  <hniksic@xemacs.org>

        * openssl.c (ssl_check_certificate): Print custom error messages
        for frequent X509 certificate problems.

2005-07-07  Hrvoje Niksic  <hniksic@xemacs.org>

        * mswindows.h: Define an alias for stat and fstat, as requested by
        config-compiler.h.
        (gai_strerror): Define to windows_strerror if NEED_GAI_STRERROR is
        defined.

2005-07-06  Hrvoje Niksic  <hniksic@xemacs.org>

        * mswindows.h: Use strtoll where available.

2005-07-06  Hrvoje Niksic  <hniksic@xemacs.org>

        * sysdep.h: Add a full declaration of fnmatch.h.

2005-07-06  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c: Unconditionally include <setjmp.h>.

2005-07-06  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (fnmatch_nocase): New function.
        (proclist): Use it instead of fnmatch when opt.ignore_case is
        requested.
        (in_acclist): Respect opt.ignore_case.
        (frontcmp): Respect opt.ignore_case.

        * options.h (struct options): New flag opt.ignore_case.

2005-07-06  Hrvoje Niksic  <hniksic@xemacs.org>

        * ptimer.c: Measure time in seconds rather than milliseconds.
        Adjusted all callers.

2005-07-06  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (gethttp): When freeing MESSAGE, take into account that
        it can be NULL.

2005-07-05  Hrvoje Niksic  <hniksic@xemacs.org>

        * cmpt.c (timegm): Handle years after 2099.

2005-07-05  Hrvoje Niksic  <hniksic@xemacs.org>

        * cmpt.c (timegm): Remove unused variable.

2005-07-05  Hrvoje Niksic  <hniksic@xemacs.org>

        * cmpt.c (timegm): Don't call mktime; simply count the seconds
        between 1970-01-01 and the specified date.

2005-07-05  Hrvoje Niksic  <hniksic@xemacs.org>

        * wget.h (or): Define HAVE_SSL when either HAVE_OPENSSL or
        HAVE_GNUTLS are defined.

        * gnutls.c: New file.

2005-07-05  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (gethttp): Don't print the request write error message
        twice.

2005-07-04  Hrvoje Niksic  <hniksic@xemacs.org>

        * openssl.c (openssl_errstr): Instead of always using a large
        static buffer, only allocate the error string when there is an
        actual error.

2005-07-04  Hrvoje Niksic  <hniksic@xemacs.org>

        * xmalloc.c (debugging_free): Prefix hex pointer value with "0x"
        when printing.

2005-07-04  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (NEXT_BASE64_CHAR): Rename to NEXT_CHAR and simplify to
        get the next non-whitespace character.

2005-07-04  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (base64_decode): Don't silently tolerate non-base64
        non-white-space characters in the base64 stream.

2005-07-04  Hrvoje Niksic  <hniksic@xemacs.org>

        * connect.c (LAZY_RETRIEVE_INFO): Make last_tick unsigned to match
        transport_map_modified_tick.

2005-07-04  Hrvoje Niksic  <hniksic@xemacs.org>

        * config-post.h (alloca): Updated declaration to not enumerate all
        Windows compilers.

2005-07-04  Hrvoje Niksic  <hniksic@xemacs.org>

        * openssl.c (openssl_errstr): Separate error messages with "; ".

2005-07-03  Hrvoje Niksic  <hniksic@xemacs.org>

        * ftp.c (getftp): Ditto.

        * http.c (gethttp): Use fd_errstr.

        * connect.c (fd_register_transport): Restructure parameters to
        include only a single structure that describes transport
        implementation.

        * openssl.c (openssl_errstr): New function: dump SSL error strings
        into a static buffer and return a pointer to the buffer.

        * connect.c (fd_errstr): New function; returns transport-specific
        error message, or strerror(errno) if transport doesn't supply one.

2005-07-03  Hrvoje Niksic  <hniksic@xemacs.org>

        * mswindows.h: Also wrap accept() and listen().

2005-07-03  Hrvoje Niksic  <hniksic@xemacs.org>

        * url.c (path_end): Skip separators appropriate for the scheme.
        (strpbrk_or_eos): Remove gcc-specific version, as the optimization
        it tried to perform no longer applies.

2005-07-02  Hrvoje Niksic  <hniksic@xemacs.org>

        * host.c: Don't include "connect.h" now that we no longer have
        socket_has_inet6.

2005-07-02  Hrvoje Niksic  <hniksic@xemacs.org>

        * host.c: Remove extraneous definition of netdb.h.

2005-07-02  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (gethttp): Skip error message body in the keep-alive
        case.

2005-07-02  Hrvoje Niksic  <hniksic@xemacs.org>

        * url.c (url_parse): Would crash when parsing fragments.  Support
        fragments for FTP URLs too.

2005-07-02  Hrvoje Niksic  <hniksic@xemacs.org>

        * version.c: Don't use "cvs" in version name, since we're not
        using CVS anymore.

2005-07-02  Hrvoje Niksic  <hniksic@xemacs.org>

        * progress.c (create_image): Ditto.

        * retr.c (retr_rate): Display smaller rate numbers with greater
        precision.

2005-07-02  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (response_head_terminator): Minor optimization.

        * retr.c (fd_read_hunk): Call terminator with pointer to the start
        of the data and the pointer to the current data.  Changed all
        callers.

2005-07-01  Hrvoje Niksic  <hniksic@xemacs.org>

        * url.c (url_parse): Make sure u->params is not initialized for
        http/https URLs.
        (url_parse): Don't crash on garbage following []-delimited IPv6
        addresses.

2005-07-01  Hrvoje Niksic  <hniksic@xemacs.org>

        * main.c (print_help): Don't refer to the non-existent -nr in
        description of --mirror.

2005-06-30  Hrvoje Niksic  <hniksic@xemacs.org>

        * host.c (pretty_print_address): Renamed to just print_address.
        Clarify documentation.

2005-06-30  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (gethttp): Explicitly document the different cases when
        generating the Host header.

2005-06-30  Hrvoje Niksic  <hniksic@xemacs.org>

        * host.c (pretty_print_address): Handle error result from
        inet_ntop.

2005-06-30  Gisle Vanem  <giva@bgnett.no>

        * mswindows.c (inet_ntop): New function.  Print IPv6 addresses
        using WSAAddressToString.

2005-06-27  Hrvoje Niksic  <hniksic@xemacs.org>

        * progress.c (dot_update): Remove unused variable row_qty.

2005-06-29  Hrvoje Niksic  <hniksic@xemacs.org>

        * main.c: Check for both SIGHUP and SIGUSR1 before using them.

2005-06-29  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c: Unconditionally include locale.h.

2005-06-29  Hrvoje Niksic  <hniksic@xemacs.org>

        * ptimer.c: Include sys/time.h to get struct timeval.

2005-06-29  Hrvoje Niksic  <hniksic@xemacs.org>

        * wget.h: Remove obsolete definition of with_thousand_seps_sum.

2005-06-29  Hrvoje Niksic  <hniksic@xemacs.org>

        * gnu-md5.h: Unconditionally include limits.h.

2005-06-29  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (random_number): Use lrand48 if available.
        (random_float): Use drand48 if available.

2005-06-29  Hrvoje Niksic  <hniksic@xemacs.org>

        * main.c (secs_to_human_time): Use print_decimal when printing
        total download time in seconds.

        * progress.c (print_row_stats): Use it to print total download
        time at the end of the download.
        (create_image): Ditto.

        * utils.c (print_decimal): New function; print small decimal
        numbers with more precision than large ones.

        * progress.c (print_row_stats): New function.  Print ETA after the
        download rate at the end of each row.

2005-06-28  Hrvoje Niksic  <hniksic@xemacs.org>

        * init.c (parse_line): Check for alphanumerics.

2005-06-28  Hrvoje Niksic  <hniksic@xemacs.org>

        * (dot_create): Remove unnecessary casts.

2005-06-28  Hrvoje Niksic  <hniksic@xemacs.org>

        * ftp.c (getftp): Delete trailing newlines from LIST output so
        lines don't come out with trailing \015\012 with -S.

2005-06-27  Hrvoje Niksic  <hniksic@xemacs.org>

        * mswindows.h: Remove superfluous includes.

2005-06-27  Hrvoje Niksic  <hniksic@xemacs.org>

        * config-post.h (alloca): Amend alloca declaration to take care of
        all Win32 compilers, not just MSVC and MinGW.

2005-06-27  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (get_grouping_data): Force separator to "." rather than
        " " when "," is taken.

2005-06-27  Hrvoje Niksic  <hniksic@xemacs.org>

        * wget.h (PTR_FORMAT): Cast the result of sizeof to int before
        passing it to printf's %*.

        * retr.h: Declare output_stream and output_stream_regular.

        * ftp.h: Declare ftp_last_respline.

        * convert.h: Declare dl_url_file_map.

        * http.h: New file.

2005-06-27  Hrvoje Niksic  <hniksic@xemacs.org>

        * cookies.c: Make cookies_now static.

2005-06-27  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (human_readable): Remove intermediary cast to long; MSVC
        has problems casting *unsigned* __int64 to double.

2005-06-27  Hrvoje Niksic  <hniksic@xemacs.org>

        * sysdep.h: Use the system-provided fnmatch by default.

2005-06-27  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (mktime_from_utc): Renamed to timegm and moved to cmpt.c.
        Don't compile it if GNU timegm is available.
        (http_atotm): Use timegm.

2005-06-27  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (http_atotm): Correctly query the old locale value.

2005-06-27  Hrvoje Niksic  <hniksic@xemacs.org>

        * config-post.h (alloca): Don't #define alloca under MinGW32,
        which defines it in malloc.h, included from mswindows.h.

2005-06-27  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (get_grouping_data): Force the use of separators in C
        locale.

2005-06-27  Hrvoje Niksic  <hniksic@xemacs.org>

        * main.c (i18n_initialize): Set all locale categories.

        * http.c (http_atotm): Temporarily set locale to "C".

2005-06-27  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (gethttp): Improve "POST data file missing" error
        message.

2005-06-27  Hrvoje Niksic  <hniksic@xemacs.org>

        * progress.c (set_progress_implementation): Type COLON as const
        char *.

2005-06-27  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (with_thousand_seps): Handle negative numbers.

2005-06-26  Hrvoje Niksic  <hniksic@xemacs.org>

        * progress.c (create_image): Mark the "eta" string for translation.

2005-06-26  Hrvoje Niksic  <hniksic@xemacs.org>

        * html-url.c (get_urls_file): Don't explicitly set entry->next to
        NULL since entry is already zeroed out.

2005-06-26  Gisle Vanem  <giva@bgnett.no>

        * mswindows.h: Define gai_strerror under MinGW.

2005-06-26  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (with_thousand_seps): Correctly implement thousand seps
        consisting of more than one character.

2005-06-26  Hrvoje Niksic  <hniksic@xemacs.org>

        * main.c (secs_to_human_time): Ditto.

        * progress.c (create_image): Print more exact duration of very
        short downloads.

        * main.c (secs_to_human_time): Don't translate time suffixes "h",
        "m", and "s", which are not strictly SI, but are "accepted for use
        with SI".
        (secs_to_human_time): Print really small intervals as 0s, not
        0.00s.

2005-06-26  Hrvoje Niksic  <hniksic@xemacs.org>

        * config-post.h: Replace the alloca declaration with the one from
        the latest Autoconf manual.  This should remove a warning with GCC
        on AIX.

2005-06-26  Hrvoje Niksic  <hniksic@xemacs.org>

        * ftp.c (getftp): Always invoke SIZE, not only when continuing a
        download.

        * main.c (main): Ditto here.

        * progress.c (create_image): When the download is finished, print
        how long it took.

2005-06-26  Hrvoje Niksic  <hniksic@xemacs.org>

        * main.c (main): Print the downloaded and quota amounts with the
        "human_readable" function.

        * ftp.c (print_length): Ditto.

        * http.c (gethttp): Don't display thousand separators.

        * utils.c (with_thousand_seps): Rewritten to respect locale
        settings and to be type size agnostic.

2005-06-25  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (human_readable): Divide with 1024 instead of shifting
        so the operation can work with non-integer N.

2005-06-25  Hrvoje Niksic  <hniksic@xemacs.org>

        * progress.c (eta_to_human): New logic for more human-readable
        ETA.

2005-06-25  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (with_thousand_seps_sum): Decrease buffer size so it
        cannot overrun add_thousand_seps's buffer.

2005-06-25  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (SPRINTF_WGINT): The correct format is %I64d, not just
        %I64.

2005-06-25  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (http_loop): Don't warn about wildcards in HTTP URLs if
        globbing isn't requested in the first place.

        * retr.c (retrieve_url): Temporarily turn off globbing when
        processing HTTP->FTP redirects.

2005-06-25  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (with_thousand_seps_sum): Now defined only if
        SUM_SIZE_INT is double.

        * wget.h (SUM_SIZE_INT): Instead of bothering with long, long
        long, __int64, and friends, simply either use wgint or double, end
        of story.  Since we know how to print either, we no longer need
        LARGE_INT_FMT.

        * sysdeps.h (LARGE_INT): Renamed to SUM_SIZE_INT to better reflect
        its intent, and moved to wget.h.

2005-06-25  Hrvoje Niksic  <hniksic@xemacs.org>

        * Makefile.in: No need to clean .libs.

2005-06-25  Hrvoje Niksic  <hniksic@xemacs.org>

        * cookies.c (parse_set_cookies): Cast pointer subtraction to int
        before using it with %d; AIX compiler warns on this.
        Reported by Jens Schleusener.

2005-06-24  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (gethttp): Don't prepend / here.

        * cookies.c (cookie_handle_set_cookie): Prepend / to PATH.
        (cookie_header): Ditto.

2005-06-24  Hrvoje Niksic  <hniksic@xemacs.org>

        * init.c: opt.verbose must be declared as int.

2005-06-23  Hrvoje Niksic  <hniksic@xemacs.org>

        * cmpt.c (strpbrk): Removed.
        (mktime): Removed.
        Include <time.h>.

2005-06-23  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (read_file): Ditto.

        * main.c (main): Use struct_fstat.

        * mswindows.h (struct_fstat): Define a struct_fstat to deal with
        the fact that Borland 5.5 has 64-bit stat, but not 64-bit fstat!

2005-06-23  Hrvoje Niksic  <hniksic@xemacs.org>

        * sysdep.h: Remove code that deals with Watcom.

2005-06-22  Hrvoje Niksic  <hniksic@xemacs.org>

        * all: Use bool instead of int and false/true instead of 0/non-0
        for boolean variables and values.

2005-06-22  Hrvoje Niksic  <hniksic@xemacs.org>

        * sysdep.h: Include the stdbool.h/_Bool/bool blurb from Autoconf.

2005-06-22  Hrvoje Niksic  <hniksic@xemacs.org>

        * init.c (cmd_lockable_boolean): Removed.

2005-06-22  Hrvoje Niksic  <hniksic@xemacs.org>

        * cookies.c (struct cookie): Use 1-bit bitfields for booleans
        which makes the structure takes less space at no cost in
        complexity.

2005-06-22  Hrvoje Niksic  <hniksic@xemacs.org>

        * Makefile.in ($(OBJ)): Add the config.h dependency.

2005-06-22  Hrvoje Niksic  <hniksic@xemacs.org>

        * openssl.c, connect.c, host.c: Replace instances of #ifdef
        ENABLE_DEBUG if (opt.debug) {...} #endif with IF_DEBUG {...}.

        * main.c: Rename the IF_DEBUG defined here to WHEN_DEBUG.

        * wget.h (IF_DEBUG): New macro.
        (DEBUGP): Define in terms of IF_DEBUG.

2005-06-22  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (gethttp): Only handle --set-cookies (and assert that
        cookie jar exists) if opt.cookies is true.  Failure to do so
        triggered the assert when --no-cookies was used and the server
        sent a Set-Cookie header.  Ouch!

2005-06-22  Hrvoje Niksic  <hniksic@xemacs.org>

        * connect.c (select_fd): Expect select() to exist.

        * utils.c (xsleep): Always use select() as sleep fallback on
        non-Windows platforms.

        * ptimer.c: Delete the implementation of PTIMER_TIME.

        * main.c: Assume existence of signal(), test for different signal
        names instead.

        * cmpt.c: Better document reasons why certain functions are
        included.

2005-06-22  Hrvoje Niksic  <hniksic@xemacs.org>

        * Makefile.in: Remove the manually maintained dependency list;
        make all object files depend on every header.

2005-06-20  Hrvoje Niksic  <hniksic@xemacs.org>

        * hash.c: Rename "mapping" to "cell" to avoid confusion with the
        term "mapping" (or "map") sometimes being used for the entire hash
        table.  Also rename "non-empty" to "occupied" for easier reading
        of if (!NON_EMPTY (...)) ... .

2005-06-20  Hrvoje Niksic  <hniksic@xemacs.org>

        * main.c, ptimer.c, sysdep.h, utils.c: Use #elif to simplify reading of
        chained if-else-else-else-... statements.

2005-06-20  Hrvoje Niksic  <hniksic@xemacs.org>

        * all: Return type of signal handlers is `void'.  Include signal.h
        unconditionally.

        * all: Don't explicitly cast values returned by malloc.  We no
        longer support ancient compilers that don't declare malloc, and we
        never supported C++ builds.

2005-06-19  Hrvoje Niksic  <hniksic@xemacs.org>

        * all: Don't declare errno.  Include both time.h and sys/time.h,
        as long as sys/time.h exists.  Don't dereference function pointers
        when invoking the functions they point to.

        * cmpt.c (memmove): Remove function mandated by C89.
        (strerror): Ditto.
        (strstr): Ditto.

        * all: Undo the K&R-ization changes from 2005-05-03.

        * all: Remove support for K&R compilers: use C89 function
        declarations, remove definition of PARAMS, remove support for
        varargs, and remove ansi2knr.  Assume the presence of time.h,
        string.h, and other headers mandated by C89.

2005-06-19  Hrvoje Niksic  <hniksic@xemacs.org>

        * init.c (cmd_lockable_boolean): Don't recognize literal "2" and
        "-1" values; unlike 0 and 1, those should never be exposed to the
        user.  Update the error message to be more self-consistent, as
        proposed by Benno Schulenberg.

2005-06-18  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (gethttp): Don't free "head" before using it to save
        headers.

2005-06-18  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (gethttp): When -E is in use, check for file existence
        after appending ".html" to the name and modify the file name if
        necessary.

2005-06-17  Hrvoje Niksic  <hniksic@xemacs.org>

        * connect.c (socket_has_inet6): Removed.

        * host.c (lookup_host): Don't use the AI_ADDRCONFIG getaddrinfo
        hint.

2005-06-16  Hrvoje Niksic  <hniksic@xemacs.org>

        * init.c (cmd_lockable_boolean): Improve the error message so it
        lists the more useful values first.

2005-06-15  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (gethttp): Also report the system error when the POST
        data file is missing.

2005-06-15  Benno Schulenberg  <benno@nietvergeten.nl>

        * ftp.c, http.c, connect.c, cookies.c, html-url.c, init.c, res.c:
        Gettext-ize messages that were previously missed.

2005-06-15  Hrvoje Niksic  <hniksic@xemacs.org>

        * host.h (ip_address): Remove the trailing comma from the type
        enum in the no-IPv6 case.

        * main.c (struct cmdline_option): Remove the trailing comma from
        the enum.

        Reported by Jens Schleusener.

2005-05-30  Hrvoje Niksic  <hniksic@xemacs.org>

        * url.c (strpbrk_or_eos): Check for a recent GCC version before
        using the statement-as-expression extension.

2005-05-30  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (gethttp): Don't attempt to "skip short body" if we're
        issuing a HEAD request (in which case the response head is not
        followed by a body).

2005-05-30  Hrvoje Niksic  <hniksic@xemacs.org>

        * init.c (cmd_spec_header): Don't split the string along the
        commas using cmd_vector; just append the new value using
        vec_append instead.

        * utils.c (vec_append): New function.

2005-05-27  Andreas Beckmann  <debian@abeckmann.de>

        * html-url.c (tag_handle_link): Mark the content from the <link
        src="..."> tag as expecting HTML.

2005-05-24  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (http_atotm): Document the origin of the "cookie date"
        format.

2005-05-21  Hrvoje Niksic  <hniksic@xemacs.org>

        * init.c (setval_internal): Report exact command name alongside
        the "display name".

2005-05-18  Hrvoje Niksic  <hniksic@xemacs.org>

        * cookies.c (update_cookie_field): Explicitly cast -1 to time_t to
        cope with systems where time_t is unsigned.

        * cookies.c: Remove unnecessary casts to time_t from values
        already of that type.

2005-05-17  Hrvoje Niksic  <hniksic@xemacs.org>

        * ftp.c (ftp_loop_internal): Same here.

        * http.c (http_loop): Don't clobber the file when -c is specified
        and the first attempt to retrieve the file fails.

2005-05-16  Hrvoje Niksic  <hniksic@xemacs.org>

        * openssl.c (ssl_check_certificate): Print all issues with a
        certificate.

2005-05-16  Hrvoje Niksic  <hniksic@xemacs.org>

        * ftp-basic.c: Don't xfree() the line returned by ftp_response if
        the returned code is not FTPOK.

2005-05-16  Hrvoje Niksic  <hniksic@xemacs.org>

        * init.c (cleanup): Don't free the non-existent opt.ftp_acc.  Free
        the SSL-related stuff.

2005-05-16  Hrvoje Niksic  <hniksic@xemacs.org>

        * ftp.c (print_length): Consistently print \n at end of the
        "Length" line.

2005-05-14  Hrvoje Niksic  <hniksic@xemacs.org>

        * openssl.c (ssl_connect): Announce the beginning and the end of
        the SSL handshake when in debug mode.

        * wget.h (PTR_FORMAT): New macro for easier printing of pointer
        values.  Use %0*lx along with PTR_FORMAT instead of %p.

2005-05-14  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (gethttp): Would forget to close the connection when
        keep_alive was not used.

2005-05-13  Hrvoje Niksic  <hniksic@xemacs.org>

        * openssl.c (pattern_match): Document the code that decides
        whether "*" matches ".".

2005-05-12  Hrvoje Niksic  <hniksic@xemacs.org>

        * ftp-ls.c (ftp_index): Use %d to print the port number, which is
        now int.
        From Steven M. Schweda's VMS patches.

2005-05-12  Hrvoje Niksic  <hniksic@xemacs.org>

        * url.c (rewrite_shorthand_url): Don't rewrite "https://host" to
        "ftp://https//host" when SSL is not used.

2005-05-11  Hrvoje Niksic  <hniksic@xemacs.org>

        * openssl.c (ssl_check_server_identity): Renamed to
        ssl_check_certificate because it does more than just checking the
        server's identity.
        (ssl_check_certificate): Tell the user about
        --no-check-certificate.

2005-05-11  Hrvoje Niksic  <hniksic@xemacs.org>

        * openssl.c (ssl_init): Always use SSL_VERIFY_NONE, so that the
        handshake finishes even if the certificate is invalid.  That way
        ssl_check_server_identity can provide better diagnostics on why
        the verification failed.

2005-05-11  Hrvoje Niksic  <hniksic@xemacs.org>

        * openssl.c (pattern_match): New function.
        (ssl_check_server_identity): Treat peer certificate common name as
        wildcard.

2005-05-10  Hrvoje Niksic  <hniksic@xemacs.org>

        * openssl.c (ssl_check_server_identity): Print certificate subject
        and issuer.

2005-05-10  Hrvoje Niksic  <hniksic@xemacs.org>

        * res.c (res_register_specs): Correctly pass pointers to
        hash_table_get_pair.

2005-05-10  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (gethttp): Call ssl_check_server_identity.

        * openssl.c (ssl_check_server_identity): New function, verifies
        that the host name in the certificate matches the actual host
        name.
        (verify_cert_callback): Removed, since it didn't do anything
        except returning the preverify_ok argument.

        * connect.c (fd_transport_context): Allow retrieval of the context
        pointer registered with fd_register_transport.

2005-05-09  Hrvoje Niksic  <hniksic@xemacs.org>

        * openssl.c (verify_cert_callback): Renamed from verify_callback.
        Always return the received "ok" value.  Print the X509 name in
        debug mode.
        (ssl_init): Enable partial writes in SSL context.

2005-05-08  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (http_loop): Check for wildcards in the URL path
        component, not in the whole URL.

        * ftp.c (ftp_loop): Check for wildcards in URL path before
        unescaping, so the users can escape globbing metacharacters with %
        escapes.

2005-05-08  Hrvoje Niksic  <hniksic@xemacs.org>

        * init.c (run_command): Correctly interpret the return value of
        parse_line.
        (commands): Re-alphabetize.

2005-05-08  Hrvoje Niksic  <hniksic@xemacs.org>

        * netrc.c (parse_netrc): Explicitly check for assignment != NULL
        to silence warning from Borland C.

        * url.c (sync_path): Don't unnecessarily increment p.
        (url_parse): Don't unnecessarily set url_encode to NULL just
        prior to return from the function.

2005-05-08  Hrvoje Niksic  <hniksic@xemacs.org>

        * log.c (escnonprint_internal): Place variable declarations
        before other statements.

2005-05-08  Hrvoje Niksic  <hniksic@xemacs.org>

        * html-url.c: Include recur.h.

        * http.c (request_new): Define as accepting no args.

2005-05-07  Hrvoje Niksic  <hniksic@xemacs.org>

        * url.c (strpbrk_or_eos): Made inline.  Use strchr(s, '\0') for
        finding the NUL char position.

2005-05-07  Hrvoje Niksic  <hniksic@xemacs.org>

        * url.c (decide_copy_method): Renamed to char_needs_escaping.
        Since it now returns only two possible values, change it to return
        boolean (int).

2005-05-07  Hrvoje Niksic  <hniksic@xemacs.org>

        * ftp-basic.c (ftp_request): Prevent newlines in VALUE causing
        inadvertent sending of multiple FTP commands.

2005-05-07  Hrvoje Niksic  <hniksic@xemacs.org>

        * url.c (decide_copy_method): Never cause reencode_escapes to
        decode % escapes; it is too intrusive and breaks some servers.

2005-05-07  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (gethttp): When tunnelling SSL traffic over proxy with
        CONNECT, we're really talking to the remote server directly.
        Because of this, the request-line argument must be the URL path
        rather than the whole URL, as it would be when using regular
        proxies.
        Reported by Charles Lane.

2005-05-06  Hrvoje Niksic  <hniksic@xemacs.org>

        * init.c (cmd_spec_useragent): Allow empty User-Agent.

        * http.c (gethttp): Don't print "unknown authentication scheme"
        for failed Basic authentication.
        (SET_USER_AGENT): Don't set user-agent if opt.useragent is empty.
        (gethttp): Use alloca for allocation of www_authenticate.

2005-05-06  Hrvoje Niksic  <hniksic@xemacs.org>

        * main.c (print_help): Fix wording of --secure-protocol help text.

2005-05-06  Hrvoje Niksic  <hniksic@xemacs.org>

        * cmpt.c (strstr): Updated from glibc 2.3.5.

2005-05-05  Hrvoje Niksic  <hniksic@xemacs.org>

        * http.c (http_atotm): Zero out the whole struct tm being passed
        to strptime.

2005-05-05  Hrvoje Niksic  <hniksic@xemacs.org>

        * main.c (main): Propagate option name to setoptval.

        * init.c (setoptval): Accept another argument, OPTNAME.  Propagate
        that argument as the option name independently of the actual
        command, determined by command_by_name(com).

2005-05-05  Hrvoje Niksic  <hniksic@xemacs.org>

        * init.c (parse_line): Make the return value indicate whether
        there was a syntax error or a setter failed.
        (run_wgetrc): Return an indication on whether an error has been
        encountered.
        (initialize): Abort if there have been errors running either
        .wgetrc file.

2005-05-05  Hrvoje Niksic  <hniksic@xemacs.org>

        * log.c (copy_and_escape): Slightly reduce code repetition between
        the two loops.

2005-05-05  Charles C.Fu  <ccwf@bacchus.com>

        * utils.c (proclist): Strip leading slash when calling fnmatch
        too, otherwise wildcard comparisons always fail.

2005-05-05  Hrvoje Niksic  <hniksic@xemacs.org>

        * utils.c (touch): Set access time to current time.

2005-05-05  Hrvoje Niksic  <hniksic@xemacs.org>

        * url.c (url_unescape): Don't unescape %00, it effectively
        truncates the string.

2005-05-05  Hrvoje Niksic  <hniksic@xemacs.org>

        * log.c (copy_and_escape): Replace the FOR_URI argument with a
        slightly more general mechanism for specifying different kinds of
        escape.

2005-05-05  Hrvoje Niksic  <hniksic@xemacs.org>

        * ftp-basic.c (ftp_response): Fix printing FTP server response.

2005-05-05  Hrvoje Niksic  <hniksic@xemacs.org>

        * retr.c (limit_bandwidth_reset): Reset sleep_adjust.
        (limit_bandwidth): Don't allow huge "adjustment" values that
        result from being suspended for a while.

2005-05-04  Hrvoje Niksic  <hniksic@xemacs.org>