This is a preview version of Cyotek's blog and may be missing functionality and/or unstable. Please visit https://www.cyotek.com/blog for the current version of the blog.
If you encounter any problems using this preview site, please contact us with the details.

Archived posts for All of 2018

WebCopy 1.7 - local file name generation

Cyotek WebCopy 0 Comments

As part of WebCopy 1.7's mission to reduce user confusion and make the product more appealing, a pair of new options for controlling local file name generation have been introduced, as well as correcting a potentially confusing bug.

By default, WebCopy will name local files to match their content type. For example, if you download the homepage of a website which is named index.php, WebCopy will save a local file named index.html - end users would probably very confused trying to open a .php file and either the operating system doesn't know how to handle it, or it executes the PHP runtime.

Read More

WebCopy 1.7 - tls/ssl invalid certificate handling

Cyotek WebCopy 1 Comments

You should add an option to ignore checking for an SSL certificate.

The above quote is the last part of a piece of uninstallation feedback I received about WebCopy on Friday. This isn't the first time I've had an anonymous feedback about ignoring SSL errors and each time it has happened it has been frustrating and even bewildering as the option is already there and has been since 2013!

Read More

WebCopy 1.7 - web browser authentication

Cyotek WebCopy Cyotek Sitemap Creator 0 Comments

There are five main features WebCopy (and Sitemap Creator) need based on user feedback and our own observations. In no particular order, these are making the product easier to use, supporting multiple downloads at once, being able to pause and resume a copy, JavaScript support and authentication. The current plan is to address three of the five in WebCopy 1.7, starting with authentication.

Since the earliest days of WebCopy, it has supported challenge authentication (where a web browser prompts you for credentials) and form based authentication (where you enter credentials into a web page). Almost all web sites use the latter approach and with WebCopy this can either be tricky to configure or impossible due to websites using interactive methods such as authenticators or captcha codes.

Read More

WebCopy 1.5 beta released

0 Comments

A new beta of WebCopy has been released, one I hope will resolve some of the plethora of uninstall feedback I've been receiving recently relating to users having problems logging into web sites using WebCopy.

When WebCopy posts a form, it downloads the existing form, pulls out all the values and merges these with the specific values the user has configured. That way, you can easily post login forms that include hidden parameters containing anti-forgery tokens or other meta data that may be generated dynamically.

Read More

WebCopy 1.4 beta released

Cyotek WebCopy

A beta version of WebCopy 1.4 complete with a fundamental change to how rules are ran, various performance improvements, UI tweaks and miscellaneous bug fixes has been released.

In previous versions of WebCopy, rule processing would stop as soon as the first rule was matched. This made it impossible to do standard tasks like exclude all HTML pages from being downloaded (but still scan them) and only download image resources, as an example.

Read More