This is a preview version of Cyotek's blog and may be missing functionality and/or unstable. Please visit https://www.cyotek.com/blog for the current version of the blog.
If you encounter any problems using this preview site, please contact us with the details.

Archived posts for All of 2019

WebCopy 1.8 - JavaScript Support

Cyotek WebCopy 3 Comments

One of the long standing requests/complaints is for WebCopy to support JavaScript enabled websites, e.g. modern SPA's where JavaScript is used to build the page. Traditionally this is something I have always put onto the furthest of back burners as in order to support this natively I'd have to essentially write half a browser, something that would be a full time job and a half and not something I'm interested in doing. Other solutions did exist but I never really looked into them.

It recently occurred to me however, that I'd put into place all the building blocks I needed to have WebCopy support JavaScript execution (in a limited fashion, more on this later) using Internet Explorer. And it was easy, in fact, the hardest part was sorting out threading issues - despite the fact that WebCopy currently only crawls on a single thread, it does run on a different thread to the UI in order not to freeze it, which COM can have a problem with.

Read More

WebCopy 1.8 - New Project Wizard

Cyotek WebCopy 0 Comments

In my previous post regarding WebCopy 1.8, I briefly covered a general grab-bag of some of the new features in this version. This post is dedicated to another new feature, the New Project Wizard.

Whilst you can still create a new blank project as with previous version of WebCopy, there's also a new GUI that will ask a series of questions and create a neatly configured project.

Read More

Introducing WebCopy 1.8

Cyotek WebCopy 0 Comments

It's been over two months since the last CI build of WebCopy was made, and during this time I've been working quite hard on some major internal refactoring and adding a long requested feature. It hope it's worth the wait, I need a break!

WebCopy 1.8 nightly builds are now available for download and so this series of posts will describe some of the changes and new functionality that have been made to the software. This first post will cover a grab bag of smaller changes.

Read More

Website history gallery

website 1 Comments

The Cyotek (and Ariad Software) websites have gone through a lot of iterations over the years. The current website software dates from 2011, with the design from 2013, and both are in drastic need of an overhaul. As I plan on redeveloping the site using ASP.NET Core, I'm also going to introduce a new look at the same time. With that in mind, I thought it might be interesting (for myself at least!) to put together a rogues gallery of some of the iterations.

Fortunately I still have the archived source code for the oldest versions on this page, and the Internet Archive was able to supply snapshots for iterations between version 10 and 12. Some of the designs I forgot were ever a thing!

Read More