This is a simple tool based on website-scraper and website-scraper-puppeteer projects (and, in turn Headless Chrome / puppeteer) that, given a URL of a website, will crawl and download its structure as a set of HTML files, then produce a single ZIP archive, suitable for importing into Smartcat platform for content translation and calculating the translation volume/statistics.
This is an experimental tool that is provided with no guarantees or obligations. See MIT-LICENSE.txt for more information.
Install Node.js as per official instructions: https://nodejs.org/en/download/
Then run the following command in the current directory to install required modules:
npm installnode download-website <URL>This will create a ZIP archive with the name that follows the <URL>-<DATETIME>.zip pattern.
Create a new project in Smartcat and drop the resulting ZIP file onto the first screen of the project creation wizard. This will upload and unpack the contents of the ZIP file. Then proceed with setting up your project as usual.
Remember that processing ZIP files with many files will take some time both at project creation time, at text parsing/indexing and at statistics calculation time.
Please contact Smartcat team at support@smartcat.com if you have questions on using the tool or our platform, or if you have specific needs with localizing your web site, CMS or a software product.