Menu

Tree [9607af] master / mwoffliner /
 History

HTTPS access


File Date Author Commit
 selections 2016-01-28 kelson42 kelson42 [a48a65] rename of wp1 0.8 selection file
 servers 2016-02-03 kelson42 kelson42 [1d8a7a] Fix wikivoyage.org url
 README 2015-03-20 kelson42 kelson42 [102154] Fix docu about redis socket path
 mwmatrixoffliner.js 2015-09-13 kelson42 kelson42 [7887ad] Use new WM Parsoid API URL scheme
 mwoffliner.js 2016-02-06 kelson42 kelson42 [9607af] set a max-width for the content for better read...
 package.json 2015-07-10 kelson42 kelson42 [0b2a6d] Fix license string
 wpselectionsoffliner.js 2015-07-05 kelson42 kelson42 [0f7ea1] rest url is http only

Read Me

mwoffliner is a tool which allows to "dump" a Wikimedia project
(Wikipedia, Wiktionary, ...) to a local storage. It should also work
for any Mediawiki instance having parsoid installed. It goes through
all articles (or a selection if specified) of the project and write
the HTML/pictures to local files.

To use it, you need a recent version of nodejs and a POSIX system
(like GNU/Linux). You need also to install all necessary nodejs
packages with "npm install" in this directory.

You need also a redis server correctly configured and listening to
/dev/shm/redis.sock. Following console binaries are necessary to
reduce image size: jpegoptim, advdef, gifsicle, pngquant. You also
need imagemagick, in particular the 'convert' tool.

We recommend also to use a DNS cache like nscd.

One time you have done this, you should be able to start the tool with
./mwoffliner.js and see the usage() for more details.