Skip to content

Commit 3021373

Browse files
committed
Added --startTitle option
1 parent 8e29825 commit 3021373

File tree

4 files changed

+21
-10
lines changed

4 files changed

+21
-10
lines changed

.gitignore

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,3 @@
1+
*~
2+
.tern-port
3+
node_modules

README.md

Lines changed: 13 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -8,18 +8,21 @@ HTML dump script for RESTBase APIs like https://rest.wikimedia.org/.
88
## Usage: Dumping a single wiki
99

1010
```
11-
Usage: node ./bin/dump_wiki
12-
Example: node ./bin/dump_wiki --domain en.wikipedia.org \
13-
--ns 0 --apiURL http://en.wikipedia.org/w/api.php \
14-
--saveDir /tmp
11+
$ node bin/dump_wiki --help
12+
Create a HTML dump in a subdir
13+
14+
Example:
15+
/usr/bin/nodejs ./bin/dump_wiki --domain en.wikipedia.org --ns 0 --apiURL http://en.wikipedia.org/w/api.php
1516
1617
Options:
17-
--apiURL [required]
18-
--domain [required]
19-
--ns [required]
20-
--host [required] [default: "http://rest.wikimedia.org"]
21-
-d, --saveDir Directory to store a dump in (named by domain) [default: no saving]
22-
--db, --dataBase SQLite database name [default: no saving]
18+
--apiURL [required]
19+
--domain, --prefix [required]
20+
--ns [required]
21+
--host [required] [default: "http://rest.wikimedia.org"]
22+
-d, --saveDir [default: ""]
23+
-t, --startTitle [default: ""]
24+
--db, --dataBase [default: ""]
25+
--verbose [default: true]
2326
```
2427

2528
### Filesystem output

bin/dump_wiki

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -17,6 +17,10 @@ var argParser = require('yargs')
1717
alias : 'saveDir',
1818
default : ''
1919
})
20+
.options('t', {
21+
alias: 'startTitle',
22+
default: ''
23+
})
2024
.options('db', {
2125
alias : 'dataBase',
2226
default : ''

lib/htmldump.js

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -35,6 +35,7 @@ function getArticles (options, res) {
3535
action: 'query',
3636
generator: 'allpages',
3737
gaplimit: '500',
38+
gapfrom: options.startTitle,
3839
prop: 'revisions',
3940
gapnamespace: options.ns,
4041
format: 'json',

0 commit comments

Comments
 (0)