How to download with wget in Python using variables?

Question

I need to do something like this, but in Python instead of Bash:

i=1
while [ $i <= 10 ] ; do
    wget http://somewebsite.net/shared/fshared_$i.7z
    $i = $i + 1
done

In Python I tried with the following:

import urllib, os
i = 0
while i <= 3:
    os.system('wget http://somewebsite.net/shared/fshared_',i,'.7z')
    i = i + 1

But it does not work, the variable is not concatenated correctly (or something similar).
Using Bash code does not work, apparently in Bash can't do something simple like: i = i + 1

Could anyone help me with this?

SOLVED! :)

Now I have the script both Bash and Python, actually with Python I have several variants.

Thanks to all... thanks a lot ^-^

How do I mark the topic as solved?

Thanks again.

If one of the answers solved your problem, you accept it. If there is more than one correct answer, accept the one you consider best. — Thomas Fenzl
– Thomas Fenzl, Commented May 30, 2013 at 20:22

karthikr · Accepted Answer · 2013-05-30 19:58:45Z

3

Try

os.system('wget http://somewebsite.net/shared/fshared_%s.7z'%i)

use %s instead of ,

edited May 30, 2013 at 19:58

answered May 30, 2013 at 19:33

karthikr

100k26 gold badges208 silver badges191 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

user2437965 Over a year ago

Using Python v2: TypeError: cannot concatenate 'str' and 'int' objects Using Python v3: TypeError: Can't convert 'int' object to str implicitly And I already put before the downlaod line: str(i)

maazza Over a year ago

you forget to remove '+' and ',' stuff

user2423516 · Accepted Answer · 2013-05-30 19:35:29Z

1

You can increment in Bash. You have to do something like:

i=3
(( i++ ))
echo $i

That last like should print 4. So your script would be:

i=1
while [ $i -le 10 ] ; do
    wget http://somewebsite.net/shared/fshared_$i.7z
    (( i++ ))
done

Edit: fixed code to use -le instead of <= since <= doesn't work in bash.

answered May 30, 2013 at 19:35

user2423516

Comments

Thomas Fenzl · Accepted Answer · 2013-05-30 19:48:08Z

1

You can use python without calling out to the shell for each file using urllib

import urllib, os

for i in range(4):
    filename = 'fshared_{}.7z'.format(i)
    urllib.urlretrieve('http://somewebsite.net/shared/'+filename, filename)

edited May 30, 2013 at 19:48

answered May 30, 2013 at 19:39

Thomas Fenzl

4,4221 gold badge19 silver badges25 bronze badges

1 Comment

user2437965 Over a year ago

I had tried before with urllib (i don't like mixing bash and python) but it did not work, but with your code it works perfectly, thanks.

Zignd · Accepted Answer · 2013-05-31 02:36:08Z

1

To fix the problem with the concatenation, you need to use + to concatenate instead of ,, because when you use , to concatenate two strings it separate them with a space character between, the same doesn't happen when you use + because it "really" concatenate the strings.

E.g.:

print('Hello' + 'World' + '!')
print('Hello', 'Stack', 'Overflow!')

Output:

HelloWorld!
Hello Stack Overflow!

Your code would look like this now using + instead of ,:

#...
os.system('wget http://somewebsite.net/shared/fshared_' + i + '.7z')
#...                                                    ^   ^

Code pasted on Ideone.com

answered May 31, 2013 at 2:36

Zignd

7,08513 gold badges42 silver badges68 bronze badges

Comments

maazza · Accepted Answer · 2013-05-30 19:57:14Z

0

Try this

import urllib, os
i = 0
while i <= 3:
    os.system('wget http://somewebsite.net/shared/fshared_%s.7z' % i)
    i = i + 1

answered May 30, 2013 at 19:57

maazza

7,26116 gold badges67 silver badges98 bronze badges

Comments

Xplore · Accepted Answer · 2015-06-12 11:26:46Z

0

you can also specify python to ask you the url to pass to wget

import os
path = raw_input("enter the url:")
os.system('wget -r -nd -l1 --no-parent -A mp3 %s'%path)

in place of 'mp3' use whatever format you want to download.

answered Jun 12, 2015 at 11:26

Xplore

3811 gold badge2 silver badges13 bronze badges

Collectives™ on Stack Overflow

How to download with wget in Python using variables?

6 Answers 6

2 Comments

Comments

1 Comment

Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

6 Answers 6

2 Comments

Comments

1 Comment

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related