Skip to content

Commit 68fb746

Browse files
YangzhediYangzhedi
committed
增加中石油股票交易数据爬虫
1 parent ffa34f7 commit 68fb746

3 files changed

Lines changed: 113 additions & 0 deletions

File tree

‎by-bs4/shares/Y2016S3.txt‎

Lines changed: 64 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,64 @@
1+
2016-09-30 7.23 7.24 7.21 7.22 -0.01 -0.14 140,295 10,133 0.41 0.01
2+
2016-09-29 7.23 7.27 7.23 7.23 0.04 0.56 183,507 13,301 0.56 0.01
3+
2016-09-28 7.21 7.21 7.18 7.19 -0.02 -0.28 80,178 5,763 0.42 0.01
4+
2016-09-27 7.19 7.22 7.16 7.21 0.02 0.28 146,268 10,511 0.83 0.01
5+
2016-09-26 7.25 7.25 7.18 7.19 -0.08 -1.10 253,114 18,257 0.96 0.02
6+
2016-09-23 7.27 7.28 7.25 7.27 0.01 0.14 112,949 8,207 0.41 0.01
7+
2016-09-22 7.27 7.28 7.26 7.26 0.00 0.00 169,546 12,326 0.28 0.01
8+
2016-09-21 7.26 7.26 7.23 7.26 0.01 0.14 86,712 6,285 0.41 0.01
9+
2016-09-20 7.28 7.28 7.25 7.27 -0.01 -0.14 132,268 9,601 0.41 0.01
10+
2016-09-19 7.27 7.29 7.26 7.28 0.00 0.00 207,369 15,077 0.41 0.01
11+
2016-09-14 7.27 7.30 7.26 7.28 -0.01 -0.14 191,952 13,958 0.55 0.01
12+
2016-09-13 7.30 7.31 7.26 7.29 -0.02 -0.27 192,731 14,036 0.68 0.01
13+
2016-09-12 7.37 7.38 7.26 7.31 -0.11 -1.48 358,063 26,152 1.62 0.02
14+
2016-09-09 7.47 7.48 7.40 7.42 -0.04 -0.54 174,065 12,957 1.07 0.01
15+
2016-09-08 7.50 7.50 7.45 7.46 -0.03 -0.40 110,170 8,225 0.67 0.01
16+
2016-09-07 7.48 7.51 7.47 7.49 0.00 0.00 166,132 12,444 0.53 0.01
17+
2016-09-06 7.49 7.50 7.46 7.49 -0.01 -0.13 135,992 10,168 0.53 0.01
18+
2016-09-05 7.47 7.52 7.45 7.50 0.03 0.40 178,188 13,332 0.94 0.01
19+
2016-09-02 7.48 7.50 7.45 7.47 -0.02 -0.27 156,727 11,716 0.67 0.01
20+
2016-09-01 7.52 7.54 7.48 7.49 -0.05 -0.66 237,877 17,860 0.80 0.01
21+
2016-08-31 7.49 7.54 7.47 7.54 0.05 0.67 355,170 26,669 0.93 0.02
22+
2016-08-30 7.42 7.52 7.39 7.49 0.07 0.94 456,700 34,095 1.75 0.03
23+
2016-08-29 7.39 7.43 7.37 7.42 0.02 0.27 163,822 12,127 0.81 0.01
24+
2016-08-26 7.40 7.43 7.39 7.40 -0.01 -0.14 163,733 12,127 0.54 0.01
25+
2016-08-25 7.41 7.42 7.37 7.41 -0.02 -0.27 237,131 17,515 0.67 0.01
26+
2016-08-24 7.41 7.44 7.40 7.43 0.01 0.13 148,676 11,035 0.54 0.01
27+
2016-08-23 7.41 7.43 7.39 7.42 0.00 0.00 187,156 13,874 0.54 0.01
28+
2016-08-22 7.41 7.45 7.40 7.42 0.01 0.14 249,024 18,491 0.67 0.02
29+
2016-08-19 7.41 7.46 7.39 7.41 0.02 0.27 279,880 20,770 0.95 0.02
30+
2016-08-18 7.41 7.44 7.38 7.39 -0.03 -0.40 214,121 15,865 0.81 0.01
31+
2016-08-17 7.42 7.44 7.40 7.42 0.00 0.00 202,916 15,061 0.54 0.01
32+
2016-08-16 7.45 7.46 7.40 7.42 -0.03 -0.40 334,813 24,867 0.81 0.02
33+
2016-08-15 7.35 7.46 7.33 7.45 0.11 1.50 549,700 40,724 1.77 0.03
34+
2016-08-12 7.30 7.35 7.27 7.34 0.04 0.55 296,878 21,701 1.10 0.02
35+
2016-08-11 7.27 7.30 7.26 7.30 0.03 0.41 226,075 16,466 0.55 0.01
36+
2016-08-10 7.28 7.29 7.26 7.27 -0.01 -0.14 114,816 8,351 0.41 0.01
37+
2016-08-09 7.26 7.29 7.22 7.28 0.02 0.28 164,700 11,974 0.96 0.01
38+
2016-08-08 7.24 7.26 7.21 7.26 0.02 0.28 152,230 11,025 0.69 0.01
39+
2016-08-05 7.23 7.25 7.21 7.24 0.00 0.00 129,719 9,383 0.55 0.01
40+
2016-08-04 7.23 7.24 7.19 7.24 0.02 0.28 124,084 8,951 0.69 0.01
41+
2016-08-03 7.21 7.23 7.19 7.22 -0.02 -0.28 103,749 7,485 0.55 0.01
42+
2016-08-02 7.20 7.24 7.19 7.24 0.02 0.28 123,093 8,886 0.69 0.01
43+
2016-08-01 7.21 7.23 7.17 7.22 0.00 0.00 133,952 9,637 0.83 0.01
44+
2016-07-29 7.21 7.23 7.20 7.22 0.00 0.00 116,170 8,385 0.42 0.01
45+
2016-07-28 7.22 7.23 7.19 7.22 -0.01 -0.14 189,588 13,674 0.55 0.01
46+
2016-07-27 7.33 7.34 7.19 7.23 -0.10 -1.36 284,834 20,637 2.05 0.02
47+
2016-07-26 7.28 7.33 7.28 7.33 0.05 0.69 111,686 8,162 0.69 0.01
48+
2016-07-25 7.29 7.31 7.26 7.28 -0.01 -0.14 107,281 7,814 0.69 0.01
49+
2016-07-22 7.34 7.34 7.28 7.29 -0.05 -0.68 159,621 11,646 0.82 0.01
50+
2016-07-21 7.32 7.37 7.31 7.34 0.02 0.27 119,943 8,800 0.82 0.01
51+
2016-07-20 7.33 7.37 7.32 7.32 -0.03 -0.41 121,135 8,888 0.68 0.01
52+
2016-07-19 7.36 7.37 7.32 7.35 -0.03 -0.41 149,149 10,950 0.68 0.01
53+
2016-07-18 7.37 7.40 7.35 7.38 0.00 0.00 180,941 13,338 0.68 0.01
54+
2016-07-15 7.37 7.41 7.36 7.38 0.01 0.14 178,135 13,161 0.68 0.01
55+
2016-07-14 7.38 7.40 7.35 7.37 -0.04 -0.54 192,009 14,148 0.67 0.01
56+
2016-07-13 7.37 7.44 7.35 7.41 0.04 0.54 372,636 27,593 1.22 0.02
57+
2016-07-12 7.27 7.38 7.25 7.37 0.09 1.24 491,313 35,984 1.79 0.03
58+
2016-07-11 7.24 7.31 7.23 7.28 0.03 0.41 254,846 18,556 1.10 0.02
59+
2016-07-08 7.26 7.27 7.23 7.25 -0.04 -0.55 132,076 9,576 0.55 0.01
60+
2016-07-07 7.26 7.30 7.23 7.29 0.02 0.28 212,190 15,422 0.96 0.01
61+
2016-07-06 7.26 7.28 7.21 7.27 -0.03 -0.41 219,806 15,935 0.96 0.01
62+
2016-07-05 7.29 7.31 7.26 7.30 0.01 0.14 233,001 16,984 0.69 0.01
63+
2016-07-04 7.21 7.29 7.20 7.29 0.07 0.97 267,340 19,425 1.25 0.02
64+
2016-07-01 7.22 7.24 7.19 7.22 -0.01 -0.14 174,638 12,606 0.69 0.01

‎by-bs4/shares/Y2016S4.txt‎

Lines changed: 23 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,23 @@
1+
2016-11-09 7.32 7.32 7.25 7.28 -0.04 -0.55 216,469 15,759 0.96 0.01
2+
2016-11-08 7.30 7.32 7.30 7.32 0.03 0.41 205,222 15,003 0.27 0.01
3+
2016-11-07 7.26 7.31 7.25 7.29 0.03 0.41 180,578 13,152 0.83 0.01
4+
2016-11-04 7.28 7.31 7.26 7.26 -0.03 -0.41 184,316 13,422 0.69 0.01
5+
2016-11-03 7.26 7.31 7.24 7.29 0.01 0.14 165,506 12,054 0.96 0.01
6+
2016-11-02 7.31 7.33 7.26 7.28 -0.05 -0.68 211,376 15,392 0.96 0.01
7+
2016-11-01 7.32 7.34 7.30 7.33 -0.01 -0.14 170,665 12,489 0.55 0.01
8+
2016-10-31 7.35 7.36 7.29 7.34 -0.04 -0.54 213,820 15,639 0.95 0.01
9+
2016-10-28 7.36 7.40 7.36 7.38 0.01 0.14 189,581 13,980 0.54 0.01
10+
2016-10-27 7.37 7.40 7.35 7.37 -0.01 -0.14 135,416 9,969 0.68 0.01
11+
2016-10-26 7.40 7.41 7.35 7.38 -0.01 -0.14 139,078 10,261 0.81 0.01
12+
2016-10-25 7.41 7.43 7.38 7.39 -0.04 -0.54 250,160 18,512 0.67 0.02
13+
2016-10-24 7.37 7.46 7.34 7.43 0.07 0.95 558,896 41,455 1.63 0.03
14+
2016-10-21 7.32 7.37 7.31 7.36 0.02 0.27 272,688 20,032 0.82 0.02
15+
2016-10-20 7.34 7.36 7.31 7.34 0.01 0.14 283,310 20,775 0.68 0.02
16+
2016-10-19 7.33 7.36 7.31 7.33 0.00 0.00 211,336 15,505 0.68 0.01
17+
2016-10-18 7.25 7.35 7.25 7.33 0.07 0.96 260,049 18,985 1.38 0.02
18+
2016-10-17 7.29 7.30 7.25 7.26 -0.04 -0.55 162,076 11,793 0.68 0.01
19+
2016-10-14 7.28 7.30 7.26 7.30 0.02 0.27 172,255 12,526 0.55 0.01
20+
2016-10-13 7.30 7.31 7.27 7.28 -0.02 -0.27 132,149 9,631 0.55 0.01
21+
2016-10-12 7.29 7.31 7.28 7.30 -0.01 -0.14 131,392 9,580 0.41 0.01
22+
2016-10-11 7.31 7.33 7.29 7.31 0.02 0.27 186,896 13,662 0.55 0.01
23+
2016-10-10 7.33 7.33 7.27 7.29 0.07 0.97 244,554 17,844 0.83 0.02

‎by-bs4/shares/zhongshiyou.py‎

Lines changed: 26 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,26 @@
1+
import requests
2+
from bs4 import BeautifulSoup
3+
4+
url = 'http://quotes.money.163.com/trade/lsjysj_601857.html?year=2016&season=3'
5+
6+
headers = {
7+
'User-Agent': 'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/53.0.2785.104 Safari/537.36 Core/1.53.1708.400 QQBrowser/9.5.9635.400'
8+
}
9+
10+
data = requests.get(url , headers=headers)
11+
soup = BeautifulSoup(data.text, 'lxml')
12+
# print soup
13+
date = soup.select('div.inner_box > table > tr > td')
14+
15+
f = open('./Y2016S3.txt','wb')
16+
for index,value in enumerate(date):
17+
print value.get_text(),index
18+
if index % 11 == 10 :
19+
f.write(value.get_text()+'\n')
20+
else:
21+
f.write(value.get_text() +'\t')
22+
f.close()
23+
24+
"""
25+
body > div.area > div.inner_box > table > tbody > tr:nth-child(1) > td:nth-child(1)
26+
"""

0 commit comments

Comments
 (0)