Mercurial > p > roundup > code

annotate .github/workflows/ci-test.yml @ 6948:078073f7d207

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
coveralls for 3.x only, add paralle unique build key disable upload to coveralls for 2.7. I need some way under python 2.x to generate coverage lcov syle files. Otherwise I lose coverage for the 2.x code paths. Call 'coverage lcov' only in 3.x pytest codepath not 2.x. Add unique tag for each parallel upload for coveralls. Also set lcov file name to what coverage lcov outputs.
author John Rouillard <rouilj@ieee.org>
date Sat, 10 Sep 2022 20:56:18 -0400
parents 623dcbf3a5b5
children 887e9f880fe2
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
1 # merged in python-package.yml workflow
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
2
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
3 name: roundup-ci
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
4
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
5 on:
6887
dc7b886c42e4 run on any branch push except maint-1.6
John Rouillard <rouilj@ieee.org>
parents: 6886
diff changeset
6 push:
6904
92b64fd3341f cleanup, comments ready for production.
John Rouillard <rouilj@ieee.org>
parents: 6903
diff changeset
7 # skip if github.ref is 'refs/heads/maint-1.6'
92b64fd3341f cleanup, comments ready for production.
John Rouillard <rouilj@ieee.org>
parents: 6903
diff changeset
8 # aka github.ref_name of 'maint-1.6'
92b64fd3341f cleanup, comments ready for production.
John Rouillard <rouilj@ieee.org>
parents: 6903
diff changeset
9 # see https://github.com/orgs/community/discussions/26253
92b64fd3341f cleanup, comments ready for production.
John Rouillard <rouilj@ieee.org>
parents: 6903
diff changeset
10 # for mechanism to control matrix based on branch
6887
dc7b886c42e4 run on any branch push except maint-1.6
John Rouillard <rouilj@ieee.org>
parents: 6886
diff changeset
11 branches: [ "*", '!maint-1.6' ]
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
12 # pull_request:
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
13 # branches: [ "master" ]
6880
222e84d12bed schedule build 7PM on first of month; commented out docker tst
John Rouillard <rouilj@ieee.org>
parents: 6879
diff changeset
14 schedule:
222e84d12bed schedule build 7PM on first of month; commented out docker tst
John Rouillard <rouilj@ieee.org>
parents: 6879
diff changeset
15 # monthly build/check
6885
cc9bd0dd39fc change time again. also build on all pushes
John Rouillard <rouilj@ieee.org>
parents: 6884
diff changeset
16 - cron: '23 17 1 * *'
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
17
6914
6010c20dc104 add mock package for testing
John Rouillard <rouilj@ieee.org>
parents: 6904
diff changeset
18 # GITHUB_TOKEN only has read repo context.
6010c20dc104 add mock package for testing
John Rouillard <rouilj@ieee.org>
parents: 6904
diff changeset
19 permissions:
6010c20dc104 add mock package for testing
John Rouillard <rouilj@ieee.org>
parents: 6904
diff changeset
20 contents: read
6010c20dc104 add mock package for testing
John Rouillard <rouilj@ieee.org>
parents: 6904
diff changeset
21
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
22 jobs:
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
23 test:
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
24 name: CI build test
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
25
6891
be310c5f866e another trial with exclude and include
John Rouillard <rouilj@ieee.org>
parents: 6890
diff changeset
26 #runs-on: ubuntu-latest
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
27 # use below if running on multiple OS's.
6891
be310c5f866e another trial with exclude and include
John Rouillard <rouilj@ieee.org>
parents: 6890
diff changeset
28 runs-on: ${{ matrix.os }}
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
29
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
30 strategy:
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
31 fail-fast: false
6878
81d811b8d45f set full python version string; other cleanups
John Rouillard <rouilj@ieee.org>
parents: 6877
diff changeset
32 max-parallel: 4
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
33 matrix:
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
34 # Run in all these versions of Python
6904
92b64fd3341f cleanup, comments ready for production.
John Rouillard <rouilj@ieee.org>
parents: 6903
diff changeset
35 python-version: [ "2.7", "3.10", "3.9", "3.8", "3.6", "3.11-dev" ]
92b64fd3341f cleanup, comments ready for production.
John Rouillard <rouilj@ieee.org>
parents: 6903
diff changeset
36
6878
81d811b8d45f set full python version string; other cleanups
John Rouillard <rouilj@ieee.org>
parents: 6877
diff changeset
37 # use for multiple os or ubuntu versions
81d811b8d45f set full python version string; other cleanups
John Rouillard <rouilj@ieee.org>
parents: 6877
diff changeset
38 #os: [ubuntu-latest, macos-latest, windows-latest]
6891
be310c5f866e another trial with exclude and include
John Rouillard <rouilj@ieee.org>
parents: 6890
diff changeset
39 os: [ubuntu-latest, ubuntu-22.04]
6904
92b64fd3341f cleanup, comments ready for production.
John Rouillard <rouilj@ieee.org>
parents: 6903
diff changeset
40
6878
81d811b8d45f set full python version string; other cleanups
John Rouillard <rouilj@ieee.org>
parents: 6877
diff changeset
41 # if the ones above fail. fail the build
6877
ac2b8a8f5727 fix mysql SQL to create user and grant. set max jobs in parallel
John Rouillard <rouilj@ieee.org>
parents: 6876
diff changeset
42 experimental: [false]
6904
92b64fd3341f cleanup, comments ready for production.
John Rouillard <rouilj@ieee.org>
parents: 6903
diff changeset
43
6888
f4705aba3503 add ubuntu-22.04 for 3.10 and 3.8
John Rouillard <rouilj@ieee.org>
parents: 6887
diff changeset
44 include:
6877
ac2b8a8f5727 fix mysql SQL to create user and grant. set max jobs in parallel
John Rouillard <rouilj@ieee.org>
parents: 6876
diff changeset
45 # example: if 3.12 fails the jobs still succeeds
6886
05b5224bf19e comment out experimental examle
John Rouillard <rouilj@ieee.org>
parents: 6885
diff changeset
46 # - python-version: 3.12
6904
92b64fd3341f cleanup, comments ready for production.
John Rouillard <rouilj@ieee.org>
parents: 6903
diff changeset
47 # experimental: [true]
92b64fd3341f cleanup, comments ready for production.
John Rouillard <rouilj@ieee.org>
parents: 6903
diff changeset
48 # version 2,7 not available on unbuntu-22.04 github
92b64fd3341f cleanup, comments ready for production.
John Rouillard <rouilj@ieee.org>
parents: 6903
diff changeset
49 # - python-version: 2.7
92b64fd3341f cleanup, comments ready for production.
John Rouillard <rouilj@ieee.org>
parents: 6903
diff changeset
50 # os: ubuntu-22.04
92b64fd3341f cleanup, comments ready for production.
John Rouillard <rouilj@ieee.org>
parents: 6903
diff changeset
51 # experimental: true
6893
d668e2800147 more debug
John Rouillard <rouilj@ieee.org>
parents: 6892
diff changeset
52 - python-version: 3.11-dev
d668e2800147 more debug
John Rouillard <rouilj@ieee.org>
parents: 6892
diff changeset
53 os: ubuntu-22.04
6904
92b64fd3341f cleanup, comments ready for production.
John Rouillard <rouilj@ieee.org>
parents: 6903
diff changeset
54 experimental: [true]
92b64fd3341f cleanup, comments ready for production.
John Rouillard <rouilj@ieee.org>
parents: 6903
diff changeset
55
6893
d668e2800147 more debug
John Rouillard <rouilj@ieee.org>
parents: 6892
diff changeset
56 exclude:
6904
92b64fd3341f cleanup, comments ready for production.
John Rouillard <rouilj@ieee.org>
parents: 6903
diff changeset
57 # skip all python versions on 22.04 except explicitly included
6891
be310c5f866e another trial with exclude and include
John Rouillard <rouilj@ieee.org>
parents: 6890
diff changeset
58 - os: ubuntu-22.04
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
59
6858
John Rouillard <rouilj@ieee.org>
parents: 6857
diff changeset
60 env:
6864
7e907d97deb6 redis, gpg, more myql debugging
John Rouillard <rouilj@ieee.org>
parents: 6863
diff changeset
61 # get colorized pytest output even without a controlling tty
7e907d97deb6 redis, gpg, more myql debugging
John Rouillard <rouilj@ieee.org>
parents: 6863
diff changeset
62 PYTEST_ADDOPTS: "--color=yes"
6859
ebdadf3b2653 fixes and re-enable mysql.
John Rouillard <rouilj@ieee.org>
parents: 6858
diff changeset
63 # OS: ${{ matrix.os }}
6860
69928bcce59d fix env again.
John Rouillard <rouilj@ieee.org>
parents: 6859
diff changeset
64 PYTHON_VERSION: ${{ matrix.python-version }}
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
65
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
66 steps:
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
67 # Checkout the latest code from the repo
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
68 - name: Checkout source
6878
81d811b8d45f set full python version string; other cleanups
John Rouillard <rouilj@ieee.org>
parents: 6877
diff changeset
69 # example directives:
81d811b8d45f set full python version string; other cleanups
John Rouillard <rouilj@ieee.org>
parents: 6877
diff changeset
70 # disable step
6873
8dab742710b6 null pw??
John Rouillard <rouilj@ieee.org>
parents: 6872
diff changeset
71 # if: {{ false }}
6878
81d811b8d45f set full python version string; other cleanups
John Rouillard <rouilj@ieee.org>
parents: 6877
diff changeset
72 # continue running if step fails
6874
70a78f281179 fix bad tab.
John Rouillard <rouilj@ieee.org>
parents: 6873
diff changeset
73 # continue-on-error: true
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
74 uses: actions/checkout@v3
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
75
6878
81d811b8d45f set full python version string; other cleanups
John Rouillard <rouilj@ieee.org>
parents: 6877
diff changeset
76 # Setup version of Python to use
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
77 - name: Set Up Python ${{ matrix.python-version }}
6879
5ba79dd2f31c add codecov token
John Rouillard <rouilj@ieee.org>
parents: 6878
diff changeset
78 uses: actions/setup-python@v4
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
79 with:
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
80 python-version: ${{ matrix.python-version }}
6879
5ba79dd2f31c add codecov token
John Rouillard <rouilj@ieee.org>
parents: 6878
diff changeset
81 cache: 'pip'
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
82
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
83 # Display the Python version being used
6920
b3fb615b81c4 get info about sqlite version
John Rouillard <rouilj@ieee.org>
parents: 6919
diff changeset
84 - name: Display Python and key module versions
b3fb615b81c4 get info about sqlite version
John Rouillard <rouilj@ieee.org>
parents: 6919
diff changeset
85 run: |
b3fb615b81c4 get info about sqlite version
John Rouillard <rouilj@ieee.org>
parents: 6919
diff changeset
86 python -c "import sys; print('python version: ', sys.version)"
6924
e57018b1c56f grr, getting tired.....
John Rouillard <rouilj@ieee.org>
parents: 6922
diff changeset
87 python -c "import sqlite3; print('sqlite3 version, sqlite version: ', sqlite3.version, sqlite3.sqlite_version)"
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
88
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
89 # Install the databases
6852
8ffb859b01dd more fixes.
John Rouillard <rouilj@ieee.org>
parents: 6851
diff changeset
90 - name: Install mysql/mariadb
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
91 run: |
6878
81d811b8d45f set full python version string; other cleanups
John Rouillard <rouilj@ieee.org>
parents: 6877
diff changeset
92 #set -xv
81d811b8d45f set full python version string; other cleanups
John Rouillard <rouilj@ieee.org>
parents: 6877
diff changeset
93 # mysql is pre-installed and active but this is the install command
81d811b8d45f set full python version string; other cleanups
John Rouillard <rouilj@ieee.org>
parents: 6877
diff changeset
94 # sudo apt-get install mysql-server mysql-client
6841
3671c0f6352e More fixes to yaml using linter:
John Rouillard <rouilj@ieee.org>
parents: 6840
diff changeset
95 # set up mysql database
6870
b040642efae3 mysql sleep and more debug
John Rouillard <rouilj@ieee.org>
parents: 6869
diff changeset
96 sudo sed -i -e '/^\[mysqld\]/,/^\[mysql/s/^#* *max_allowed_packet.*/max_allowed_packet = 500M/' /etc/mysql/mysql.conf.d/mysqld.cnf; sleep 3
6878
81d811b8d45f set full python version string; other cleanups
John Rouillard <rouilj@ieee.org>
parents: 6877
diff changeset
97 #tail -n +0 /etc/mysql/my.cnf /etc/mysql/mysql.conf.d/mysqld.cnf
81d811b8d45f set full python version string; other cleanups
John Rouillard <rouilj@ieee.org>
parents: 6877
diff changeset
98 #grep max_allowed /etc/mysql/mysql.conf.d/mysqld.cnf
81d811b8d45f set full python version string; other cleanups
John Rouillard <rouilj@ieee.org>
parents: 6877
diff changeset
99 #ls /etc/mysql/conf.d/ /etc/mysql/mysql.conf.d/
81d811b8d45f set full python version string; other cleanups
John Rouillard <rouilj@ieee.org>
parents: 6877
diff changeset
100 #sleep 5
81d811b8d45f set full python version string; other cleanups
John Rouillard <rouilj@ieee.org>
parents: 6877
diff changeset
101 sudo service mysql restart
81d811b8d45f set full python version string; other cleanups
John Rouillard <rouilj@ieee.org>
parents: 6877
diff changeset
102 #sleep 10
81d811b8d45f set full python version string; other cleanups
John Rouillard <rouilj@ieee.org>
parents: 6877
diff changeset
103 #ps -ef | grep mysqld
81d811b8d45f set full python version string; other cleanups
John Rouillard <rouilj@ieee.org>
parents: 6877
diff changeset
104 #sudo netstat -anp | grep mysqld
6877
ac2b8a8f5727 fix mysql SQL to create user and grant. set max jobs in parallel
John Rouillard <rouilj@ieee.org>
parents: 6876
diff changeset
105 sudo mysql -u root -proot -e 'CREATE USER "rounduptest"@"localhost" IDENTIFIED WITH mysql_native_password BY "rounduptest"; GRANT ALL on rounduptest.* TO "rounduptest"@"localhost";'
6873
8dab742710b6 null pw??
John Rouillard <rouilj@ieee.org>
parents: 6872
diff changeset
106
8dab742710b6 null pw??
John Rouillard <rouilj@ieee.org>
parents: 6872
diff changeset
107 - name: Install postgres
8dab742710b6 null pw??
John Rouillard <rouilj@ieee.org>
parents: 6872
diff changeset
108 run: |
8dab742710b6 null pw??
John Rouillard <rouilj@ieee.org>
parents: 6872
diff changeset
109 sudo apt-get install postgresql
6875
f1f947f6e476 try password found at
John Rouillard <rouilj@ieee.org>
parents: 6874
diff changeset
110 # Disable fsync for speed, don't care about data durability
f1f947f6e476 try password found at
John Rouillard <rouilj@ieee.org>
parents: 6874
diff changeset
111 # when testing
6873
8dab742710b6 null pw??
John Rouillard <rouilj@ieee.org>
parents: 6872
diff changeset
112 sudo sed -i -e '$a\fsync = off' /etc/postgresql/*/*/postgresql.conf
6878
81d811b8d45f set full python version string; other cleanups
John Rouillard <rouilj@ieee.org>
parents: 6877
diff changeset
113 sudo service postgresql restart; sleep 10
6873
8dab742710b6 null pw??
John Rouillard <rouilj@ieee.org>
parents: 6872
diff changeset
114 # set up postgresql database
8dab742710b6 null pw??
John Rouillard <rouilj@ieee.org>
parents: 6872
diff changeset
115 sudo -u postgres psql -c "CREATE ROLE rounduptest WITH CREATEDB LOGIN PASSWORD 'rounduptest';" -U postgres
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
116
6864
7e907d97deb6 redis, gpg, more myql debugging
John Rouillard <rouilj@ieee.org>
parents: 6863
diff changeset
117 - name: install redis
6865
e69b4bfaccd3 pip redis in, fix markdown2 test, install ReST, mysql edit
John Rouillard <rouilj@ieee.org>
parents: 6864
diff changeset
118 run: |
e69b4bfaccd3 pip redis in, fix markdown2 test, install ReST, mysql edit
John Rouillard <rouilj@ieee.org>
parents: 6864
diff changeset
119 sudo apt-get install redis
e69b4bfaccd3 pip redis in, fix markdown2 test, install ReST, mysql edit
John Rouillard <rouilj@ieee.org>
parents: 6864
diff changeset
120 pip install redis
6864
7e907d97deb6 redis, gpg, more myql debugging
John Rouillard <rouilj@ieee.org>
parents: 6863
diff changeset
121
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
122 - name: Update pip
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
123 run: python -m pip install --upgrade pip
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
124
6878
81d811b8d45f set full python version string; other cleanups
John Rouillard <rouilj@ieee.org>
parents: 6877
diff changeset
125 - name: Install python db libraries
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
126 run: pip install psycopg2 mysqlclient
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
127
6865
e69b4bfaccd3 pip redis in, fix markdown2 test, install ReST, mysql edit
John Rouillard <rouilj@ieee.org>
parents: 6864
diff changeset
128 - name: Install auxiliary packages
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
129 run: |
6850
ce3f39195a68 updates and remove tab from yml.
John Rouillard <rouilj@ieee.org>
parents: 6849
diff changeset
130 sudo apt-get install swig gpgsm libgpgme-dev
6865
e69b4bfaccd3 pip redis in, fix markdown2 test, install ReST, mysql edit
John Rouillard <rouilj@ieee.org>
parents: 6864
diff changeset
131 # pygments for markdown2 to highlight code blocks
e69b4bfaccd3 pip redis in, fix markdown2 test, install ReST, mysql edit
John Rouillard <rouilj@ieee.org>
parents: 6864
diff changeset
132 pip install markdown2 pygments
e69b4bfaccd3 pip redis in, fix markdown2 test, install ReST, mysql edit
John Rouillard <rouilj@ieee.org>
parents: 6864
diff changeset
133 # docutils for ReStructuredText
6866
a3ad2d1a4ea1 spec mistune version; force socket on mysql invocation
John Rouillard <rouilj@ieee.org>
parents: 6865
diff changeset
134 pip install beautifulsoup4 brotli docutils gpg jinja2 \
a3ad2d1a4ea1 spec mistune version; force socket on mysql invocation
John Rouillard <rouilj@ieee.org>
parents: 6865
diff changeset
135 mistune==0.8.4 pyjwt pytz whoosh
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
136
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
137 - name: Install aux packages that need versions differences
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
138 # if zstd fails install, keep going with test, don't abort
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
139 run: |
6842
d8d4600c49eb More fixes to yaml using linter:
John Rouillard <rouilj@ieee.org>
parents: 6841
diff changeset
140 set -xv
6840
8ee17804086e untabify yml file.
John Rouillard <rouilj@ieee.org>
parents: 6839
diff changeset
141 pip install zstd || true
6861
097578791f7b mysql verbose and remove -u
John Rouillard <rouilj@ieee.org>
parents: 6860
diff changeset
142 if [[ "$PYTHON_VERSION" != "2."* ]]; then
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
143 pip install Markdown; fi
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
144
6867
25487b21f812 add xapian build/install
John Rouillard <rouilj@ieee.org>
parents: 6866
diff changeset
145 - name: Install xapian
25487b21f812 add xapian build/install
John Rouillard <rouilj@ieee.org>
parents: 6866
diff changeset
146 run: |
25487b21f812 add xapian build/install
John Rouillard <rouilj@ieee.org>
parents: 6866
diff changeset
147 sudo apt-get install libxapian-dev
25487b21f812 add xapian build/install
John Rouillard <rouilj@ieee.org>
parents: 6866
diff changeset
148 # Sphinx required to build the xapian python bindings. Use 1.8.5 on
25487b21f812 add xapian build/install
John Rouillard <rouilj@ieee.org>
parents: 6866
diff changeset
149 # older python and newest on newer.
25487b21f812 add xapian build/install
John Rouillard <rouilj@ieee.org>
parents: 6866
diff changeset
150 if [[ $PYTHON_VERSION == "2."* ]]; then pip install sphinx==1.8.5; fi
25487b21f812 add xapian build/install
John Rouillard <rouilj@ieee.org>
parents: 6866
diff changeset
151 if [[ $PYTHON_VERSION == '3.'* ]] ; then pip install sphinx; fi
25487b21f812 add xapian build/install
John Rouillard <rouilj@ieee.org>
parents: 6866
diff changeset
152 XAPIAN_VER=$(dpkg -l libxapian-dev | tail -n 1 | awk '{print $3}' | cut -d '-' -f 1); echo $XAPIAN_VER
25487b21f812 add xapian build/install
John Rouillard <rouilj@ieee.org>
parents: 6866
diff changeset
153 cd /tmp
25487b21f812 add xapian build/install
John Rouillard <rouilj@ieee.org>
parents: 6866
diff changeset
154 curl -s -O https://oligarchy.co.uk/xapian/$XAPIAN_VER/xapian-bindings-$XAPIAN_VER.tar.xz
25487b21f812 add xapian build/install
John Rouillard <rouilj@ieee.org>
parents: 6866
diff changeset
155 tar -Jxvf xapian-bindings-$XAPIAN_VER.tar.xz
25487b21f812 add xapian build/install
John Rouillard <rouilj@ieee.org>
parents: 6866
diff changeset
156 cd xapian-bindings-$XAPIAN_VER/
25487b21f812 add xapian build/install
John Rouillard <rouilj@ieee.org>
parents: 6866
diff changeset
157 if [[ $PYTHON_VERSION == "2."* ]]; then ./configure --prefix=$VIRTUAL_ENV --with-python --disable-documentation; fi
25487b21f812 add xapian build/install
John Rouillard <rouilj@ieee.org>
parents: 6866
diff changeset
158 # edit the configure script.
25487b21f812 add xapian build/install
John Rouillard <rouilj@ieee.org>
parents: 6866
diff changeset
159 # distutils.sysconfig.get_config_vars('SO') doesn't work for
25487b21f812 add xapian build/install
John Rouillard <rouilj@ieee.org>
parents: 6866
diff changeset
160 # 3.11 or newer.
25487b21f812 add xapian build/install
John Rouillard <rouilj@ieee.org>
parents: 6866
diff changeset
161 # Change distutils.sysconfig... to just sysconfig and SO
25487b21f812 add xapian build/install
John Rouillard <rouilj@ieee.org>
parents: 6866
diff changeset
162 # to EXT_SUFFIX to get valid value.
25487b21f812 add xapian build/install
John Rouillard <rouilj@ieee.org>
parents: 6866
diff changeset
163 if [[ $PYTHON_VERSION == "3."* ]]; then sed -i -e '/PYTHON3_SO=/s/distutils\.//g' -e '/PYTHON3_SO=/s/"SO"/"EXT_SUFFIX"/g' configure; ./configure --prefix=$VIRTUAL_ENV --with-python3 --disable-documentation; fi
6868
5aee1b6ffb52 sudo make install; add 3.11 python.
John Rouillard <rouilj@ieee.org>
parents: 6867
diff changeset
164 case "$PYTHON_VERSION" in nightly) echo skipping xapian build;; *) make && sudo make install; esac
6867
25487b21f812 add xapian build/install
John Rouillard <rouilj@ieee.org>
parents: 6866
diff changeset
165
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
166 - name: Install pytest and other packages needed for running tests
6914
6010c20dc104 add mock package for testing
John Rouillard <rouilj@ieee.org>
parents: 6904
diff changeset
167 run: pip install codecov flake8 mock pytest pytest-cov requests
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
168
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
169 - name: Test build roundup and install locale so lang tests work.
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
170 run: |
6855
30815d9bd95c fix tab
John Rouillard <rouilj@ieee.org>
parents: 6854
diff changeset
171 sudo apt-get install gettext
6854
4f115313e262 install gettext for locale
John Rouillard <rouilj@ieee.org>
parents: 6853
diff changeset
172 python setup.py build
6840
8ee17804086e untabify yml file.
John Rouillard <rouilj@ieee.org>
parents: 6839
diff changeset
173 (cd locale; make local_install; ls -lR locale/de/LC_MESSAGES)
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
174
6843
c61ab02ad067 fix syntax error name can not include :
John Rouillard <rouilj@ieee.org>
parents: 6842
diff changeset
175 - name: run flake8 - abort for syntax error, otherwise warn only
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
176 run: |
6840
8ee17804086e untabify yml file.
John Rouillard <rouilj@ieee.org>
parents: 6839
diff changeset
177 # stop the build for Python syntax errors or undefined names
6857
a346b5d23480 flake8 fixes.
John Rouillard <rouilj@ieee.org>
parents: 6855
diff changeset
178 # talgettext is a utility function ignore it.
a346b5d23480 flake8 fixes.
John Rouillard <rouilj@ieee.org>
parents: 6855
diff changeset
179 flake8 roundup --count --select=E9,F63,F7,F82 --show-source --statistics --extend-exclude talgettext.py
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
180 # exit-zero treats all errors as warnings.
6840
8ee17804086e untabify yml file.
John Rouillard <rouilj@ieee.org>
parents: 6839
diff changeset
181 # The GitHub editor is 127 chars wide
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
182 flake8 roundup --count --exit-zero --max-complexity=10 --max-line-length=127 --statistics
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
183
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
184 # Run the tests using pytest with test files in tests directory.
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
185 - name: Run tests
6858
John Rouillard <rouilj@ieee.org>
parents: 6857
diff changeset
186 run: |
6861
097578791f7b mysql verbose and remove -u
John Rouillard <rouilj@ieee.org>
parents: 6860
diff changeset
187 if [[ "$PYTHON_VERSION" != "2."* ]]; then
6858
John Rouillard <rouilj@ieee.org>
parents: 6857
diff changeset
188 pytest -r a \
John Rouillard <rouilj@ieee.org>
parents: 6857
diff changeset
189 -W default \
John Rouillard <rouilj@ieee.org>
parents: 6857
diff changeset
190 -W "ignore:SelectableGroups:DeprecationWarning" \
John Rouillard <rouilj@ieee.org>
parents: 6857
diff changeset
191 -W "ignore:the imp module:DeprecationWarning:gpg.gpgme:15" \
John Rouillard <rouilj@ieee.org>
parents: 6857
diff changeset
192 -W "ignore:'U' mode::docutils.io" \
John Rouillard <rouilj@ieee.org>
parents: 6857
diff changeset
193 -W "ignore:unclosed:ResourceWarning:roundup.roundup.demo" \
John Rouillard <rouilj@ieee.org>
parents: 6857
diff changeset
194 -W "ignore:unclosed file:ResourceWarning:enum" \
6919
4076c5cfd682 remove limit on test failures for github actions.
John Rouillard <rouilj@ieee.org>
parents: 6914
diff changeset
195 -v test/ --cov=roundup
6948
078073f7d207 coveralls for 3.x only, add paralle unique build key
John Rouillard <rouilj@ieee.org>
parents: 6947
diff changeset
196 codecov lcov
6858
John Rouillard <rouilj@ieee.org>
parents: 6857
diff changeset
197 else
John Rouillard <rouilj@ieee.org>
parents: 6857
diff changeset
198 # python2 case
6919
4076c5cfd682 remove limit on test failures for github actions.
John Rouillard <rouilj@ieee.org>
parents: 6914
diff changeset
199 pytest -v -r a test/ --cov=roundup
6858
John Rouillard <rouilj@ieee.org>
parents: 6857
diff changeset
200 fi
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
201
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
202 - name: Upload coverage to Codecov
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
203 # see: https://github.com/codecov/codecov-action#usage
6840
8ee17804086e untabify yml file.
John Rouillard <rouilj@ieee.org>
parents: 6839
diff changeset
204 uses: codecov/codecov-action@v3
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
205 with:
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
206 verbose: true
6881
ae3d98c1fb69 fix tab.
John Rouillard <rouilj@ieee.org>
parents: 6880
diff changeset
207 token: ${{ secrets.CODECOV_TOKEN }}
6839
6e1a82c3addb Add GitHub Actions test workflow.
John Rouillard <rouilj@ieee.org>
parents:
diff changeset
208
6945
7eb0e1cffe54 indentation fix.
John Rouillard <rouilj@ieee.org>
parents: 6944
diff changeset
209 - name: Upload coverage to Coveralls
6948
078073f7d207 coveralls for 3.x only, add paralle unique build key
John Rouillard <rouilj@ieee.org>
parents: 6947
diff changeset
210 # python 2.7 version of codecov can't produce lcov files.
078073f7d207 coveralls for 3.x only, add paralle unique build key
John Rouillard <rouilj@ieee.org>
parents: 6947
diff changeset
211 if: matrix.python-version != '2.7'
6945
7eb0e1cffe54 indentation fix.
John Rouillard <rouilj@ieee.org>
parents: 6944
diff changeset
212 uses: coverallsapp/github-action@master
7eb0e1cffe54 indentation fix.
John Rouillard <rouilj@ieee.org>
parents: 6944
diff changeset
213 with:
7eb0e1cffe54 indentation fix.
John Rouillard <rouilj@ieee.org>
parents: 6944
diff changeset
214 github-token: ${{ secrets.GITHUB_TOKEN }}
6948
078073f7d207 coveralls for 3.x only, add paralle unique build key
John Rouillard <rouilj@ieee.org>
parents: 6947
diff changeset
215 path-to-lcov: coverage.lcov
078073f7d207 coveralls for 3.x only, add paralle unique build key
John Rouillard <rouilj@ieee.org>
parents: 6947
diff changeset
216 parallel: run-{{ matrix.python-version }}-{{ matrix.os }}
6943
3b081f5c8fc2 add coveralls as codecov is severly broken.
John Rouillard <rouilj@ieee.org>
parents: 6924
diff changeset
217
6945
7eb0e1cffe54 indentation fix.
John Rouillard <rouilj@ieee.org>
parents: 6944
diff changeset
218 - name: test build_doc
6946
f1912f901aa6 more indentation fixes.
John Rouillard <rouilj@ieee.org>
parents: 6945
diff changeset
219 run: |
f1912f901aa6 more indentation fixes.
John Rouillard <rouilj@ieee.org>
parents: 6945
diff changeset
220 python ./setup.py build_doc
6880
222e84d12bed schedule build 7PM on first of month; commented out docker tst
John Rouillard <rouilj@ieee.org>
parents: 6879
diff changeset
221
6893
d668e2800147 more debug
John Rouillard <rouilj@ieee.org>
parents: 6892
diff changeset
222 #- name: test docker build current version ubuntu-latest
6904
92b64fd3341f cleanup, comments ready for production.
John Rouillard <rouilj@ieee.org>
parents: 6903
diff changeset
223 # if: matrix.python-version == '3.10' && matrix.os == 'ubuntu-latest'
6880
222e84d12bed schedule build 7PM on first of month; commented out docker tst
John Rouillard <rouilj@ieee.org>
parents: 6879
diff changeset
224 # run: |
222e84d12bed schedule build 7PM on first of month; commented out docker tst
John Rouillard <rouilj@ieee.org>
parents: 6879
diff changeset
225 # docker build -t roundup-app-dev -f scripts/Docker/Dockerfile .
222e84d12bed schedule build 7PM on first of month; commented out docker tst
John Rouillard <rouilj@ieee.org>
parents: 6879
diff changeset
226 # mkdir tracker; chmod 777 tracker
222e84d12bed schedule build 7PM on first of month; commented out docker tst
John Rouillard <rouilj@ieee.org>
parents: 6879
diff changeset
227 # docker run -d --rm -p 9017:8080 \
222e84d12bed schedule build 7PM on first of month; commented out docker tst
John Rouillard <rouilj@ieee.org>
parents: 6879
diff changeset
228 # -v $PWD/tracker:/usr/src/app/tracker \
222e84d12bed schedule build 7PM on first of month; commented out docker tst
John Rouillard <rouilj@ieee.org>
parents: 6879
diff changeset
229 # roundup-app-dev:latest demo
222e84d12bed schedule build 7PM on first of month; commented out docker tst
John Rouillard <rouilj@ieee.org>
parents: 6879
diff changeset
230 # expect 200
222e84d12bed schedule build 7PM on first of month; commented out docker tst
John Rouillard <rouilj@ieee.org>
parents: 6879
diff changeset
231 # curl --fail http://localhost:9017/demo/ > /dev/null
222e84d12bed schedule build 7PM on first of month; commented out docker tst
John Rouillard <rouilj@ieee.org>
parents: 6879
diff changeset
232
222e84d12bed schedule build 7PM on first of month; commented out docker tst
John Rouillard <rouilj@ieee.org>
parents: 6879
diff changeset
233 #- name: test docker build released pip version
222e84d12bed schedule build 7PM on first of month; commented out docker tst
John Rouillard <rouilj@ieee.org>
parents: 6879
diff changeset
234 # run: |
222e84d12bed schedule build 7PM on first of month; commented out docker tst
John Rouillard <rouilj@ieee.org>
parents: 6879
diff changeset
235 # docker build -t roundup-app-rel --build-arg="source=pypi" \
222e84d12bed schedule build 7PM on first of month; commented out docker tst
John Rouillard <rouilj@ieee.org>
parents: 6879
diff changeset
236 # -f scripts/Docker/Dockerfile .
6943
3b081f5c8fc2 add coveralls as codecov is severly broken.
John Rouillard <rouilj@ieee.org>
parents: 6924
diff changeset
237
3b081f5c8fc2 add coveralls as codecov is severly broken.
John Rouillard <rouilj@ieee.org>
parents: 6924
diff changeset
238
3b081f5c8fc2 add coveralls as codecov is severly broken.
John Rouillard <rouilj@ieee.org>
parents: 6924
diff changeset
239 # in parallel build codecov requires a finish step
6945
7eb0e1cffe54 indentation fix.
John Rouillard <rouilj@ieee.org>
parents: 6944
diff changeset
240 finish:
7eb0e1cffe54 indentation fix.
John Rouillard <rouilj@ieee.org>
parents: 6944
diff changeset
241 needs: test
7eb0e1cffe54 indentation fix.
John Rouillard <rouilj@ieee.org>
parents: 6944
diff changeset
242 runs-on: ubuntu-latest
7eb0e1cffe54 indentation fix.
John Rouillard <rouilj@ieee.org>
parents: 6944
diff changeset
243 steps:
7eb0e1cffe54 indentation fix.
John Rouillard <rouilj@ieee.org>
parents: 6944
diff changeset
244 - name: Coveralls Finished
7eb0e1cffe54 indentation fix.
John Rouillard <rouilj@ieee.org>
parents: 6944
diff changeset
245 uses: coverallsapp/github-action@master
7eb0e1cffe54 indentation fix.
John Rouillard <rouilj@ieee.org>
parents: 6944
diff changeset
246 with:
7eb0e1cffe54 indentation fix.
John Rouillard <rouilj@ieee.org>
parents: 6944
diff changeset
247 github-token: ${{ secrets.github_token }}
7eb0e1cffe54 indentation fix.
John Rouillard <rouilj@ieee.org>
parents: 6944
diff changeset
248 parallel-finished: true
Roundup Issue Tracker: http://roundup-tracker.org/