tap-github is a Singer tap for GitHub.
Build with the Singer SDK.
-
Developer TODO:Update the below as needed to correctly describe the install procedure. For instance, if you do not have a PyPi repo, or if you want users to directly install from your git repo, you can modify this step as appropriate.
pipx install tap-github-
Developer TODO:Provide a list of config options accepted by the tap.
A full list of supported settings and capabilities for this tap is available by running:
tap-github --about-
Developer TODO:If your tap requires special access on the source system, or any special authentication requirements, provide those here.
You can easily run tap-github by itself or in a pipeline using Meltano.
tap-github --version
tap-github --help
tap-github --config CONFIG --discover > ./catalog.json-
Developer TODO:As a first step, scan the entire project for the text "TODO:" and complete any recommended steps, deleting the "TODO" references once completed.
pipx install poetry
poetry installCreate tests within the tap_github/tests subfolder and
then run:
poetry run pytestYou can also test the tap-github CLI interface directly using poetry run:
poetry run tap-github --helpTesting with Meltano
Note: This tap will work in any Singer environment and does not require Meltano. Examples here are for convenience and to streamline end-to-end orchestration scenarios.
Your project comes with a custom meltano.yml project file already created. Open the meltano.yml and follow any "TODO" items listed in
the file.
Next, install Meltano (if you haven't already) and any needed plugins:
# Install meltano
pipx install meltano
# Initialize meltano within this directory
cd tap-github
meltano installNow you can test and orchestrate using Meltano:
# Test invocation:
meltano invoke tap-github --version
# OR run a test `elt` pipeline:
meltano elt tap-github target-jsonlOne-liner to recreate output directory, run elt, and write out state file:
# Update this when you want a fresh state file:
TESTJOB=testjob1
# Run everything in one line
mkdir -p .output && meltano elt tap-github target-jsonl --job_id $TESTJOB && meltano elt tap-github target-jsonl --job_id $TESTJOB --dump=state > .output/state.jsonSee the dev guide for more instructions on how to use the Singer SDK to develop your own taps and targets.