Installation using pip¶
Dataduct can easily be installed using pip with the following commands.
pip install dataduct
The major dependencies of dataduct are:
botogreater than version 2.34, older versions are missing some of the functionality provided by EMR
Ensure that a boto config file containing proper AWS credentials is present.
The visualizations are created using:
Autocomplete for the CLI is supported using:
The documentation is created using:
Installing in the developer environment¶
1. Clone the Repo¶
git clone https://github.com/coursera/dataduct.git
2. Update PATH and PYTHONPATH¶
Add these lines into your
.zshrc etc based on
your shell type.
export PYTHONPATH=~/dataduct:$PYTHONPATH export PATH=~/dataduct/bin:$PATH
Create a config file. Instructions for this are provided in the config section.
Install argcomplete with
pip install argcomplete.
If you’re using
bash then add the following to your
eval "$(register-python-argcomplete dataduct)"
if you’re using
zsh then add the following line to your
autoload bashcompinit bashcompinit eval "$(register-python-argcomplete dataduct)"