Development Environment#
Follow the steps below to get an OpenDP development environment set up, including the ability to run tests in both Rust and Python.
Install the Rust toolchain.
Install Python version 3.7 or higher.
Clone the OpenDP Repo#
If you want to submit PRs, but don’t have write access to the OpenDP repository, you will either need to request to join the organization or make a fork. The GitHub documentation explains forking.
Clone the repo (or your fork) and change into the opendp directory that’s created.
git clone git@github.com:opendp/opendp.git
cd opendp
If you have not set up SSH, you can clone with https instead:
git clone https://github.com/opendp/opendp.git
Build OpenDP#
Next, you’ll need to build the Rust binaries.
This is done by running cargo build in the rust subdirectory of the repo.
cd rust
cargo build --features untrusted,bindings-python
This will compile a debug build of the OpenDP shared library, placing it in the directory opendp/rust/target/debug.
(The specific name of the library file will vary depending on your platform.)
Substitute cargo build with cargo test, cargo doc or cargo check to test, build rust documentation, or run a lightweight check that the code is valid.
In the above command, the features untrusted and bindings-python are enabled.
Setting a feature changes how the crate compiles:
Feature List
Name |
Description |
|---|---|
|
Enables untrusted features |
|
Enable to include constructors that have not passed the vetting process. |
|
Enable to include measurements with floating-point vulnerabilities. |
|
Enables the |
|
Enable to include C foreign function interfaces. |
|
Enable to use the system installation of MPFR. |
|
Already enabled. Use MPFR for exact floating-point arithmetic. |
|
Already enabled. Use OpenSSL for secure noise generation. |
To make the crate compile faster, ffi functions in debug builds support a reduced set of primitive types.
Release-mode builds support the full set of primitive types and undergo compiler optimizations, but take longer to compile.
You can compile a release build by adding the --release flag.
In contrast to debug builds, release builds are located in opendp/rust/target/release.
To use a release-mode binary from the python bindings,
set the environment variable OPENDP_TEST_RELEASE=1 before importing OpenDP.
If you run into compilation problems, please contact us! We also have a Developer Frequently Asked Questions with some common issues.
Note
There is a more involved setup guide for Windows users.
You can compromise to simple and vulnerable builds instead, by adding the --no-default-features flag to cargo commands.
Be advised this flag disables GMP’s exact float handling, as well as OpenSSL’s secure noise generation.
Python Setup#
You can install a local Python package that uses your new OpenDP binary.
We recommend setting up a virtual environment first, but this is optional:
Virtual Environment
# recommended. conda is just as valid
python3 -m venv opendp
source opendp/bin/activate
Change to the python directory, install dependencies, and then install the Python OpenDP library itself.
cd python
pip install flake8 pytest
pip install -e .
The -e flag is significant! It stands for “editable”, meaning you only have to run this command once. At this point, you should be able use OpenDP as a locally installed package.
Testing Python#
You can test that things are working by running OpenDP’s python test suite, using pytest.
Run the tests from the python directory.
pytest -v
If everything has gone well, you’ll see a bunch of output, then a line similar to this:
================== 57 passed in 1.02s ==================
If pytest is not found, don’t forget to activate your virtual environment!
This is just a quick overview of building OpenDP. If you’re interested in porting OpenDP to a different platform, we’d be delighted to get your help; please contact us!
Documentation#
The source for this documentation website can be found in the “docs” directory at opendp/opendp
Building the Docs#
The docs are built using Sphinx and the steps are listed in the README in the “docs” directory.
Developer Tooling#
There are many development environments that work with Rust. Here are a few:
Use whatever tooling you are comfortable with.
A few notes on VS Code:
Be sure to install the rust-analyzer plugin, not the rust plugin
Open
rust-analyzer’s extension settings, search “features” and add"untrusted", "bindings-python"Look for
Problemsin the bottom panel for live compilation errors as you workOther useful extensions are “Better Toml”, “crates” and “LaTex Workshop”
Starter json configurations:
Expand Me
Starter /.vscode/tasks.json.
These tasks can be used to directly build or test OpenDP.
See also the VSCode documentation on tasks.
{
"version": "2.0.0",
"tasks": [
{
"type": "cargo",
"command": "build",
"problemMatcher": {
"base": "$rustc",
"fileLocation": ["autodetect", "${workspaceFolder}/rust"],
},
"options": {
"cwd": "./rust"
},
"args": [
"--features", "untrusted"
],
"group": "build",
"label": "rust: cargo build",
"presentation": {
"clear": true
}
},
{
"type": "cargo",
"command": "build",
"problemMatcher": {
"base": "$rustc",
"fileLocation": ["autodetect", "${workspaceFolder}/rust"],
},
"options": {
"cwd": "./rust"
},
"args": [
"--features", "bindings-python untrusted"
],
"group": "build",
"label": "rust: cargo build ffi",
"presentation": {
"clear": true
}
},
{
"type": "cargo",
"command": "test",
"problemMatcher": {
"base": "$rustc",
"fileLocation": ["autodetect", "${workspaceFolder}/rust"],
},
"options": {
"cwd": "./rust"
},
"args": [
"--features", "bindings-python untrusted"
],
"group": "build",
"label": "rust: cargo test ffi",
"presentation": {
"clear": true
}
}
]
}
Starter settings.json for LaTex Workshop.
Access this file through the LaTex Workshop extension settings.
This configuration emits outputs into ./out/
{
"latex-workshop.latex.outDir": "%DIR%/out/",
"latex-workshop.latex.recipes": [
{
"name": "latexmk",
"tools": [
"latexmk"
]
}
],
"latex-workshop.latex.tools": [
{
"name": "latexmk",
"command": "latexmk",
"args": [
"-synctex=1",
"-interaction=nonstopmode",
"-file-line-error",
"-recorder",
"-pdf",
"--shell-escape",
"-aux-directory=out",
"-output-directory=out",
"%DOC%"
]
},
{
"name": "pdflatex",
"command": "pdflatex",
"args": [
"-synctex=1",
"-interaction=nonstopmode",
"-file-line-error",
"-aux-directory=out",
"-output-directory=out",
"%DOC%"
]
}
],
"latex-workshop.view.pdf.viewer": "tab"
}
A few notes on Intellij IDEA:
Both Intellij IDEA community edition and the CodeWithMe plugin are free
Be sure to open the project at the root of the git repository
Be sure to install the Python and Rust plugins for interactivity
Be sure to “attach” the Cargo.toml in the red banner the first time you open a Rust source file
Use run configurations to build the rust library and run tests