Part of Using Databricks in the NHS England Secure Data Environment
Using the SDE Package Manager
The SDE Package Manager allows you to install pre-approved packages through CRAN and Pypi Mirrors for use with Databricks.
Each Databricks cluster will still have a set of pre-installed packages that can be used when working in Databricks notebooks.
You can install packages from the Package Manager directly into your notebook.
Notebook-scoped packages do not persist and will need to be installed each time you open a new notebook.
Installing Python pacakges
To install a package, enter and run this in a notebook cell:
%pip install --index-url https://packages.sde.digital.nhs.uk/repository/pypi-mirror/simple [package name]
Installing R packages
To install a package, enter and run this in a notebook cell:
install.packages("package name", repos = "https://packages.sde.digital.nhs.uk/repository/cran-mirror/", dependencies = TRUE)
Last edited: 15 March 2024 1:22 pm