Why am I seeing Jupyter rate limit errors?
If you are running a Jupyter notebook with various visualizations, you may encounter the following error:
IOPub data rate exceeded. The notebook server will temporarily stop sending output to the client in order to avoid crashing it. To change this limit, set the config variable `--NotebookApp.iopub_data_rate_limit`.
This indicates that the maximum rate at which stream output can be sent on iopub has been reached. You can avoid this by configuring a higher limit. Here's how to do it in the pre-setup script of a custom environment definition:
echo "c.NotebookApp.iopub_data_rate_limit = 1000000000" >> /home/ubuntu/.jupyter/jupyter_notebook_config.py && \ chown -R ubuntu:ubuntu /home/ubuntu/.jupyter
Note the chown command - this is needed because the pre-setup script runs as the root user, so the file ownership must be changed back to the ubuntu user in order to avoid a permissions error during your run. Also note that some deployments may have this configuration file under /domino instead of /ubuntu, this can be checked by opening a terminal in one of your workspace sessions.