Why am I seeing Jupyter rate limit errors?

andrea.loweandrea.lowe Member, Moderator, Domino Posts: 27 mod

If you are running a Jupyter notebook with various visualizations, you may encounter the following error:

IOPub data rate exceeded.
The notebook server will temporarily stop sending output
to the client in order to avoid crashing it.
To change this limit, set the config variable
`--NotebookApp.iopub_data_rate_limit`.

This indicates that the maximum rate at which stream output can be sent on iopub has been reached. You can avoid this by configuring a higher limit. Here's how to do it in the pre-setup script of a custom environment definition:

echo "c.NotebookApp.iopub_data_rate_limit = 1000000000" >> /home/ubuntu/.jupyter/jupyter_notebook_config.py && \
chown -R ubuntu:ubuntu /home/ubuntu/.jupyter

Note the chown command - this is needed because the pre-setup script runs as the root user, so the file ownership must be changed back to the ubuntu user in order to avoid a permissions error during your run. Also note that some deployments may have this configuration file under /domino instead of /ubuntu, this can be checked by opening a terminal in one of your workspace sessions.

Sign In or Register to comment.