Why am I seeing Jupyter rate limit errors?

andrea.loweandrea.lowe Member, Moderator, Domino Posts: 27 mod

If you are running a Jupyter notebook with various visualizations, you may encounter the following error:

IOPub data rate exceeded.
The notebook server will temporarily stop sending output
to the client in order to avoid crashing it.
To change this limit, set the config variable

This indicates that the maximum rate at which stream output can be sent on iopub has been reached. You can avoid this by configuring a higher limit. Here's how to do it in the pre-setup script of a custom environment definition:

echo "c.NotebookApp.iopub_data_rate_limit = 1000000000" >> /home/ubuntu/.jupyter/jupyter_notebook_config.py && \
chown -R ubuntu:ubuntu /home/ubuntu/.jupyter

Note the chown command - this is needed because the pre-setup script runs as the root user, so the file ownership must be changed back to the ubuntu user in order to avoid a permissions error during your run. Also note that some deployments may have this configuration file under /domino instead of /ubuntu, this can be checked by opening a terminal in one of your workspace sessions.

Sign In or Register to comment.