Investigate issues with jupyter-contrib-nbextensions for utoronto-configurator #2380

pnasrat · 2023-03-20T13:52:48Z

Context

via https://2i2c.freshdesk.com/a/tickets/554

jupyter-contrib-nbextensions is
installed. I'll note that running jupyter nbextension list shows
"nbextensions_configurator/config_menu/main", but there are "problems
found" with that extension.

jovyan@c97ceffb19a2:~$ pip list | grep jupyter-nbextension 
jupyter-nbextensions-configurator 0.6.1
jovyan@c97ceffb19a2:~$ jupyter nbextension list 
Known nbextensions:
  config dir: /opt/conda/etc/jupyter/nbconfig
    notebook section
      nbextensions_configurator/config_menu/main  enabled 
      - Validating: problems found:
        - require?  X nbextensions_configurator/config_menu/main
      jupyter_resource_usage/main  enabled 
      - Validating: OK
      jupyterlab-plotly/extension  enabled 
      - Validating: OK
      jupytext/index  enabled 
      - Validating: OK
      markus-jupyter-extension/extension  enabled 
      - Validating: OK
      rise/main  enabled 
      - Validating: OK
      voila/extension  enabled 
      - Validating: OK
      jupyter-js-widgets/extension  enabled 
      - Validating: OK
      contrib_nbextensions_help_item/main  enabled 
      - Validating: OK
    tree section
      jupyter_server_proxy/tree  enabled 
      - Validating: OK
      jupyter_tree_download/tree  enabled 
      - Validating: OK
      nbextensions_configurator/tree_tab/main  enabled 
      - Validating: problems found:
        - require?  X nbextensions_configurator/tree_tab/main

Proposal

No response

Updates and actions

No response

The text was updated successfully, but these errors were encountered:

pnasrat · 2023-03-20T13:54:15Z

Jinja2 needs to be pinned for voila but unrelated.

[D 09:48:34.453 NotebookApp] [jupyter_nbextensions_configurator] Loading 0.6.1
[D 09:48:34.454 NotebookApp] [jupyter_nbextensions_configurator]   Editing templates path to add /opt/conda/lib/python3.10/site-packages/jupyter_nbextensions_configurator/templates
[D 09:48:34.454 NotebookApp] [jupyter_nbextensions_configurator]   Editing nbextensions path to add /opt/conda/lib/python3.10/site-packages/jupyter_nbextensions_configurator/static
[D 09:48:34.454 NotebookApp] [jupyter_nbextensions_configurator]   Adding new handlers
[I 09:48:34.455 NotebookApp] [jupyter_nbextensions_configurator] enabled 0.6.1
[W 09:48:36.102 NotebookApp] Loading JupyterLab as a classic notebook (v6) extension.
[I 2023-03-20 09:48:36.116 LabApp] JupyterLab extension loaded from /opt/conda/lib/python3.10/site-packages/jupyterlab
[I 2023-03-20 09:48:36.116 LabApp] JupyterLab application directory is /opt/conda/share/jupyter/lab
[I 09:48:36.226 NotebookApp] [Jupytext Server Extension] Deriving a JupytextContentsManager from LargeFileManager
[W 09:48:36.472 NotebookApp] Error loading server extension voila.server_extension
    Traceback (most recent call last):
      File "/opt/conda/lib/python3.10/site-packages/notebook/notebookapp.py", line 2040, in init_server_extensions
        mod = importlib.import_module(modulename)
      File "/opt/conda/lib/python3.10/importlib/__init__.py", line 126, in import_module
        return _bootstrap._gcd_import(name[level:], package, level)
      File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
      File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
      File "<frozen importlib._bootstrap>", line 992, in _find_and_load_unlocked
      File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
      File "<frozen importlib._bootstrap>", line 1050, in _gcd_import
      File "<frozen importlib._bootstrap>", line 1027, in _find_and_load
      File "<frozen importlib._bootstrap>", line 1006, in _find_and_load_unlocked
      File "<frozen importlib._bootstrap>", line 688, in _load_unlocked
      File "<frozen importlib._bootstrap_external>", line 883, in exec_module
      File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
      File "/opt/conda/lib/python3.10/site-packages/voila/__init__.py", line 11, in <module>
        from .server_extension import _load_jupyter_server_extension # noqa
      File "/opt/conda/lib/python3.10/site-packages/voila/server_extension.py", line 21, in <module>
        from .handler import VoilaHandler
      File "/opt/conda/lib/python3.10/site-packages/voila/handler.py", line 24, in <module>
        from .notebook_renderer import NotebookRenderer
      File "/opt/conda/lib/python3.10/site-packages/voila/notebook_renderer.py", line 24, in <module>
        from .exporter import VoilaExporter
      File "/opt/conda/lib/python3.10/site-packages/voila/exporter.py", line 15, in <module>
        from jinja2 import contextfilter
    ImportError: cannot import name 'contextfilter' from 'jinja2' (/opt/conda/lib/python3.10/site-packages/jinja2/__init__.py)
[I 09:48:36.476 NotebookApp] Serving notebooks from local directory: /home/jovyan
[I 09:48:36.476 NotebookApp] Jupyter Notebook 6.5.3 is running at:
[I 09:48:36.476 NotebookApp] http://localhost:8888/?token=a66242d872cded51b0b60f406db2fe342cead16f040db892
[I 09:48:36.476 NotebookApp]  or http://127.0.0.1:8888/?token=a66242d872cded51b0b60f406db2fe342cead16f040db892
[I 09:48:36.476 NotebookApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation).
[W 09:48:36.484 NotebookApp] No web browser found: could not locate runnable browser.
[C 09:48:36.484 NotebookApp]

pnasrat · 2023-03-20T13:59:06Z

Note the extensions list error may be misleading as I don't see a tb above see also

Jupyter-contrib/jupyter_nbextensions_configurator#37
Jupyter-contrib/jupyter_nbextensions_configurator#131

yuvipanda · 2023-03-20T14:14:39Z

Upgrading jupyter-nbextensions-configurator from 0.5.1 to 0.7 might fix it, perhaps related to Jupyter-contrib/jupyter_nbextensions_configurator#141?

pnasrat · 2023-03-20T14:21:42Z

Issue still appears with:

conda list | grep nbex
jupyter-contrib-nbextensions 0.7.0                    pypi_0    pypi
jupyter-nbextensions-configurator 0.6.1                    pypi_0    pypi
 jupyter nbextension list 
Known nbextensions:
  config dir: /home/jovyan/.jupyter/nbconfig
    notebook section
      nbextensions_configurator/config_menu/main  enabled 
      - Validating: problems found:
        - require?  X nbextensions_configurator/config_menu/main
      contrib_nbextensions_help_item/main  enabled 
      - Validating: OK
      hide_input  enabled 
      - Validating: problems found:
        - require?  X hide_input
    tree section
      nbextensions_configurator/tree_tab/main  enabled 
      - Validating: problems found:
        - require?  X nbextensions_configurator/tree_tab/main
  config dir: /opt/conda/etc/jupyter/nbconfig
    notebook section
      nbextensions_configurator/config_menu/main  enabled 
      - Validating: problems found:
        - require?  X nbextensions_configurator/config_menu/main
      jupyter_resource_usage/main  enabled 
      - Validating: OK
      jupyterlab-plotly/extension  enabled 
      - Validating: OK
      jupytext/index  enabled 
      - Validating: OK
      rise/main  enabled 
      - Validating: OK
      voila/extension  enabled 
      - Validating: OK
      jupyter-js-widgets/extension  enabled 
      - Validating: OK
    tree section
      jupyter_server_proxy/tree  enabled 
      - Validating: OK
      jupyter_tree_download/tree  enabled 
      - Validating: OK
      nbextensions_configurator/tree_tab/main  enabled 
      - Validating: problems found:
        - require?  X nbextensions_configurator/tree_tab/main

pnasrat · 2023-03-20T14:26:10Z

Actually it functionally works with the upgrade but you have to uncheck "disable configuration for nbextensions without explicit compatibility (they may break your notebook environment, but can be useful to show for nbextension development)" as shown with hide input working on the right. The cli breakage is misleading per above

pnasrat · 2023-03-20T14:36:14Z

Emailed community with testing instructions if that works for them. I tested locally on a clean launch of the image run locally via docker. I did the following in a running jupyter notebook --ip 0.0.0.0 launch a terminal and run the below, then refresh the list of extensions.

pip install --upgrade 'jupyter-contrib-nbextensions==0.7.' 
jupyter contrib nbextension install --user

pnasrat · 2023-03-22T14:16:18Z

Community member was unable to fix in the way I documented. I do not yet have access to the utoronto hub. Going to liase with @yuvipanda to see if we can get a work around for them.

yuvipanda · 2023-03-22T15:25:18Z

I tried to see if this was related to the serverapp change (with #2210), but reverting that and deploying to staging had no effect.

I'm upgrading nbcontrib (2i2c-org/utoronto-image#48) to see if that helps.

yuvipanda · 2023-03-22T15:30:39Z

Aha, with a bit more digging, I'm pretty sure the culprit is Jupyter-contrib/jupyter_nbextensions_configurator#152.

I'm going to pin nbclassic<0.5 and see if that fixes things.

Ref 2i2c-org/infrastructure#2380 Can be removed once Jupyter-contrib/jupyter_nbextensions_configurator#152 is fixed.

yuvipanda · 2023-03-22T19:20:01Z

Symptoms alleviated by #2411. We need to figure out what the longer term solution there is.

Following suggestion from Jupyter-contrib/jupyter_nbextensions_configurator#153 that we need to explicilty enable the configurator. nbclassic also has hit 1.0, which might help. Ref 2i2c-org/infrastructure#2380

damianavila · 2023-09-20T18:08:57Z

This is upstream, closing now.

Brings in 2i2c-org/utoronto-image#58, so we no longer have to use the older notebook server. Fixes 2i2c-org#2380 Ref 2i2c-org#2729

yuvipanda · 2023-12-27T23:12:24Z

2i2c-org/utoronto-image#58 actually fixes this, #3550 rolls it out to just the staging utoronto hub. It can be rolled out to prod on Jan 9.

damianavila · 2024-01-18T16:46:47Z

I think this landed into production on Jan 9th, ref: #3598.
Feel free to reopen if you disagree.

pnasrat self-assigned this Mar 20, 2023

github-project-automation bot added this to DEPRECATED Engineering and Product Backlog Mar 20, 2023

github-project-automation bot moved this to Needs Shaping / Refinement in DEPRECATED Engineering and Product Backlog Mar 20, 2023

damianavila added this to Sprint Board Mar 20, 2023

damianavila moved this from Needs Shaping / Refinement to In progress in DEPRECATED Engineering and Product Backlog Mar 20, 2023

damianavila moved this to In Progress ⚡ in Sprint Board Mar 20, 2023

yuvipanda mentioned this issue Mar 22, 2023

Upgrade jupyter_contrib_nbextension 2i2c-org/utoronto-image#48

Merged

yuvipanda added a commit to 2i2c-org/utoronto-image that referenced this issue Mar 22, 2023

Pin nbclassic<0.5 to get nbcontrib extensions to work

9334aa8

Ref 2i2c-org/infrastructure#2380 Can be removed once Jupyter-contrib/jupyter_nbextensions_configurator#152 is fixed.

yuvipanda mentioned this issue Mar 22, 2023

Pin nbclassic<0.5 to get nbcontrib extensions to work 2i2c-org/utoronto-image#49

Merged

yuvipanda mentioned this issue Mar 23, 2023

Migrate UToronto off Classic Notebook to retrolab / notebook v7 #2415

Open

damianavila assigned yuvipanda Mar 29, 2023

damianavila moved this from In progress to Waiting in DEPRECATED Engineering and Product Backlog Jul 5, 2023

pnasrat removed their assignment Jul 11, 2023

damianavila removed this from Sprint Board Jul 12, 2023

yuvipanda removed their assignment Jul 27, 2023

damianavila closed this as completed Sep 20, 2023

github-project-automation bot moved this from Waiting to Complete in DEPRECATED Engineering and Product Backlog Sep 20, 2023

yuvipanda reopened this Dec 27, 2023

yuvipanda added a commit to yuvipanda/pilot-hubs that referenced this issue Dec 27, 2023

Bump utoronto staging image again

7db229f

Brings in 2i2c-org/utoronto-image#58, so we no longer have to use the older notebook server. Fixes 2i2c-org#2380 Ref 2i2c-org#2729

yuvipanda mentioned this issue Dec 27, 2023

Bump utoronto staging image again #3550

Merged

yuvipanda added a commit to yuvipanda/pilot-hubs that referenced this issue Dec 27, 2023

Bump utoronto staging image again

dada11f

Brings in 2i2c-org/utoronto-image#58, so we no longer have to use the older notebook server. Fixes 2i2c-org#2380 Ref 2i2c-org#2729

yuvipanda closed this as completed in #3550 Dec 27, 2023

yuvipanda reopened this Dec 27, 2023

damianavila assigned yuvipanda Jan 17, 2024

damianavila added this to Sprint Board Jan 17, 2024

damianavila moved this to Done 🎉 in Sprint Board Jan 17, 2024

damianavila closed this as completed Jan 18, 2024

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Investigate issues with jupyter-contrib-nbextensions for utoronto-configurator #2380

Investigate issues with jupyter-contrib-nbextensions for utoronto-configurator #2380

pnasrat commented Mar 20, 2023

pnasrat commented Mar 20, 2023

pnasrat commented Mar 20, 2023

yuvipanda commented Mar 20, 2023

pnasrat commented Mar 20, 2023

pnasrat commented Mar 20, 2023

pnasrat commented Mar 20, 2023

pnasrat commented Mar 22, 2023

yuvipanda commented Mar 22, 2023

yuvipanda commented Mar 22, 2023

yuvipanda commented Mar 22, 2023

damianavila commented Sep 20, 2023

yuvipanda commented Dec 27, 2023

damianavila commented Jan 18, 2024

Investigate issues with jupyter-contrib-nbextensions for utoronto-configurator #2380

Investigate issues with jupyter-contrib-nbextensions for utoronto-configurator #2380

Comments

pnasrat commented Mar 20, 2023

Context

Proposal

Updates and actions

pnasrat commented Mar 20, 2023

pnasrat commented Mar 20, 2023

yuvipanda commented Mar 20, 2023

pnasrat commented Mar 20, 2023

pnasrat commented Mar 20, 2023

pnasrat commented Mar 20, 2023

pnasrat commented Mar 22, 2023

yuvipanda commented Mar 22, 2023

yuvipanda commented Mar 22, 2023

yuvipanda commented Mar 22, 2023

damianavila commented Sep 20, 2023

yuvipanda commented Dec 27, 2023

damianavila commented Jan 18, 2024