Update to Lumino 2 and JupyterLab 4.0.0a29

[afshin]

Resolves #6538
Fixes #6500
Closes #6533

• Revert Pin ypy-websocket to 0.2 #6499
• Check CodeMirror 6: Migrate to Codemirror 6 jupyterlab/jupyterlab#11638
• Check lsp-extension: Integrate jupyterlab-lsp into jupyterlab jupyterlab/jupyterlab#12534
• Update Playwright: Update @playwright/test #6533
• Update to TypeScript 4.7 to align with JupyterLab
• Change compilation target from ES2017 to ES2018 to align with JupyterLab
• Update reference snapshots
• Fix Playwright tests for handling the renaming of files and notebooks, behavior changed with Fixes renaming files from title while using a custom drive jupyterlab/jupyterlab#12849
• Check other changes from https://github.com/jupyterlab/jupyterlab/releases/tag/v4.0.0a27
• Check other changes from https://github.com/jupyterlab/jupyterlab/releases/tag/v4.0.0a28
• Check other changes from https://github.com/jupyterlab/jupyterlab/releases/tag/v4.0.0a29
• Cell output auto-scroll now seems to be broken after the update, might be related to Remove modeldb jupyterlab/jupyterlab#12695
• Fix cell collapser which does not seem to be working anymore (also no hover style)
• Fix CSS issues:
  • Virtual Notebook changes:
    
  • Side-by-side rendering
    
  • Remove this new horizontal scroll bar:
    
• Make sure shadows are still present: Add shadow to cells #6433
  • The new Virtual Notebook DOM structure requires updating the CSS: Windowed (Virtual) notebook jupyterlab/jupyterlab#12554
• Cleanup the notebook CSS

[github-actions]

👈 Launch a Binder on branch afshin/notebook/lumino-2

[jtpio]

Thanks @afshin for starting this.

Do you want to take over the lab 4.0.0a27 update as well, which was started in #6525 and has some overlap with the current PR? If so happy to close #6525 then.

There are a couple of items to have a look listed in the top comment: #6525 (comment)

[afshin]

@jtpio, sounds like a plan! I may ask you for advice if I run into any headaches 🤕

[afshin]

This migration will need to wait for a version of Lumino that includes the bug fix for startup plugins not activating and a new version of JupyterLab based with updated Lumino libraries.

• Fix bug that prevents any startup plugins from activating jupyterlab/lumino#391
• Bump to Lumino 2ᵅ⁶ jupyterlab/jupyterlab#13062

[jtpio]

Looks like there is a new error coming from jupyter_ydoc: https://github.com/jupyter/notebook/actions/runs/3145280672/jobs/5112365511

lerna ERR! yarn run build:prod stderr:
Traceback (most recent call last):
  File "/tmp/build-env-sga8vbqf/bin/jupyter-labextension", line 5, in <module>
    from jupyterlab.labextensions import main
  File "/tmp/build-env-sga8vbqf/lib/python3.10/site-packages/jupyterlab/labextensions.py", line 37, in <module>
    from .labapp import LabApp
  File "/tmp/build-env-sga8vbqf/lib/python3.10/site-packages/jupyterlab/labapp.py", line 15, in <module>
    from jupyter_server_ydoc.ydoc import JupyterSQLiteYStore
  File "/tmp/build-env-sga8vbqf/lib/python3.10/site-packages/jupyter_server_ydoc/__init__.py", line 6, in <module>
    from .ydoc import YDocWebSocketHandler
  File "/tmp/build-env-sga8vbqf/lib/python3.10/site-packages/jupyter_server_ydoc/ydoc.py", line 11, in <module>
    from jupyter_ydoc import ydocs as YDOCS  # type: ignore
  File "/tmp/build-env-sga8vbqf/lib/python3.10/site-packages/jupyter_ydoc/__init__.py", line 1, in <module>
    import pkg_resources

EDIT: opened jupyter-server/jupyter_ydoc#58

[jtpio]

Alright CI is all passing now ✔️

I also did a quick check on Binder and it seems to be looking good there as well.

Found a new issue when opening a JSON file with the code editor, but it seems to be happening in JupyterLab too. Opened jupyterlab/jupyterlab#13170 so it can be fixed upstream.

[jtpio]

Thanks @afshin for starting this update.

In the end it required more changes than initially thought but it's looking good now 😅

Getting this one in and making a new release right after.

[afshin]

Thank you @jtpio!