Category
Compatibility Issue
🐛 Describe the bug
I have an EMR Serverless PySpark setup where the initial %sm_analytics emr-serverless connect cell successfully creates a Livy session and marks it idle on the backend, but the notebook front end never receives/handles the completion properly, so the cell stays “running” and will not release to allow subsequent cells to execute. This happens in both local VS Code Jupyter and SageMaker Code Editor.
🐛 Describe the expected behavior
When you run the first %sm_analytics emr-serverless connect cell, the EMR Serverless / Livy side actually starts a Spark session, runs its internal test statement, and reports the session as idle and successful, but the notebook front end never cleanly receives or processes the “execution finished” signal, so it keeps that cell in a permanently running/busy state and blocks new cells from executing, even though the backend work is already complete and the Spark session is alive.
Image Tags
3.6.1-cpu but its the same behavior with all images
Category
Compatibility Issue
🐛 Describe the bug
I have an EMR Serverless PySpark setup where the initial %sm_analytics emr-serverless connect cell successfully creates a Livy session and marks it idle on the backend, but the notebook front end never receives/handles the completion properly, so the cell stays “running” and will not release to allow subsequent cells to execute. This happens in both local VS Code Jupyter and SageMaker Code Editor.
🐛 Describe the expected behavior
When you run the first %sm_analytics emr-serverless connect cell, the EMR Serverless / Livy side actually starts a Spark session, runs its internal test statement, and reports the session as idle and successful, but the notebook front end never cleanly receives or processes the “execution finished” signal, so it keeps that cell in a permanently running/busy state and blocks new cells from executing, even though the backend work is already complete and the Spark session is alive.
Image Tags
3.6.1-cpu but its the same behavior with all images