![]() You only need to make sure you’re inside your pipenv environment. To start Pyspark and open up Jupyter, you can simply run $ pyspark. Now you save the file, and source your Terminal: Your ~/.bashrc or ~/.zshrc should now have a section that looks kinda like this: 172 # Sparkġ79 export PYSPARK_DRIVER_PYTHON_OPTS='notebook'ġ80 export PYSPARK_PYTHON=python3 # only if you're using Python 3 If you want to use Python 3 with Pyspark (see step 3 above), you also need to add: export PYSPARK_PYTHON=python3 ![]() Now tell Pyspark to use Jupyter: in your ~/.bashrc/ ~/.zshrc file, add export PYSPARK_DRIVER_PYTHON=jupyterĮxport PYSPARK_DRIVER_PYTHON_OPTS='notebook' Please refrain from using an M1 Mac computer until the.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |