%fs: Allows you to use dbutils filesystem commands. To run a shell command on all nodes, use an init script. This command runs only on the Apache Spark driver, and not the workers. To fail the cell if the shell command has a non-zero exit status, add the -e option.
%sh: Allows you to run shell code in your notebook.
Notebooks also support a few auxiliary magic commands: REPLs can share state only through external resources such as files in DBFS or objects in object storage. Variables defined in one language (and hence in the REPL for that language) are not available in the REPL of another language. When you invoke a language magic command, the command is dispatched to the REPL in the execution context for the notebook.
0 kommentar(er)
