Skip to main content

HDFS files

Binding: %file.hdfs

Browses and reads files on HDFS-compatible storage over WebHDFS, without leaving the notebook — handy for a quick look at a file's contents before pointing a Spark or Python job at it.

%file.hdfs
ls /data/incoming

Configuration

PropertyDefaultDescription
hdfs.urlhttp://localhost:50070/webhdfs/v1/The WebHDFS endpoint URL.
hdfs.userhdfsThe WebHDFS user to connect as.
hdfs.maxlength1000Maximum number of lines fetched from a file.

These are set by your administrator from the interpreter settings screen.