I am using the Jupyter Notebook, and here is one of the path I have used: my_df = sqlContext.read.parquet('hdfs://myPath/user/hive/warehouse/myDB.db/myTable/**') Since I want to check what's under hdfs://myPath/user/hive/warehouse I did: !ls hdfs://myPath/user/hive/warehouse Then I got errors: ls: cannot access hdfs://myPath/user/hive/warehouse: No such file or directory Am I missing anything? What's the proper way for viewing a directory content from the Jupyter Notebook? Thanks! Continue reading...
