Truncating a HDFS folder that Im accessing through Download Recipe

sarah2753 Registered Posts: 1 ✭✭✭


Is it possible to delete everything inside a filesystem HDFS folder that I'm downloading?

I'm, copying them and deleting them like this:

for x in paths:
with source_folder.get_download_stream(x) as f:
data =
with destination_folder.get_writer(x) as w:

But the files only get deleted temporarily . If I build the source folder again the files reappear?

How can I delete them from the original place? Do I need the host, port... information? It doesn't seem to be working

Thank you so much in advance

Setup Info
      Help me…