Is it possible to delete everything inside a filesystem HDFS folder that I'm downloading?
I'm, copying them and deleting them like this:
for x in paths:
with source_folder.get_download_stream(x) as f:
data = f.read()
with destination_folder.get_writer(x) as w:
But the files only get deleted temporarily . If I build the source folder again the files reappear?
How can I delete them from the original place? Do I need the host, port... information? It doesn't seem to be working
Thank you so much in advance 🙂