Repository navigation
CSV button not showing up #91
Description
I've used hydrator in order to get some tweets. I am not at 3,704,430 tweets hydrated (the .jsonl file is 11.5 GB) and I've decided to stop so I hit the stop button. I've done some tests with smaller datasets and after stopping the process the CSV button would show up. However, not it's not. Is it still working on the CSV? I've noticed that I can press start again so I guess the app is still working ok.
How can I tell if the CSV is generating? Will the button show up? Is there a way to manually start the conversion process?
Activity
edsu commentedon May 9, 2021
Actually the csv button only shows up after the hydration is finished. But I agree that it would be useful for it to be available whenever hydration is stopped. If you want you can use another tool like json2csv utility to convert it:
https://github.com/DocNow/twarc/blob/main/utils/json2csv.py
edsu commentedon May 20, 2021
I'm going to reopen this because I think you are right that this would be a good feature to have.