olivia_dataset.utilities.web package¶
Submodules¶
olivia_dataset.utilities.web.download module¶
- olivia_dataset.utilities.web.download.cookie_enabled_download(url: str, output_filepath: str, chunk_size: int = 4096) None[source]¶
This method enables downloading while simulating cookies being present. It is prepared using the code-segments in [https://wasi0013.com/2019/10/04/how-to-download-a-file-from-a-website-link-using-python-script-or-code-snippet/](https://wasi0013.com/2019/10/04/how-to-download-a-file-from-a-website-link-using-python-script-or-code-snippet/).
- url: str, required
The path to the online file to be downloaded
- output_filepath: str, required
The output filepath, in which the file will be saved
- chunk_size: int, optional (default=4096)
The chunk size for downloading