module filehelper.download_urls_helper¶
Short summary¶
module pyquickhelper.filehelper.download_urls_helper
Series of functions related to folder, explore, synchronize, remove (recursively).
Functions¶
function |
truncated documentation |
|---|---|
Iterates on files in folder, parse them, extracts all urls, download them in a folder. |
Documentation¶
Series of functions related to folder, explore, synchronize, remove (recursively).
- pyquickhelper.filehelper.download_urls_helper.download_urls_in_folder_content(folder, pattern='.+[.]((py)|(ipynb))', neg_pattern=None, recursive=True, timeout=10, folder_dest=None, encoding='utf-8', raise_exception=False, chunk=None, fLOG=None)[source]¶
Iterates on files in folder, parse them, extracts all urls, download them in a folder.
- Parameters:
folder – folder
pattern – if None, get all files, otherwise, it is a regular expression, the filename must verify (with the folder is fullname is True)
neg_pattern – negative pattern to exclude files
fullname – if True, include the subfolder while checking the regex
recursive – look into subfolders
urls – urls
timeout – in seconds, after this time, the function drops an returns None, -1 for forever
folder_dest – if None, the content is stored in that file
encoding – None by default, but if it is None, the returned information is binary
raise_exception – True to raise an exception, False to send a warnings
chunk – save data every chunk (only if output is not None)
fLOG – logging function (only applies when chunk is not None)
- Returns:
list of downloaded content
