Generic Crawler Settings:

Timeout:

Connection timeout in ms that should be used. 0 means unlimited.

http Crawler Settings:

Maximum Filesize:

Maximum allowed file size in bytes that should be downloaded. Oversized files will be skipped. -1 means unlimited.
Please note that if the crawler uses content compression, this limit is used to check the compressed content size.

ftp Crawler Settings:

Maximum Filesize:

Maximum allowed file size in bytes that should be downloaded. Oversized files will be skipped. -1 means unlimited.

Changes will take effect immediately.