Crawler Settings

Generic Crawler Settings:

Timeout: Connection timeout in ms. 0 means unlimited.

HTTP Crawler Settings:

Maximum Filesize: Maximum allowed file size in bytes that should be downloaded. Larger files will be skipped. -1 means unlimited.
Please note that if the crawler uses content compression, this limit is used to check the compressed content size.

FTP Crawler Settings:

Maximum Filesize: Maximum allowed file size in bytes that should be downloaded. Larger files will be skipped. -1 means unlimited.

SMB Crawler Settings:

Maximum Filesize: Maximum allowed file size in bytes that should be downloaded. Larger files will be skipped. -1 means unlimited.

Local File Crawler Settings:

Maximum Filesize: Maximum allowed file size in bytes that should be downloaded. Larger files will be skipped. -1 means unlimited.
  Changes will take effect immediately.