Data size limit and timeout specifications
Size limits
Type | Limit |
|---|---|
Dataset ingested to data.world | 1 GB |
Metadata management datasets | no limit |
Project | 1 GB |
Derived dataset | 1 GB |
Virtual dataset (hosted on a remote server) | Size not limited by data.world |
Size of a file in a dataset | 1 GB |
Number of files in a dataset | 250 |
Number of columns in a table | limited by file size |
Number of columns previewed in a table | 50 |
Number of columns previewed in query results | 500 |
Number of rows in a table | limited by file size |
Number of rows previewed in query results | 10,000 |
Rate limiting: Number of burst streams API calls | 5 in the first second or after a 5 second idle period, then 1 per second |
Size of a record streamed | 1 MiB |
Size of a request streamed | 1 GB |
Number of JSON objects in a stream | 1 GB divided by the avg record size |
Timeouts
Type of timeout | Limit |
|---|---|
Query timeout before first byte is transmitted | 1 minute (upgrade to 5 minutes available upon request) |
Query timeout before last byte is transmitted | 60 minutes |
Data upload timeout | None: As long as packets continue to be passed the connection will stay open |