Bug report
Bug description:
Summary
csv.Sniffer().sniff() raises csv.Error: Could not determine delimiter for a sample whose first row contains a field longer than the current csv.field_size_limit() (131072 by default), even when every following row is consistently delimited.
Reproduction Code
import csv
sample = 'a,"' + 'x' * 200_000 + '",b\n' + 'c,d,e\n' * 50
print(csv.Sniffer().sniff(sample).delimiter)
Actual Behavior
Traceback (most recent call last):
File "repro.py", line 4, in <module>
print(csv.Sniffer().sniff(sample).delimiter)
~~~~~~~~~~~~~~~~~~~^^^^^^^^
File "Lib/csv.py", line 384, in sniff
raise Error("Could not determine delimiter")
_csv.Error: Could not determine delimiter
Expected Behavior
sniff() should return a dialect with `delimiter=','
CPython versions tested on:
CPython main branch
Operating systems tested on:
Linux
Linked PRs
Bug report
Bug description:
Summary
csv.Sniffer().sniff()raisescsv.Error: Could not determine delimiterfor a sample whose first row contains a field longer than the currentcsv.field_size_limit()(131072 by default), even when every following row is consistently delimited.Reproduction Code
Actual Behavior
Expected Behavior
sniff()should return a dialect with `delimiter=','CPython versions tested on:
CPython main branch
Operating systems tested on:
Linux
Linked PRs