#733271 ship all data files needed for testing

#733271#5
Date:
2013-12-27 23:19:07 UTC
From:
To:
I have spotted that the size of .orig.tar.gz is much larger than the size of
generated .deb files... primarily (besides missing -doc package ;) ) it is due
to some  data files used for testing not being installed (package_data in
setup.py), which leads to failure of unittests when ran on mne "as installed":

$> grep 'No such' nose.log | sort | uniq
ERROR: Failure: IOError ([Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/realtime/tests/../../fiff/tests/data/test_raw.fif')
ERROR: Failure: IOError ([Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/tests/../fiff/tests/data/test_raw.fif')
Failure: IOError ([Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/realtime/tests/../../fiff/tests/data/test_raw.fif') ... ERROR
Failure: IOError ([Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/tests/../fiff/tests/data/test_raw.fif') ... ERROR
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/decoding/tests/../../fiff/tests/data/test_raw.fif'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/fiff/brainvision/tests/data/test.vhdr'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/fiff/bti/tests/data/exported4D_linux.fif'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/fiff/bti/tests/data/test_config_linux'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/fiff/bti/tests/data/test_hs_linux'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/fiff/bti/tests/data/test_pdf_linux'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/fiff/edf/tests/data/test.bdf'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/fiff/edf/tests/data/test.edf'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/fiff/kit/tests/data/test_hsp.txt'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/fiff/kit/tests/data/test_mrk.sqd'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/fiff/kit/tests/data/test.sqd'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/fiff/tests/data/fsaverage-fiducials.fif'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/fiff/tests/data/test-ave.fif'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/fiff/tests/data/test_ctf_comp_raw.fif'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/fiff/tests/data/test_raw.fif'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/fiff/tests/data/test_withbads_raw.fif'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/layouts/tests/../../fiff/tests/data/test_raw.fif'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/preprocessing/tests/../../fiff/tests/data/test_raw.fif'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/realtime/tests/../../fiff/tests/data/test_raw.fif'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/tests/../fiff/tests/data/test-ave.fif'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/tests/../fiff/tests/data/test-ave.log'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/tests/../fiff/tests/data/test-cov.fif'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/tests/../fiff/tests/data/test-eve.fif'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/tests/../fiff/tests/data/test-lh.label'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/tests/../fiff/tests/data/test_raw.fif'
IOError: [Errno 2] No such file or directory: '/usr/lib/python2.7/dist-packages/mne/time_frequency/tests/../../fiff/tests/data/test_raw.fif'

Cheers!

#733271#10
Date:
2014-01-08 21:02:08 UTC
From:
To:
hi,

do you have any idea why this happens? these files are excluded from
the manifest to avoid
a huge upload to pypi but could be shipped on debian. Any idea how to fix this?

thanks
Alex

#733271#15
Date:
2026-10-06 12:09:03 UTC
From:
To:
I tried integrating the additional external data into the test suite.
Even when downloading only the minimal test data, it amounts to over a gigabyte of data.
I consider both the effort involved and the resulting repository size to be excessive, especially given that many integration tests relying on data are already running, and this would add only 705 more.
current tests === 4775 passed, 1745 skipped, 2 deselected, 7 xfailed in 709.79s (0:11:49) ====
Of these, 705 were skipped due to "Requires testing dataset".

#733271#26
Date:
2026-10-07 18:14:16 UTC
From:
To:
Am Tue, Oct 06, 2026 at 12:09:03PM +0000 schrieb Schöke, Karsten: