#921463 python3-dask: recursion problem

Package:
python3-dask
Source:
dask
Submitter:
javierruano
Date:
2024-01-28 12:54:02 UTC
Severity:
normal
Tags:
#921463#5
Date:
2019-02-05 19:33:42 UTC
From:
To:
Dear Maintainer,

*** Reporter, please consider answering these questions, where appropriate ***
At the operation compute to dask.dataframe.
  args2 = [_get_recursive(dsk, k, cache) for k in args]
  File "/usr/lib/python3/dist-packages/dask/core.py", line 136, in <listcomp>
    args2 = [_get_recursive(dsk, k, cache) for k in args]
  File "/usr/lib/python3/dist-packages/dask/core.py", line 132, in _get_recursive

 Information:
Debian Release: buster/sid
  APT prefers testing
  APT policy: (500, 'testing'), (500, 'oldstable')
Architecture: amd64 (x86_64)

Kernel: Linux 4.18.0-3-amd64 (SMP w/8 CPU cores)
Locale: LANG=en_GB.UTF-8, LC_CTYPE=en_GB.UTF-8 (charmap=UTF-8), LANGUAGE=en_GB:en (charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled

Versions of packages python3-dask depends on:
ii  python3        3.7.2-1
ii  python3-toolz  0.9.0-1

Versions of packages python3-dask recommends:
ii  python3-cloudpickle  0.5.6-1
ii  python3-numpy        1:1.16.1-1
ii  python3-pandas       0.23.3-1
ii  python3-partd        0.3.9-1
ii  python3-requests     2.20.0-2

Versions of packages python3-dask suggests:
pn  ipython              <none>
pn  python-dask-doc      <none>
pn  python3-bcolz        <none>
ii  python3-blosc        1.7.0+ds1-1
pn  python3-boto         <none>
pn  python3-distributed  <none>
pn  python3-graphviz     <none>
pn  python3-h5py         <none>
ii  python3-psutil       5.5.0-1
ii  python3-scipy        1.1.0-2
pn  python3-skimage      <none>
ii  python3-sklearn      0.20.2+dfsg-6
pn  python3-sqlalchemy   <none>
ii  python3-tables       3.4.4-2

#921463#10
Date:
2019-02-05 21:53:01 UTC
From:
To:
Could send me a small test program that triggers the bug?

I'll try looking at it and sending it upstream.

Thanks,
Diane

#921463#15
Date:
2019-02-05 21:53:01 UTC
From:
To:
Could send me a small test program that triggers the bug?

I'll try looking at it and sending it upstream.

Thanks,
Diane

#921463#20
Date:
2019-02-05 23:02:56 UTC
From:
To:
Hello Diane,
The exact message is:

args2 = [_get_recursive(dsk, k, cache) for k in args]
  File "/usr/lib/python3/dist-packages/dask/core.py", line 136, in <listcomp>
    args2 = [_get_recursive(dsk, k, cache) for k in args]
  File "/usr/lib/python3/dist-packages/dask/core.py", line 132, in _get_recursive
    res = cache[x] = _get_recursive(dsk, dsk[x], cache)
  File "/usr/lib/python3/dist-packages/dask/core.py", line 128, in _get_recursive
    hashable = ishashable(x)
  File "/usr/lib/python3/dist-packages/dask/core.py", line 20, in ishashable
    hash(x)
RecursionError: maximum recursion depth exceeded while calling a Python object

I have used the
for i in listIndex:
    daskdataframe.loc[i].values.compute()

The daskdataframe is from a read_csv and the csv has 2.5 Gb Volume.


5 feb. 2019 22:53, Diane Trout <diane@ghic.org> escribió:

Could send me a small test program that triggers the bug?

I'll try looking at it and sending it upstream.

Thanks,
Diane

#921463#25
Date:
2019-02-05 23:02:56 UTC
From:
To:
Hello Diane,
The exact message is:

args2 = [_get_recursive(dsk, k, cache) for k in args]
  File "/usr/lib/python3/dist-packages/dask/core.py", line 136, in <listcomp>
    args2 = [_get_recursive(dsk, k, cache) for k in args]
  File "/usr/lib/python3/dist-packages/dask/core.py", line 132, in _get_recursive
    res = cache[x] = _get_recursive(dsk, dsk[x], cache)
  File "/usr/lib/python3/dist-packages/dask/core.py", line 128, in _get_recursive
    hashable = ishashable(x)
  File "/usr/lib/python3/dist-packages/dask/core.py", line 20, in ishashable
    hash(x)
RecursionError: maximum recursion depth exceeded while calling a Python object

I have used the
for i in listIndex:
    daskdataframe.loc[i].values.compute()

The daskdataframe is from a read_csv and the csv has 2.5 Gb Volume.


5 feb. 2019 22:53, Diane Trout <diane@ghic.org> escribió:

Could send me a small test program that triggers the bug?

I'll try looking at it and sending it upstream.

Thanks,
Diane

#921463#30
Date:
2019-02-05 23:14:51 UTC
From:
To:
This seems relevant:

https://github.com/python/typing/issues/523

Scott K
 args2 = [_get_recursive(dsk, k, cache) for k in args]
 res = cache[x] = _get_recursive(dsk, dsk[x], cache)
 hashable = ishashable(x)
 hash(x)

#921463#35
Date:
2020-03-17 18:36:47 UTC
From:
To:
Hi,

Now that there's a new version of dask, which includes upstream's
fixes, is there any chance this problem got resolved?

Thanks,
Diane Trout

#921463#38
Date:
2020-03-17 18:36:47 UTC
From:
To:
Hi,

Now that there's a new version of dask, which includes upstream's
fixes, is there any chance this problem got resolved?

Thanks,
Diane Trout