Any way to install Pandas with PyPy?

Afflatus picture Afflatus · Sep 15, 2016 · Viewed 8.7k times · Source

I'm trying to run some code using PyPy to speed it up. My code uses Pandas dataframes, so I'm trying to find a way to install the package...

Unfortunately, I can't find a way to do that... searching online yields this and this -- two disappointing results which say it's not possible, but they are 1-2 years old!

There was a glimmer of hope from this twitter post from Romain Guillebert which suggests I could do it using a package called pymetabiosis. Unfortunately when I go to install that, I get the error mentioned below.

Any idea how I can debug the error or find some other way of using Pandas with PyPy?**


Error message when installing pymetabiosis:

Collecting pymetabiosis
  Using cached pymetabiosis-0.0.1.tar.gz
    Complete output from command python setup.py egg_info:
    pymetabiosis/__pycache__/_cffi__x771a6f66x197b9d2b.c:219:13: warning: initializing 'char **' with an expression of type 'const char **' discards qualifiers in nested pointer types [-Wincompatible-pointer-types-discards-qualifiers]
      { char * *tmp = &p->ml_name; (void)tmp; }
                ^     ~~~~~~~~~~~
    pymetabiosis/__pycache__/_cffi__x771a6f66x197b9d2b.c:220:13: warning: incompatible pointer types initializing 'void **' with an expression of type 'PyCFunction *' (aka 'struct _object *(**)(struct _object *, struct _object *)') [-Wincompatible-pointer-types]
      { void * *tmp = &p->ml_meth; (void)tmp; }
                ^     ~~~~~~~~~~~
    pymetabiosis/__pycache__/_cffi__x771a6f66x197b9d2b.c:222:13: warning: initializing 'char **' with an expression of type 'const char **' discards qualifiers in nested pointer types [-Wincompatible-pointer-types-discards-qualifiers]
      { char * *tmp = &p->ml_doc; (void)tmp; }
                ^     ~~~~~~~~~~
    pymetabiosis/__pycache__/_cffi__x771a6f66x197b9d2b.c:1189:30: warning: incompatible pointer types passing 'PyObject *' (aka 'struct _object *') to parameter of type 'PyCodeObject *' [-Wincompatible-pointer-types]
      { result = PyEval_EvalCode(x0, x1, x2); }
                                 ^~
    //anaconda/include/python2.7/eval.h:10:54: note: passing argument to parameter here
    PyAPI_FUNC(PyObject *) PyEval_EvalCode(PyCodeObject *, PyObject *, PyObject *);
                                                         ^
    pymetabiosis/__pycache__/_cffi__x771a6f66x197b9d2b.c:1857:12: warning: incompatible integer to pointer conversion assigning to 'PyObject *' (aka 'struct _object *') from 'int' [-Wint-conversion]
      { result = PyObject_SetAttr(x0, x1, x2); }
               ^ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    pymetabiosis/__pycache__/_cffi__x771a6f66x197b9d2b.c:2164:5: warning: incompatible pointer types assigning to 'PyObject *(*)(size_t, ...)' (aka 'struct _object *(*)(unsigned long, ...)') from 'PyObject *(Py_ssize_t, ...)' (aka 'struct _object *(long, ...)') [-Wincompatible-pointer-types]
      i = (PyTuple_Pack);
        ^ ~~~~~~~~~~~~~~
    6 warnings generated.
    ld: warning: directory not found for option '-L//anaconda/lib
    '
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "/private/var/folders/t4/n42mh55n05sd6s5hgk1dzdz80000gp/T/pip-build-fSTXPd/pymetabiosis/setup.py", line 2, in <module>
        from pymetabiosis.bindings import ffi
      File "pymetabiosis/__init__.py", line 1, in <module>
        from pymetabiosis.module import import_module
      File "pymetabiosis/module.py", line 2, in <module>
        from pymetabiosis.wrapper import MetabiosisWrapper
      File "pymetabiosis/wrapper.py", line 3, in <module>
        from __pypy__ import identity_dict
    ImportError: No module named __pypy__

    ----------------------------------------
Command "python setup.py egg_info" failed with error code -11 in /private/var/folders/t4/n42mh55n05sd6s5hgk1dzdz80000gp/T/pip-build-fSTXPd/pymetabiosis/

Answer

Spcogg the second picture Spcogg the second · Aug 13, 2019

Here's what I've done, assume you're using Conda, but Pip/Venv should work also

Make a new conda env

conda create --name pypy_env
conda activate pypy_env

Install pypy3 using conda

conda install pypy3

Get Pip for pypy3 using the method here Install pip on pypy

Install packages for pypy using

pypy3 -m pip install pandas