I'm trying to run some code using PyPy to speed it up. My code uses Pandas dataframes, so I'm trying to find a way to install the package...
Unfortunately, I can't find a way to do that... searching online yields this and this -- two disappointing results which say it's not possible, but they are 1-2 years old!
There was a glimmer of hope from this twitter post from Romain Guillebert which suggests I could do it using a package called pymetabiosis. Unfortunately when I go to install that, I get the error mentioned below.
Any idea how I can debug the error or find some other way of using Pandas with PyPy?**
Collecting pymetabiosis
Using cached pymetabiosis-0.0.1.tar.gz
Complete output from command python setup.py egg_info:
pymetabiosis/__pycache__/_cffi__x771a6f66x197b9d2b.c:219:13: warning: initializing 'char **' with an expression of type 'const char **' discards qualifiers in nested pointer types [-Wincompatible-pointer-types-discards-qualifiers]
{ char * *tmp = &p->ml_name; (void)tmp; }
^ ~~~~~~~~~~~
pymetabiosis/__pycache__/_cffi__x771a6f66x197b9d2b.c:220:13: warning: incompatible pointer types initializing 'void **' with an expression of type 'PyCFunction *' (aka 'struct _object *(**)(struct _object *, struct _object *)') [-Wincompatible-pointer-types]
{ void * *tmp = &p->ml_meth; (void)tmp; }
^ ~~~~~~~~~~~
pymetabiosis/__pycache__/_cffi__x771a6f66x197b9d2b.c:222:13: warning: initializing 'char **' with an expression of type 'const char **' discards qualifiers in nested pointer types [-Wincompatible-pointer-types-discards-qualifiers]
{ char * *tmp = &p->ml_doc; (void)tmp; }
^ ~~~~~~~~~~
pymetabiosis/__pycache__/_cffi__x771a6f66x197b9d2b.c:1189:30: warning: incompatible pointer types passing 'PyObject *' (aka 'struct _object *') to parameter of type 'PyCodeObject *' [-Wincompatible-pointer-types]
{ result = PyEval_EvalCode(x0, x1, x2); }
^~
//anaconda/include/python2.7/eval.h:10:54: note: passing argument to parameter here
PyAPI_FUNC(PyObject *) PyEval_EvalCode(PyCodeObject *, PyObject *, PyObject *);
^
pymetabiosis/__pycache__/_cffi__x771a6f66x197b9d2b.c:1857:12: warning: incompatible integer to pointer conversion assigning to 'PyObject *' (aka 'struct _object *') from 'int' [-Wint-conversion]
{ result = PyObject_SetAttr(x0, x1, x2); }
^ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~
pymetabiosis/__pycache__/_cffi__x771a6f66x197b9d2b.c:2164:5: warning: incompatible pointer types assigning to 'PyObject *(*)(size_t, ...)' (aka 'struct _object *(*)(unsigned long, ...)') from 'PyObject *(Py_ssize_t, ...)' (aka 'struct _object *(long, ...)') [-Wincompatible-pointer-types]
i = (PyTuple_Pack);
^ ~~~~~~~~~~~~~~
6 warnings generated.
ld: warning: directory not found for option '-L//anaconda/lib
'
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/private/var/folders/t4/n42mh55n05sd6s5hgk1dzdz80000gp/T/pip-build-fSTXPd/pymetabiosis/setup.py", line 2, in <module>
from pymetabiosis.bindings import ffi
File "pymetabiosis/__init__.py", line 1, in <module>
from pymetabiosis.module import import_module
File "pymetabiosis/module.py", line 2, in <module>
from pymetabiosis.wrapper import MetabiosisWrapper
File "pymetabiosis/wrapper.py", line 3, in <module>
from __pypy__ import identity_dict
ImportError: No module named __pypy__
----------------------------------------
Command "python setup.py egg_info" failed with error code -11 in /private/var/folders/t4/n42mh55n05sd6s5hgk1dzdz80000gp/T/pip-build-fSTXPd/pymetabiosis/
Here's what I've done, assume you're using Conda, but Pip/Venv should work also
Make a new conda env
conda create --name pypy_env
conda activate pypy_env
Install pypy3 using conda
conda install pypy3
Get Pip for pypy3 using the method here Install pip on pypy
Install packages for pypy using
pypy3 -m pip install pandas