`libarrow_python.so` is now a part of `pyarrow` Python module and unable
to build / install separately. It is true that `pyarrow` is installable
through `pip` with some trivial workaround, but I would like to package
this in our official repo for backward compatibility.