Is there a good library for accessing HBase from Python?

python hadoop hbase stargate
Wojtek picture Wojtek · Apr 18, 2010 · Viewed 9.9k times · Source

I spent some time looking around, and all I could find is Jython. It's an option, but is there something that could be used in a more pythonesque (simpler) way?

Answer

juhanic picture juhanic · Apr 27, 2010

Stargate is still in the contrib part of the Hbase project while ThriftServer is maintained in core(org.apache.hadoop.hbase.thrift). Grab the HBase.thrift file from the repository and run

thrift --gen py HBase.thrift on it, shove the contents into wherever, and startup a thrift server. Stargate is very very slow. The HBase thrift still has some work to be done on it, however it is still being actively worked on

A couple of places to get started

http://wiki.apache.org/hadoop/Hbase/ThriftApi

Related questions

How to Access Hive via Python?

https://cwiki.apache.org/confluence/display/Hive/HiveClient#HiveClient-Python appears to be outdated. When I add this to /etc/profile: export PYTHONPATH=$PYTHONPATH:/usr/lib/hive/lib/py I can then do the imports as listed in the link, with …

Read More
How to turn off INFO logging in Spark?

I installed Spark using the AWS EC2 guide and I can launch the program fine using the bin/pyspark script to get to the spark prompt and can also do the Quick Start quide successfully. However, I cannot for the …

Read More
Python read file as stream from HDFS

Here is my problem: I have a file in HDFS which can potentially be huge (=not enough to fit all in memory) What I would like to do is avoid having to cache this file in memory, and only process …

Read More