Support more NoSQL databases #600

btzo posted onGitHub

I don't know if this topic has already been discussed, but I was thinking on the idea of including a NoSQL database option in Caravel. Whereas currently the interface for connection is made using SQLAlchemy and, as its own name says, it doesn't deal with anything that is not SQL, I think this could be a nice upgrade.

PS: I imagine that this change could bring changes on the current interface as well.

We support Druid which we query through a REST API. There's a common interface to both, though it's non trivial (but certainly doable!) to add support for a new DB backend. We were discussing adding support for ElasticSearch for instance as we have some use cases at Airbnb.

posted by mistercrunch almost 9 years ago

Any specific backend you had in mind?

posted by mistercrunch almost 9 years ago

CouchDB

posted by btzo almost 9 years ago

I would like to suggest MongoDB.

posted by hugo-pires almost 9 years ago

Mongodb would be great !

posted by saitx almost 9 years ago

Acting like a REST API client could be used to connect to several databases

posted by hugo-pires over 8 years ago

Well the REST APIs to different NOSQL dbs are all very different. I don't think there's a standard there... Different calls to get column metadata, different APIs for queries, ...

posted by mistercrunch over 8 years ago

Ok. Just a suggestion.

posted by hugo-pires over 8 years ago

I'm thinking about ElasticSearch. Has a nice REST interface, and Caravel could be a nice alternative to Kibana...

I wonder if porting Caravel would be mainly a matter of reimplementing what I see for Druid in views.py, or it would be much more than that?

posted by jgbarah over 8 years ago

I see that topic of integrating with ElasticSearch is covered in some detail in #241.

posted by jgbarah over 8 years ago

@jgbarah, @mistercrunch, any update on this issue? Has there been work done on this that I could see?

posted by SalehHindi over 8 years ago

ElasticSearch support +1

posted by fnzv over 8 years ago

+1 for ElasticSearch

posted by danmaz74 over 8 years ago

posted by eroncastro over 8 years ago

+1 for ElasticSearch

posted by jerry-sjtu over 8 years ago

+1 for ElasticSearch

posted by mineca over 8 years ago

+1 for ElasticSearch

posted by feiquanbifeng over 8 years ago

+1 for ElasticSearch

posted by liukaitj over 8 years ago

PSA: Please make use of github reactions instead of the annoying +1 comments, thanks.

posted by xrmx over 8 years ago

+1 for ElasticSearch

posted by detectivebag over 8 years ago

Anyone actually working on this? Is there any standard Python API so user could implement certain interface for specific NoSQL database when officially it's not done yet?

posted by QiXuanWang about 8 years ago

@QiXuanWang yes, you should write a sqlalchemy dialect to be pluggable with superset

posted by xrmx about 8 years ago

Here's the spec for Python's DBAPI: https://www.python.org/dev/peps/pep-0249/

posted by mistercrunch about 8 years ago

Would it be possible to know the list of NoSql databases currently supported by Superset? Is there a list or additional information somewhere. By the way, also in favour of an Elasticsearch support.

posted by frosiere about 8 years ago

+1 for elasticsearch

posted by xycloud almost 8 years ago

+1 for elasticsearch...

posted by davidattw almost 8 years ago

+1 for bigquery

posted by lilila almost 8 years ago

People, backends support won't automagically appear by themselves by adding +1. Again: https://github.com/airbnb/superset/issues/600#issuecomment-255326247

posted by xrmx almost 8 years ago

I've done some work to clarify the connectors interface, making it easier to add new connectors to the platform.

posted by mistercrunch almost 8 years ago

FYI I started the work to integrate with ElasticSearch. Seems like it's going to be fairly straightforward. Let me know if you want to get involved. https://github.com/airbnb/superset/pull/2953

posted by mistercrunch almost 8 years ago

Fund this Issue

$20.00

Funded

rororofff(123)$20.00

Only logged in users can fund an issue

Pull requests

Recent activities

rororofff cancelled funding $ 20.00 for apache/ incubator-superset#600

almost 6 years ago

rororofff funded $ 20.00 for apache/incubator-superset# 600

almost 6 years ago

Support more NoSQL databases #600

Company

Community

Support

Connect