This framework allows read/write and ETL against many SQL, Cloud, NoSQL databases, and other persistent data stores. Additional features include support for user-defined plugin pre/post processing functions
You cannot select more than 25 topics
Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
Steve L. Nyemba
3443ec8da8
|
7 years ago | |
|---|---|---|
| README.md | 7 years ago | |
| requirements.txt | 7 years ago | |
| transport.py | 7 years ago | |
README.md
Introduction
This project implements an abstraction of objects that can have access to a variety of data stores, implementing read/write functions associated and specific to the data-sources. The classes implement functionalities against :
- Rabbitmq-server
- Couchdb-server
- Http Session : {csv,tab,pipe,sql}
- Disk{Reader|Writer} : csv, tab, pipe, sql on disk
Usage
The basic usage revolves around a factory class (to be a singleton)
import transport
p = {"uri":"https://your-server:5984","dbname":"mydatabase","doc":"doc_id"}
couchdb = transport.Factory.instance(type='CouchdbReader',args=p)
#
# let's execute a view
#
result = couchdb.view('view_name/function',key=value)
info = couchdb.read()