This framework allows read/write and ETL against many SQL, Cloud, NoSQL databases, and other persistent data stores. Additional features include support for user-defined plugin pre/post processing functions
You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
Go to file
Steve L. Nyemba 0b15351b8e
data transport framework for rabbitmq, mongodb, couchdb, ...
5 years ago
transport data transport framework for rabbitmq, mongodb, couchdb, ... 5 years ago
README.md Update 'README.md' 7 years ago
requirements.txt S3 Requirments file 7 years ago
setup.py data transport framework for rabbitmq, mongodb, couchdb, ... 5 years ago
transport.py S3 - Bug fix? Not sure 7 years ago

README.md

Introduction

This project implements an abstraction of objects that can have access to a variety of data stores, implementing read/write functions associated and specific to the data-sources. The classes implement functionalities against :

- Rabbitmq-server
- Couchdb-server
- Http Session : {csv,tab,pipe,sql}
- Disk{Reader|Writer} : csv, tab, pipe, sql on disk

Usage

The basic usage revolves around a factory class (to be a singleton)

import transport

p = {"uri":"https://your-server:5984","dbname":"mydatabase","doc":"doc_id"}
couchdb = transport.Factory.instance(type='CouchdbReader',args=p)

#
# let's execute a view
#
result = couchdb.view('view_name/function',key=value)
info   = couchdb.read()