Data Warehouse using Python

I have the required skills and I can do it within 5 days

Hi, i can propose you ETL solution in Python (using pure python or frameworks like pandas or petl, depending on project requirements) I have experience with various data warehouses and OLAP tools. Relevant Skills and Experience Python, DB/DWH (Oracle, Vertica, Postgres, MariaDB, AWS RDS, NoSql). Various AWS services (S3, RDS, Kinesis, DynamoDB etc). Proposed Milestones $277 USD - Python script(s) to load data from S3 to AWS Redshift Additional Services Offered $50 USD - Depending on project needs i can create a deployment scripts as well

I have been working on AWS infrastructure elements like S3, BOTO-3 and Redshift for past 2 years and have 12 years of experience working with python. I have built applications for VMware and NetApp. Relevant Skills and Experience AWS , Redshift, Boto3, python, Dataware housing Proposed Milestones $100 USD - Demo of complete data fetching from S3 $100 USD - Demo of Data processing as needed $100 USD - Complete demo and delivery ( including Demo for updating the redshift database ) Additional Services Offered $200 USD - complete automation of this process using python and BOTO3 Are you looking for making a tool to do this task, so that you can repeat it free of cost each time

In addition to many years ETL and DW/BI architecture experience, I am also a seasoned coder of over 25 years. 5 days for, say, 5-10 python scripts is easily achievable. Relevant Skills and Experience I have many years of multi-terabyte datawarehouse experience for major investment and high-street banks (JMorgan, Landsbankinn, ASB etc.). I also have experience of AWS deployment and maintenance. Proposed Milestones $100 USD - Requirements gathering, documentation and first prototype signed off. $122 USD - Final production version (scripts), full documentation and handover. Sign-off to full satisfaction. Additional Services Offered $100 USD - $20USD per day additional coding and/or maintenance and tuning services. Can I have some idea of dataset size and number of tables from/to Redshift, please?

I have experience in data transformations using Python, putting and getting objects from Amazon S3, and inserting and read data into MySQL and other databases, using Python. I have not used Redshift yet, but I have a lot of experience using Python to send data to MySQL. I have an AWS account that I can use for some testing, and I'm setting up a free-tier Redshift trial. Relevant Skills and Experience Python, Amazon Web Services S3, MySQL, other databases. What I need to start: Sample file. Description of transformations. If there are "simple" and "complex" transformations, please group them so that I can start with the simple ones as a proof of concept. Redshift database schema. Proposed Milestones $50 USD - Read S3 file, transform 1 object up to 5 fields with simple transforms, insert into Redshift $105 USD - Complete rest of project Additional Services Offered $50 USD - Notification to SNS of job status Questions: Has the Redshift database been set up? Will the code run as Lambda function or on-demand? The Lambda function can be triggered by object add to S3 bucket. Python 2.7 or Python 3, or does it matter? Is there a way for me to use your AWS resources for development, or do I need to develop on my AWS account?