Find Jobs
Hire Freelancers

Create an ETL flow with AWS Glue -- 2

$30-250 USD

Lezárt
Kiadva ekkor: több mint 1 évvel ezelőtt

$30-250 USD

Teljesítéskor fizetve
I need the creation of an AWS glue project to automate an ETL process, which is as follows: 1.- We have a list of ids where we have to get the description of the object from a rest API (multiple calls). 2.- Save raw objects to S3 to create datalake. 2.- Make one transformation from one JSON schema to another JSON schema. 3.- Save transformed JSON into DBs. (Probably DynamoDB and/or OpenSearch Service) These are the main characteristics of the flow. We are open to any further suggetions toi improve it if needed. Thank you.
Projektazonosító: 35994581

A projektről

9 ajánlat
Távolról teljesíthető projekt
Aktiválva: 1 évvel ezelőtt

Szeretne pénzt keresni?

A Freelancer oldalán történő árajánlatadás előnyei

Határozzon meg költségvetést és időkeretet
Kapja meg fizetését a munkáért
Vázolja ajánlatát
Ingyen regisztrálhat és adhat árajánlatot munkákra
9 szabadúszó adott átlagosan $207 USD összegű árajánlatot erre a munkára
Felhasználó avatár
Hi there, I am Rashid. Hope you are doing great. Firstly about the Create an ETL flow with AWS Glue -- 2 that I have a great experience in it. I am very confident to pull it off once awarded. I have good experience in Data Science and Amazon Web Services. I am a Full stack developer with a team of experienced developers, So it would be my pleasure to build long term relationship with you. All my skills are related to this particular project. Please let me know what is needed to secure the bid! Thanks for your consideration. Rashid Amjad.
$250 USD 8 napon belül
5,0 (23 értékelés)
5,9
5,9
Felhasználó avatár
Hi,I reviewed the project details and understand your requirement (each process flow) to create a Data Pipeline for Data Lake. I acn develop the pipeline from End to End Process in less than and cosst-effective way. Let's connect and discussion more on it. Short Into about Me: Currently working in one of the Big4 Companies and solving Big Data Business problem using AWS Cloud and Pyspark Engine. I have expertise on the following Tools/Technologies: - AWS Cloud Services (DynamoDB, S3, Glue Lambda, EC2, Athena, Step function, EC2, ECS, secret manager (kms), s3, sns, ses, sqssqs, cloudwatch etc) - Apache Spark (PySpark) - Python3, unit test script, Numpy, Pandas - Creation of cloud formation templates for various AWS Services - CI/CD Pipelines - SQL/MySQL - Git, GitHub, BitBucket - Big Data Pipelines - IBM DB2 - MS Excel, MS Office - PyCharm, VSCode, Databricks, Jupyter Notebook, MS Excel, Putty Please provide more details if it's more than what you have given in the project details. Thank you! Thanks & Regards, Prakash
$200 USD 7 napon belül
5,0 (2 értékelés)
2,1
2,1
Felhasználó avatár
Hello my Client, I can help you build full flow with CI/CD and support you maintain your ETL in the future. It will be very easy to maintain, update new code or even add more ids as you want. Please contact me via chatbox, i am very interesting with your project. I setup this kind of project lots time before Thank you
$250 USD 2 napon belül
5,0 (1 értékelés)
1,1
1,1
Felhasználó avatár
HhI I am experienced in and I can start right now but i have few doubts and questions lets have a quick chat and get it started waiting for your replyyy
$140 USD 7 napon belül
0,0 (0 értékelés)
0,0
0,0
Felhasználó avatár
hello . I have large experience in ETL automation tasks and i worked on similar projects to what you are looking for, and I am confident I can exceed your expectations. I can achieve the results that you are asking for Looking forward to hearing from you
$370 USD 7 napon belül
0,0 (0 értékelés)
0,0
0,0
Felhasználó avatár
Hi, Just entering as freelancer. I have 13+ years of experience in IT various tools including DevOps, AWS cloud and Other infrastructure n SDLC process. Have recent experience in AWS cloud formation, building infrastructure as code, migration of on-premises applications to cloud. As addition holding below certificates: AWS Solutions Architect associate AWS developers Associate Azure Solutions Architect Expert.
$140 USD 7 napon belül
0,0 (0 értékelés)
0,0
0,0
Felhasználó avatár
I hope you are doing great! We are one of the upcoming Salesforce consulting firms in India. We have enterprise-grade offerings that span from contracting technical resources to Salesforce development and DevOps; our services include Salesforce Consultation, Cloud Consulting (AWS/ Azure), Resource Contracting, and so on. I would love to discuss this in detail and present our portfolio of services to you; kindly suggest a suitable date and time so I can schedule a call accordingly. Quick overview of our services – • Salesforce Resource contracting • Salesforce Integration • Salesforce development • AWS/Azure Implementation, Migration, and management. • Subcontracting • Data base I am looking forward to your response.
$240 USD 7 napon belül
0,0 (0 értékelés)
0,0
0,0
Felhasználó avatár
I use AWS glue everyday. I have very deep understanding about Glue and Spark. From what you described I can see the REST api call might need some additional development, as the rest of operations are natively supported by built-in functions or connector of Glue/Spark. For Rest API data source. I can parallelise the API call (if applicable) to maximise the job performance. I gonna use RDD to do this part. This is my first time using freelancer. I am going to build my reputation here. So pricing is not a problem. I can complete this project for you regardless how complicated it is.
$120 USD 2 napon belül
0,0 (0 értékelés)
0,0
0,0

Az ügyfélről

MEXICO zászlója
Benito Juarez, Mexico
0,0
0
Fizetési mód hitelesítve
Tagság kezdete: febr. 15, 2023

Ügyfél-hitelesítés

Köszönjük! E-mailben elküldtük a linket, melyen átveheti ajándék egyenlegét.
E-mailje elküldése során valami hiba történt. Kérjük, próbálja újra.
Regisztrált Felhasználók Összes Közzétett Munka
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Előnézet betöltése
Hozzáférést adott a helymeghatározáshoz.
Belépési munkamenete lejárt, és kijelentkeztettük. Kérjük, lépjen be újra.