Find Jobs
Hire Freelancers

Migrate a database to support data warehousing, OLAP and big data

$30-250 AUD

Folyamatban
Kiadva ekkor: körülbelül 5 évvel ezelőtt

$30-250 AUD

Teljesítéskor fizetve
This project aims to transform an existing database to support analytical processing (OLAP) for a data-warehouse that holds a huge amount of data and streams more data on daily basis. The analytical tasks are mostly statistical such as mean, variance, normalization, standardization, max, min, median. The challenge here is that the nested queries and the big data make the response time too slow and consumes lots of computational power that takes the server down. The requirement here is : 1. Propose a solution to make these reports more efficient in a way that allows the site to load in less than a second 2. evaluating the performance of current queries 3. Install and configure the necessary needed software to the server (if any) 4. Migrate the database from the current DBMS (MySQL) to the new DBMS 5. Migrate the views and nested queries in the current database to be efficiently implemented in the new database 6. Review each SQL statements to and propose how it can be optimized to run in the most efficient way 7. Create and optimize materialized views + triggers as needed 8. optimize the performance of the migrated database The deliverable: A new database to be used by the website with response time less than 3 seconds. I will just change the connection string in my site to connect to the new database and it should load the same data from the same views as fast as it can. The new database should be able to handle huge amounts of data (more than 30 million records) Obviously, MySQL does not support nested select statements, so many queries are just created to be used by the end queries for business. The business queries used by the site are listed at the end of the attached document. These queries must be created by the same names in the new database. The other internal queries used implicitly by the main queries can be traced through the code or listed from MySQL Before awarding the project, I will have a chat with each applicant to discuss the proposed solutions, the data warehousing experience and query optimization method.
Projektazonosító: 18770030

A projektről

18 ajánlat
Távolról teljesíthető projekt
Aktiválva: 5 évvel ezelőtt

Szeretne pénzt keresni?

A Freelancer oldalán történő árajánlatadás előnyei

Határozzon meg költségvetést és időkeretet
Kapja meg fizetését a munkáért
Vázolja ajánlatát
Ingyen regisztrálhat és adhat árajánlatot munkákra
18 szabadúszó adott átlagosan $415 AUD összegű árajánlatot erre a munkára
Felhasználó avatár
Hello, I have checked the project requirements. We can discuss further in more details on this task. Thanks.
$250 AUD 5 napon belül
5,0 (25 értékelés)
6,2
6,2
Felhasználó avatár
Hello, I can work on this project. I have much experience working with Data Warehousing. I worked on Target's Store-BI DTK Toolkit with Data Stage as ETL processes, Hyperrol as Multi-Dimmension Data Cubes (OLAP engine) that help reports, and j2ee for the BI reports (200+ report pages with 5000+ online management users) , Database uses IBM DB2 and Oracle. (Target Stores have about 1800+ Brick-Mortar retail stores located throughout the United States) Best Regards, An Ho
$155 AUD 3 napon belül
4,7 (2 értékelés)
3,7
3,7
Felhasználó avatár
I have more than 18 years of experience working on highly regulated environments and supporting large scale database installations. I am here to help you. Please contact me to learn more details about the project. I have careful reviewed the attachment. The
$1 666 AUD 15 napon belül
4,8 (1 értékelés)
2,9
2,9
Felhasználó avatár
Hi, I have 8 years of experience and working on hadoop, spark, nosql, java, BI tools(tableau, powerbi), cloud(Amazon, Google, Microsoft Azure)... Done end to end data warehouse management projects on aws cloud with hadoop, hive, spark and presodb. Worked on multiple etl project like Kafka, nifi, flume, mapreduce, spark with XML/JSON., Cassandra, mongodb, hbase, redis, oracle, sap hana, ASE.... Many more. Let's discuss the required things in detail. I am committed to work done and strong in issue resolving as well. Thanks
$55 AUD 1 napon belül
5,0 (2 értékelés)
3,0
3,0
Felhasználó avatár
We DataLamp, is a Big Data company which works in Java, Data-Pipeline, BI/Visualisation/Reporting & Recommendation solutions. We also provide optimisation in existing architectural design for better performance. We have done projects in which we were supposed to optimise data warehouse response time. Last project to optimise queries of data warehouse was of a telecommunication in which we optimise the queries response time to 1-3 sec which was 30-40 sec. Would look forward to your reply where our solution architect will interact with you. Regards DataLamp
$277 AUD 3 napon belül
5,0 (1 értékelés)
1,0
1,0
Felhasználó avatár
Hi, I have 7+ year of experience in database development and BI implementation. Mostly I worked with Pentaho business suits and most of RDBMS databases. According to my personal experience I suggest you to choose HP vertica db. It has columnar storage support which provides high throughput in aggregating/ analytical queries. It is free till 1tb of storage. Let's have a call for understanding your requirement. I am sure that we will have a good and mutual beneficiary conversation.  Hoping to talk with you soon. Thanks.
$890 AUD 10 napon belül
5,0 (1 értékelés)
1,1
1,1
Felhasználó avatár
Hello We are team of smart developers working in IT industry from past 7-years have developed 200+ simple and complex Mobile phone apps for Android & iPhone, Hybrid app and many Websites in RubyOnRails,WordPress , Dot Net and PHP with a wide range of different features and technologies. Our area of expertise includes Android, iPhone, RubyOnRails, AngularJs, Dot Net , Postgresql, SQl Server, PHP, HTML, Graphics designs etc. Supportive - 24 full-time employees - Full-time customer care - Unlimited design options and revisions - 110% satisfaction guarantee Specialization - Website designing ( E-commerce, Static and Dynamic, Cryptocurrency) -CRM design - Logo design - Illustration - Packaging - Print Design - Animated Videos - brochure design We offer customized and high-quality design services at affordable prices. We promise quick turnaround times, great customer service and 100% original designs ! Thank you!
$250 AUD 3 napon belül
0,0 (0 értékelés)
0,0
0,0
Felhasználó avatár
Hi I am data engineer with 4+ years of experience. I have worked on analytics solutions using both clouds and on premises. I have experience in bi, dwh and big data. Relevant Skills and Experience Proposed solutions 1. Optimize the way we store data that is store in unnormalized way to make retrieval fast 2. Offload the data processing and bring back the data in prepared form for query
$500 AUD 10 napon belül
0,0 (0 értékelés)
0,0
0,0
Felhasználó avatár
Hello , I’m excited to share with you the proposal for this project. As I understand about your project it's truly challenging. I'll assure you that this project will complete within promise day. I’m truly excited to be working with you on your new logo redesign. I look forward to your response. All the best, Soumya
$166 AUD 9 napon belül
0,0 (0 értékelés)
0,0
0,0
Felhasználó avatár
- 7.8 Years of onshore and offshore experience in EIM Technology, specializing in OLAP, ETL, Informatica, IBM DB2, Tableau, Quality Centre, Microsoft Sql Server, JIRA, Data Analysis, Alteryx. - Having a good understanding of Data Warehousing fundamentals including Dimensional Modeling. - Experience for 2 big 4 companies.
$277 AUD 3 napon belül
0,0 (0 értékelés)
0,0
0,0
Felhasználó avatár
Hello, Hope you are doing great ! As per your requirements, I saw a 50+ Tables where your destination source will fetch the data and you require a Analytical Database for this perpose. I having a 2+ years of experience in Data warehouse and Analytics as well as I'm a System Architect and have a experience of GCP platform. I have a solutions for your requirements. Regards Rahul Singh
$333 AUD 10 napon belül
0,0 (0 értékelés)
0,0
0,0
Felhasználó avatár
I have gone through your requirement and I have done similar projects in past. The requirement is similar to what I am doing right now. we have a MySQL OLTP which we have migrated to postgresql. We have build DWH with dimensions and few facts based on reports also build aggregation and summary tables instead of using procedures. The ETL tool which I have been using is pentaho community edition. I hope I am pretty much fit to your requirement.
$777 AUD 15 napon belül
0,0 (0 értékelés)
0,0
0,0
Felhasználó avatár
I will improve your system for the lowest possible price for you! I am researching working with big data as a project in my life and would really love to work on this project to endue more knowledge of subclosed data! ~Greetings from a bigdata fan Joeri m. van Velzen
$35 AUD 0 napon belül
0,0 (0 értékelés)
0,0
0,0

Az ügyfélről

AUSTRALIA zászlója
Geelong, Australia
4,9
37
Fizetési mód hitelesítve
Tagság kezdete: febr. 14, 2006

Ügyfél-hitelesítés

Köszönjük! E-mailben elküldtük a linket, melyen átveheti ajándék egyenlegét.
E-mailje elküldése során valami hiba történt. Kérjük, próbálja újra.
Regisztrált Felhasználók Összes Közzétett Munka
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Előnézet betöltése
Hozzáférést adott a helymeghatározáshoz.
Belépési munkamenete lejárt, és kijelentkeztettük. Kérjük, lépjen be újra.