Hadoop Jobs

Looking for Hadoop Hive Experts I am seeking experienced Hadoop Hive experts for a personal project. Requirements: - Advanced level of expertise in Hadoop Hive - Strong understanding of big data processing and analysis - Proficient in Hive query language (HQL) - Experience with data warehousing and ETL processes - Familiarity with Apache Hadoop ecosystem tools (e.g., HDFS, MapReduce) - Ability to optimize and tune Hadoop Hive queries for performance If you have a deep understanding of Hadoop Hive and can effectively analyze and process big data, then this project is for you. Please provide examples of your previous work in Hadoop Hive and any relevant certifications or qualifications. I am flexible with the timeframe for completing the project, so please let me know your availability...

I am looking for an experienced AI DevOps Engineer with expertise in Natural Language Processing (NLP). Skills and Experience: - Strong understanding of NLP technologies and algorithms - Proven experience in improving existing AI models - Familiarity with DevOps practices and tools - Ability to work within a 1-3 month timeline Project Details: - The project involves improving an existing AI model using NLP techniques. - The ideal candidate will have a deep understanding of NLP and the ability to optimize and enhance the model. - The project timeline is 1-3 months, and it is crucial to adhere to the agreed-upon timeframe. - Effective communication and collaboration skills are essential to ensure successful project completion. If you have the necessary skills and experience in NLP and AI...

I am looking for an experienced AWS developer to migrate my AWS Glue ETL Jobs along with Glue workflow to another AWS environment. i also want to migrate s3 bucket folders as well. the iDea is that i have an aws environment in which i have put files on s3 and using AWS glue to load data from it and load back into s3 itself. i want a way to migrate this solution into another aws environment via cloud formation or other mechanism Requirements: - Strong experience with AWS Glue and ETL Jobs - In-depth knowledge of AWS environments and their capabilities - Ability to migrate ETL jobs within a short timeline (1-2 days) The ideal candidate should have experience in AWS migration projects and be able to provide recommendations on the best AWS environment to migrate the ETL jobs to. Additionally...

I am looking for a Spark Scala developer with intermediate experience to assist with data processing and analysis. The specific tasks for this project include building machine learning models and developing Spark applications. There is no specific deadline for the project, allowing for flexibility in completing the tasks. The ideal candidate should have intermediate experience in Spark Scala development and be proficient in data processing and analysis techniques.

I am looking for a freelancer who can help me with a Cloud-based data virtualization solution. I have a rough idea of the software I want to use, but I am open to suggestions. Ideally, the freelancer should have experience with the following: - Cloud-based data virtualization - Knowledge of Denodo, Cisco Data Virtualization, or Red Hat JBoss Data Virtualization - Proficiency in Excel and Python The main goal of this project is to create a data virtualization solution that meets my specific requirements. I am looking for someone who can help me optimize my data management processes and ensure seamless integration with my existing systems.

I am looking for a Kafka Admin who can assist me with the following tasks: - Onboarding Kafka cluster - Managing Kafka topics and partitions - Its already available in the company and we need to onboard it for our project . -Should be able to Size and scope . - We will start with small data ingestion from Hadoop datalake . -Should be willing to work on remote machine . The ideal candidate should have experience in: - Setting up and configuring Kafka clusters - Managing Kafka topics and partitions - Troubleshooting Kafka performance issues The client already has all the necessary hardware and software for the Kafka cluster setup.

Over the past years, I have devoted myself to a project involving Algorithmic Trading. My system leverages only pricing and volume data at market closing. It studies technical indicators for every stock in the S&P 500 from its IPO date, testing all possible indicator 'settings', as I prefer to call them. This process uncovers microscopic signals that suggest beneficial buying at market close and selling at the next day's close. Any signal with a p-value below 0.01 is added to my portfolio. Following this, the system removes correlated signals to prevent duplication. A Bayesian ranking of signals is calculated, and correlated signals with a lower rank are eliminated. The result is a daily optimized portfolio of buy/sell signals. This system, primarily built with numpy...