Need Help Implementing [login to view URL] on Video Inputs for Machine Learning

Lezárva Kiadva: 3 évvel ezelőtt Kiszállításkor fizetve
Lezárva Kiszállításkor fizetve

I'm training a video classification model using TensorFlow and Keras. Currently my data pipeline is a custom generator than reads the raw video file, do some preprocessing and feed the processed data into the model batch by batch. However, this is really slow and not scalable to large datasets.

I'm currently running the model on my university's high performance computing server, which allows me to request up to 28 cpu cores (with up to 128 gb of memory each) and 4 gpu cores per job. However, my custom generator, which processes videos sequentially are not utilizing these resources for speedup and is pretty much stuck at the I/O disk reading and video pre-processing part.

I'm unfamiliar with [login to view URL] pipeline but heard that it can prefetch data. I also heard about parallel processing but I'm unable to implement these by myself. So I'm asking for your help to write a code that can prefetch video data, do parallel processing of my videos and utilize the resources provided so that the speed of the training and prediction can be increased.

I'm going to give you more information in the chat room.

This will be ongoing work if it goes well.

Python C++ Programozás Machine Learning (ML) C programozás Szoftverarchitektúra

Projektazonosító: #27500724

A projektről

16 ajánlat Távolról teljesíthető projekt Utoljára aktív: 3 évvel ezelőtt

16 szabadúszó tett átlagosan 1183$ összegű árajánlatot erre a munkára

AwaisChaudhry

Hello there, How are you doing? Just saw your project posted. I read the brief details and I felt I could help you with it. Lets start the chat and discuss it in detail. Please check my porfolio: My Portfolio: https:/ Továbbiak

$1500 USD 12 napon belül
(74 vélemény)
8.0
sgadou

Hi, there. I am a machine learning engineer with 5+ years of hands-on experience in Tensorflow. Carefully checked your requirements. Hope to work for you with this project. Best regards, Sgadou

$1125 USD 7 napon belül
(15 vélemény)
5.2
obsurf

Hello, I am very interested on your project, and I have confident to complete your work. I am a talented developer and have been developing software for years. I am confident to finish your task in time, I wish to work Továbbiak

$1200 USD 7 napon belül
(5 vélemény)
5.0
sajjadtaghvaeifr

Hi, I hope you are doing fine. I have almost 10 years of experience in machine learning algorithms. I can implement various types of artificial intelligence algorithms including yours with Matlab, Python, JAVA, etc. I Továbbiak

$1125 USD 7 napon belül
(8 vélemény)
4.1
engrhassanwali

Hello! I have read your project details completely and thoroughly. I am Python and have 10 years experience. Further details will be discuss in the inbox. I am waiting for your message to discuss it. Th Továbbiak

$1500 USD 14 napon belül
(3 vélemény)
3.5
rbn2000

I am currently pursuing my Masters in Data science and thus have a lot of experience, 2+ years to be exact, in the field of ML using python. I have done several projects such Real time hand emoji detection, Music genre Továbbiak

$1200 USD 2 napon belül
(0 vélemény)
0.0
omartini

Hello Thanks for your opportunity to apply this project. I have 7 years experience of computer vision and machine learning. So i have full skills and experience of this field, and have developed a lot of projects such Továbbiak

$1125 USD 7 napon belül
(0 vélemény)
0.0