Data Engineer with Machine Learning and Hadoop Experience

Company: Kodo Digital Systems Inc
Location: Clifton, New Jersey, United States
Type: Full-time
Posted: 09.JUN.2021


Job Title:- Data Engineer with Hadoop & Machine Learning Location:- NJ Duration:- 12+ Months Skills :- Must Hadoop & ML Job Description:-...


Job Title:- Data Engineer with Hadoop & Machine Learning

Location:- NJ
Duration:- 12+ Months

Skills :- Must Hadoop & ML

Job Description:-

Designing and developing machine learning and deep learning data pipelines via Hadoop, spark, kafka, pulsar and etc.
Research and implement appropriate ML algorithms and tools
Extend existing ML libraries and frameworks
Performance tuning and diagnose/resolve technical issues.
Design and implement error handling mechanisms to ensure system stability and security.
Design and implement solutions across multiple layers of the technology stack, including data processing, database, web services, network, and user security.
Assist UI and client side engineers to assure the system meets overall goals.
Perform integration testing and assist QA on large projects.
Contribute to requirements analysis, project estimation, design, coding, and testing.
Suggest and implement third party libraries and software in the product when appropriate.
Deliver applications that meet performance and scalability goals of the project.
5+ years of experience in a commercial Product Development environment
Hands on experience with Java, Python, Scala or other modern data processing and manipulation programming tools/skills
Demonstrated strength working with large scale distributed database systems, transaction processing, and parallel processing in a cluster-computing environment (i.e., Map Reduce, Spark)
Experience with Kafka from both an administrative and client perspective
Experience developing software products using Scala for Spark parallel processing cluster environments

Experience with server-side JavaScript, REST API software implementations
Experience delivering real-time ML model training and prediction, big data analytics systems, and visualization dashboards

Strong written and verbal communication skills, and interpersonal skills which facilitate team work
Educational Requirements:
MS degree required. PHD preferred.

With Regards,


- provided by Dice

Apply Now


Loader2 Processing ...