Apply at : https://mycrisil.darwinbox.com/ms/candidate/careers/a617bff0b05ba2
Job title
ETL developer (Big Data Engineer)
Location
Mumbai / Pune / Bangalore
Role
- As a ETL developer, you will:
- Work for a leading banking client on Apache Spark and Java applications, with a strong focus on functional programming
- Work in 7-9 member scrum teams to deliver a specific feature of a new application, which is being built by integrating two large applications and developing new services
- Work on latest technologies with a strong focus on performance, large data sets and towards event-driven architecture/calculations
- Interact with Bigdata and focus on performance & real time analytics
- Interpret business requirements with the Product Owner and Feature Engineer during the refinement session, break down the tasks, estimate the Story Points to develop, test and harden this feature with colleagues, and deliver and support it on the production environment to global users
- Design and develop various database queries, scripts and tables to pull, clean, arrange and persist risk management data
Qualification
Bachelor or Master Degree in Computer Science , Cybernetics, Software Engineering, Financial Engineering or equivalent
Skills required
- Programming: Java 8 is must, Scala / Python are good to have but not mandatory
- Development / ETL Frameworks: Spark, Kafka, Hive, Junit
- Database: HBase
- Testing: Unit, integration and functional test automation and delivery.
- Knowledge of SQL query engines namely, Impala and Presto
- Stream and batch processing frameworks namely, Apache Flink and Storm
- Strong understanding of agile methodology of delivery. Ideal if there is past experience of delivering projects on Scrum
- Experience with any dependency injection framework
- Familiarity with tools such as Confluence, JIRA, Fortify, Gitlab, Jenkins, Maven.
Soft skills:
- Strong communication skills – ability to articulate, present ideas and engage with an international audience
- Self-motivated and problem solving attitude
- Experience on participating in end-to-end development lifecycle in a rigorous test driven software development environment
- Attention to detail and problem solving skills & Follows clean code principles
|