Dataproc

Responsibilities

The Senior Principal Analyst will be responsible for driving large multi-environment project end to end and will act more of individual contributor

– Design and develop reusable classes for ETL code pipelines and responsible for optimistic ETL framework design.

– Plan and execute the projects and be able to guide the junior folks in the team.

– Excellent presentation and communication skills, and strong team player

– Experience in working with clients, stakeholders, product owners to collect requirements and creating solutions, estimations.

Qualifications & Experience:

– 5+ years of experience solutioning and design in data & analytics projects

– Strong in Data Modelling Skills, Data Warehousing, and Architecture with ETL & SQL Skills

– Experience in handling multiple projects as Data Architect and/or Solution Architect

– 6+ years of Big Data Processing technologies such as Spark, Hadoop etc.

– 6+ years’ experience in Programming Python/Scala/Java & Linux shell scripting

– 6+ years of hands-on experience in implementing data Integration frameworks to ingest terabytes of data in batch and real-time to an analytical environment.

– 3+ years of experience in developing big data applications in Cloud (AWS/GCP/Azure and/or Snowflake)

– Deep knowledge of Database technologies such as Relational and NoSQL

– Hands on experience with ETL pipeline development and functional programming preferably with Scala, Python, Spark, and R

– Must be good in developing ETL layer for high data volume transaction processing.

– Experience with any ETL tool (Informatica/DataStage/SSIS/Talend) with Data modelling, and Data warehousing concepts

– Good to have jobs execution/debugging experience with PySpark, PyKafka classes, with combination of Docker containerization.

– Agile/Scrum methodology experience is required.