Data Engineering

Data Engineer (GCP)

Responsibilities

We are seeking a highly skilled and motivated Senior Principal Analyst to join our team. The ideal candidate will possess
a strong technical background with expertise in various programming languages and data technologies, coupled with
exceptional business acumen and communication skills. As a Senior Principal Analyst, you will be responsible for leading
technical initiatives, designing innovative solutions, and providing expert consultation to our clients.

Key Responsibilities:
Technical:
• Proficiency in programming languages including Python, SQL, Spark, and PySpark.
• Extensive experience in Data Warehousing, Solution Architecture, ETL processes, and SQL skills.
• In-depth knowledge of data integration frameworks and techniques.
• Hands-on experience with Cloud platforms such as AWS, GCP, Azure, and/or Snowflake.
• GCP knowledge including experience in Big Query, Dataflow, Cloud Composer, Dataproc and GCS
• 5+ years of experience in solutioning and design in data & analytics projects
• Experience in handling multiple projects as a Data Architect and/or Solution Architect
• 5+ years of hands-on experience in implementing data Integration frameworks to ingest terabytes of data in batch
and real-time to an analytical environment
• 3+ years of experience in Cloud data migration (GCP preferred)
• Hands-on experience with ETL pipeline development and functional programming

Business:
• Ability to translate complex business problems into technical solution architectures.
• Develop and demonstrate Proof of Concepts (POCs) related to data ingestion and data quality.
• Design and implement frameworks and reusable codes to streamline processes.
• Conduct technical client presentations and provide consulting services to clients.

Behavioural:
• Demonstrated passion for the role and commitment to the company’s objectives.
• Strong technical aptitude and ability to stay updated with the latest technological trends.
• Excellent written and verbal communication skills.
• Analytical and creative thinking abilities to solve complex problems.
• Collaborative mindset with the ability to work effectively in a team environment.
• Self-driven and proactive approach towards achieving goals.

Qualifications:
• Bachelor’s or master’s degree in computer science, Information Technology, or related field.
• Minimum of 10 years of experience in a similar role with recent 8 years of relevant experience
• Proven track record of successfully delivering technical solutions to clients.
• Relevant certifications in programming languages, data technologies, or cloud platforms would be advantageous.

Data Engineer (GCP) Read More »

Data Engineer (AWS)

Job description:

We are seeking a highly skilled and motivated Senior Principal Analyst to join our team. The ideal candidate will possess
a strong technical background with expertise in various programming languages and data technologies, coupled with exceptional business acumen and communication skills. As a Senior Principal Analyst, you will be responsible for leading
technical initiatives, designing innovative solutions, and providing expert consultation to our clients.

Key Responsibilities:

Technical:
• 8+ years of experience solutioning and design in Data engineering
• Strong in Data Modelling Skills, Data Warehousing, and Architecture with ETL & SQL Skills
• Experience in handling multiple projects as Data Architect and/or Solution Architect
• Hands on in creating data architecture
• 6+ years of Cloud technologies such as AWS/Snowflake etc.
• 6+ years’ experience in Programming Python / Pyspark
• 6+ years of hands-on experience in implementing data Integration frameworks to ingest terabytes of data in
batch and real-time to an analytical environment.
• 5+ years of experience in developing big data applications in Cloud (AWS and Snowflake)
• Deep knowledge of Database technologies such as Relational and non-relational databases
• Hands on experience with ETL pipeline development
• Must be good in developing ETL layer for high data volume transaction processing.
• Experience with any ETL/ELT preferred DBT tool with Data modelling, and Data warehousing
concepts.
• Agile/Scrum methodology experience is required.
Business:
• Ability to translate complex business problems into technical solution architectures.
• Develop and demonstrate Proof of Concepts (POCs) related to data ingestion and data quality.
• Design and implement frameworks and reusable codes to streamline processes.
• Conduct technical client presentations and provide consulting services to clients.
Behavioral:
• Demonstrated passion for the role and commitment to the company’s objectives.
• Strong technical aptitude and ability to stay updated with the latest technological trends.
• Excellent written and verbal communication skills.
• Analytical and creative thinking abilities to solve complex problems.
• Collaborative mindset with the ability to work effectively in a team environment.
• Self-driven and proactive approach towards achieving goals.

Qualifications:
• Bachelor’s or master’s degree in engineering and technology

Data Engineer (AWS) Read More »

Senior Principal Analyst (SPA) – Data Engineering

Responsibilities

The Senior Principal Analyst will be responsible for driving large multi-environment project end to end and will act more of individual contributor

– Design and develop reusable classes for ETL code pipelines and responsible for optimistic ETL framework design.

– Plan and execute the projects and be able to guide the junior folks in the team.

– Excellent presentation and communication skills, and strong team player

– Experience in working with clients, stakeholders, product owners to collect requirements and creating solutions, estimations.

Qualifications & Experience:

– 5+ years of experience solutioning and design in data & analytics projects

– Strong in Data Modelling Skills, Data Warehousing, and Architecture with ETL & SQL Skills

– Experience in handling multiple projects as Data Architect and/or Solution Architect

– 6+ years of Big Data Processing technologies such as Spark, Hadoop etc.

– 6+ years’ experience in Programming Python/Scala/Java & Linux shell scripting

– 6+ years of hands-on experience in implementing data Integration frameworks to ingest terabytes of data in batch and real-time to an analytical environment.

– 3+ years of experience in developing big data applications in Cloud (AWS/GCP/Azure and/or Snowflake)

– Deep knowledge of Database technologies such as Relational and NoSQL

– Hands on experience with ETL pipeline development and functional programming preferably with Scala, Python, Spark, and R

– Must be good in developing ETL layer for high data volume transaction processing.

– Experience with any ETL tool (Informatica/DataStage/SSIS/Talend) with Data modelling, and Data warehousing concepts

– Good to have jobs execution/debugging experience with PySpark, PyKafka classes, with combination of Docker containerization.

– Agile/Scrum methodology experience is required.

Senior Principal Analyst (SPA) – Data Engineering Read More »

Scroll to Top