Data Engineer 1

Zygna

Location

Bengaluru

Employment

Full Time

Experience

2+ years

Salary

₹Not Available

About the role

Focus on topics such as data engineering design and development, large-scale distributed data platforms, data pipeline management, data governance, and collaboration in a geographically distributed team environment.

Responsibilities

Build and operate a multi PB-scale data platform.
Design, code, and develop new features/fix bugs/enhancements to systems and data pipelines (ETLs) while adhering to the SLA.
Identifying anomalies, inconsistencies in data sets and algorithms and flagging it to the relevant team and / or fixing the bugs in the data workflows where applicable.
Follow the best engineering methodologies towards ensuring performance, reliability, scalability, and measurability.
Collaborate effectively with teammates, contributing to an innovative environment of technical excellence.

Full description

Your responsibilities will include Build and operate a multi PB-scale data platform. Design, code, and develop new features/fix bugs/enhancements to systems and data pipelines (ETLs) while adhering to the SLA. Identifying anomalies, inconsistencies in data sets and algorithms and flagging it to the relevant team and / or fixing the bugs in the data workflows where applicable. Follow the best engineering methodologies towards ensuring performance, reliability, scalability, and measurability. Collaborate effectively with teammates, contributing to an innovative environment of technical excellence. You will be a perfect fit if you haveBachelor’s degree in Computer Science, or a related technical discipline (or equivalent). 2+ years of strong data engineering design/development experience in building large-scale, distributed data platforms/products. Advanced coding expertise in SQL & Python/JVM-based language. Exposure to heterogeneous data storage systems like relational, NoSQL, in-memory etc. Knowledge of data modeling, lineage, data access and its governance. Proficient in AWS services like Redshift, Kinesis, Lambda, RDS, EKS/ECS etc. Exposure to open source software, frameworks and broader powerful technologies (Airflow, Kafka, DataHub etc). Shown ability to deliver work on time with attention to quality. Excellent written and spoken communication skills and ability to work optimally in a geographically distributed team environment.