Senior Data Engineer

Senior Data Engineer Alternative Path is seeking skilled software developers to collaborate on client projects with an asset management firm. In this role, you will collaborate with individuals across various company departments to shape and innovate new products and features for our platform, enhancing existing ones. You will have a large degree of independence and trust, but you won't be isolated; the support of the Engineering team leads, the Product team leads, and every other technology team member is behind you. This is an opportunity to join a team-first meritocracy and help grow an entrepreneurial group inside Alternative Path. You will be asked to contribute, given ownership, and will be expected to make your voice heard. Role Summary Design and implement Python-based data ingestion pipelines using a proprietary data onboarding platform to orchestrate and schedule workloads on an AWS-hosted Kubernetes environment. Pipelines ingest data from external vendors via SFTP, S3, Snowflake, and REST APIs; land raw data in Amazon S3; and transform it into curated, query-ready tables in Snowflake and Iceberg. You will work closely with Data Managers and Software Engineers to understand existing legacy Apache Airflow logic, and translate those requirements into efficient, well-tested implementations on the firm’s strategic ingestion platform. Apply AI/LLM-assisted tooling to accelerate pipeline configuration, automate documentation, and strengthen data quality validation and monitoring. Role Overview The Data Team is seeking a creative and detail-oriented developer to contribute to projects. The team develops critical applications to onboard vendor data sets into our data warehouse, including data ingestion, parsing, normalization and quality controls. The team mission is to deliver data to downstream data scientists and analysts with a high degree of resilience, velocity and adaptability to onboard new data sets. We are seeking someone who is self-motivated, self-sufficient, with a passion for tinkering and a love for automation. In your role, you will: ➢ Collaborate with other software engineers to understand and resolve requirements ➢ Design and implement data pipelines in Python/Pandas ➢ Implement test harnesses to extensively test new pipelines ➢ Develop and enhance core library functions to provide robust data processing features ➢ Implement observability and alerting features with Open Telemetry and Prometheus Qualifications Must have ➢ Bachelor’s or Master’s degree in computer science or engineering ➢ 5 years software development experience ➢ Strong experience building enterprise solutions in Python ➢ Pandas and data science transformation logic ➢ Experience of Apache Airflow ➢ Experience of CSV and Parquet data formats ➢ Exposure to SQL queries (basic queries and joins) Preferred ➢ AWS experience including Kubernetes ➢ S3 experience ➢ Familiarity with Databricks Job Title Senior Data Engineer Location Gurgaon, India (You may note that this role is fully remote) Interview Process The selection process comprises two key stages. In the first stage, candidates will undergo screening and interviews conducted by Alternative Path’s experienced team. This phase is designed to assess the candidate’s overall fit for the role, including their skills, experience, and cultural alignment. Upon successfully completing the initial stage, candidates will move to the second phase, which involves additional interviews with the client’s team. These discussions will focus more deeply on technical competencies, enabling the client to evaluate the candidate’s proficiency in role-specific areas. All interviews will be conducted remotely, ensuring flexibility and convenience. As part of the process, candidates may be required to complete an online screening test, although this may be waived for certain individuals. However, all candidates will participate in two to three rounds of technical interviews, during which they will be expected to solve problems in a live online environment. To effectively participate in these technical rounds, candidates must have access to a laptop that supports programming tasks, screen sharing, and video communication. Overall, the process is designed to be thorough and fair, providing candidates with the opportunity to demonstrate their expertise while enabling both Alternative Path and the client to make well-informed hiring decisions for this role.