Senior Data Engineer - Databricks

JOB TITLE: Senior Data Engineer LOCATION: Pune EMPLOYMENT TYPE: Full Time EXPERIENCE REQUIRED: 3+ Years ABOUT THE ROLE: We are seeking a Senior Data Engineer with 3+ years of hands-on experience in building and optimizing large-scale data systems, with strong expertise in Databricks. The ideal candidate has deep experience in designing cloud-based data architectures, building high-performance data pipelines, and enabling analytics and machine learning use cases. You will be responsible for architecting scalable data platforms, leading complex data initiatives, and collaborating with cross-functional teams to deliver reliable, secure, and production-ready data solutions. KEY RESPONSIBILITIES: • Design, build, and optimize scalable data pipelines using Databricks • Develop and maintain Spark and PySpark jobs for large-scale data processing • Implement ETL/ELT workflows for structured and semi-structured data • Architect modern data lakehouse solutions using Databricks • Design data models to support analytics, BI, and ML use cases • Integrate cloud storage solutions such as AWS S3 or Azure Data Lake • Implement data orchestration using tools like Airflow or Databricks Workflows • Ensure data quality, governance, security, and compliance standards • Monitor performance and optimize jobs for cost and scalability • Collaborate with analytics, product, and engineering teams • Mentor junior engineers and participate in code reviews SKILLS REQUIRED: • Strong expertise in Databricks and Lakehouse architecture • Hands-on experience with Apache Spark and PySpark • Proficiency in SQL and advanced data modeling concepts • Experience with cloud platforms such as AWS or Azure • Experience building scalable ETL/ELT pipelines • Understanding of Delta Lake and data versioning • Knowledge of data warehousing concepts and performance tuning • Experience with orchestration tools such as Airflow • Strong problem-solving and debugging skills • Ability to lead technical discussions and guide teams PREFERRED QUALIFICATIONS: • Bachelor’s or Master’s degree in Computer Science, Engineering, or related field • Experience working with large datasets in distributed environments • Exposure to CI/CD pipelines for data engineering • Familiarity with data governance and security best practices • Experience supporting ML or AI-driven data workloads KEY ATTRIBUTES: • Ownership mindset and accountability • Strong communication and stakeholder management skills • Attention to detail and quality focus • Continuous learning attitude and adaptability This role is ideal for a Data Engineer who wants to take ownership of scalable data platforms and drive high-impact data initiatives using Databricks.