Sr. Data Engineer
Full time
|
4+
YEARS
|
Pune-IN
Roles and Responsibilities
The Senior Data Engineer will have deep hands-on experience in data engineering concepts and will work extensively with AWS and GCP.
- Design, develop, and maintain scalable data pipelines and ETL processes.
- Collaborate with data scientists and analysts to understand data requirements.
- Optimize data architecture for performance and cost-efficiency.
- Implement data governance and security measures.
- Provide technical guidance and mentorship to junior data engineers.
- Ensure data quality and reliability across the organization.
Technical Expertise
- Bachelor’s degree in Computer Science, Engineering, or related field.
- 4+ years of experience in data engineering.
- Strong proficiency in AWS and GCP cloud services.
- Over 1-2 years of hands-on experience in a programming language such as Python, Java, or Scala.
- Database Skills: A strong understanding of SQL is essential.
- Big Data Technologies: Proficiency with Hadoop, Hive, Yarn, and Sqoop.
- Data Pipeline & Scheduler Tools: Hands-on experience with Oozie, Airflow, or Nifi.
- Streaming Engines: Knowledge of Kafka, Storm, or Spark Streaming.
- Database and ETL: Experience with any relational database or data warehouse, as well as ETL tools.
- Pipeline Design & Application Development: Practical experience in pipeline design, ETL processes, and application development.
- Ability to work in a dynamic, young environment with intercultural aspects.