Roles & Responsibilities
- The Data Engineer’s primary role is working within a very dynamic team
- This role must help elevate the team’s quality.
- The Data Engineer will work closely with Data Analysts, Data Scientists, and business and technical teams to deliver secure, reliable, fault-tolerant, scalable, quality, and efficient outcomes.
Key Responsibilities
- Develop, construct, test, and maintain data architectures (e.g., databases, large-scale processing systems)
- Build high-quality data pipelines using Spark/Scala
- Implement best software engineering practices, including Git version control, code reviews, and unit testing
- Collaborate with data scientists and architects to deliver top-notch data solutions
- Debug and troubleshoot issues in data pipelines and other data systems
Education
- Bachelor’s degree in Engineering, Bachelor’s in Computer applications or Master’s in Computer Applications
Skills & Knowledge
- 3+ years of experience in software engineering
- Strong proficiency in Spark and Scala
- Strong communication and interpersonal skills
- Familiarity with Git and unit testing frameworks
- Excellent problem-solving skills
Good to Have
- Previous experience in a Data Engineering role
- Knowledge of Informatica or similar ETL tools
- Experience with cloud platforms like AWS, Azure, or GCP