Technical Lead – Data engineering & Tableau

 

Mandate Skills: AWS – AWS S3, Lambda, Glue, Step function, Redshift, dynamo DB, Quick sight, Python

Required Technical Skills

  • CI/CD Pipeline Development:
  • Design, implement, and optimize CI/CD pipelines using Jenkins, CircleCI, or GitLab to support rapid software development and deployment.
  • Manage and troubleshooting build processes, ensuring high availability and performance.

AWS Services Management

  • Architect, deploy, and manage data warehousing solutions using AWS Redshift, ensuring data integrity and security.
  • Utilize AWS Glue for ETL processes, ensuring seamless data integration and transformation across various sources.

Automation and Scripting

  • Develop and maintain automation scripts using Python, Bash, or similar languages to streamline processes and reduce manual efforts.
  • Implement monitoring and alerting solutions to proactively identify and resolve issues.

Collaboration and Support

  • Partner with software development teams to understand application requirements and translate them into scalable and maintainable CI/CD solutions.
  • Provide technical support and guidance to team members and stakeholders regarding best practices in DevOps and data management.

Documentation and Process Improvement

  • Maintain comprehensive documentation of system configurations, deployment processes, and operational procedures using Confluence.
  • Conduct regular reviews of existing processes to identify areas for improvement and implement solutions.

Security and Compliance

  • Ensure that CI/CD processes and AWS resources adhere to security best practices and compliance requirements.
  • Regularly audit and refine security policies related to data access and infrastructure management.
  • Experience with containerization technologies (e.g., Docker, Kubernetes) and orchestration tools.
  • Familiarity with other AWS services (e.g., S3, Lambda, EC2) and their integration with data workflows.
  • Knowledge of infrastructure as code (IaC) tools such as Terraform or Cloud Formation.
  • Understanding of Agile methodologies and experience working in Agile environments.
  • Familiarity with Confluence for documentation and team collaboration.

Secondary skill – Tableau

  • Experience with enterprise data management technologies, including database platforms, ETL tools Informatica, Power BI and Big Data
  • Experience with data modeling for OLPT, Data Lake, Data Warehousing and Big data environments
  • Experience in Amazon S3, AWS Redshift & Amazon Glue
  • Experience with Cloud and Microservices based Architecture (SOA), enterprise data management, information security, applications development, and cloud-based architecture with federal clients.
  • Experience working as a member of distributed data architecture teams
  • Experienced in Determining database structural requirements by analyzing client operations, applications, and programming; reviewing objectives with clients; evaluating current system
  • Experience in developing database solutions by designing proposed system, defining database physical structure and functional capabilities, security, back-up, and recovery specifications
  • Installs database systems by developing flowcharts; applying optimum access techniques; coordinating installation actions; documents actions.
  • Experience in maintaining database performance by identifying and resolving production and application development problems; calculating optimum values for parameters; evaluating, integrating, and installing new releases; completing maintenance; answering user questions.
  • Experience in Coding utilities, database support, responding to user questions, and resolving problems.
  • Accomplishes information systems and organization mission by completing related results as needed
  • Supervising and guiding the entire Data architectural implements
  • Strong Data modeling skills to Design conceptual and logical data models and flowcharts
  • Experience in Erwin or equivalent Data modeling too
  • Strong with Governance, Architecture processes, best practices and structure
  • Strong in analytical skills and defining architecture best suited for the organization (using companies approved stack and tools
  • Understanding information systems and data life-cycle management, the best practices and methodologies, formal systems engineering life cycle (SELC), and systems development life cycle (SDLC)
  • Strong with Project Management and project planning kills.
  • Good knowledge of SDLC for projects using DW concepts and Client/Server technologies.
  • Well versed with Backup Procedure, Data security and GDPR

Interpersonal Skills

  • Well-developed analytical & problem-solving skills
  • Strong oral and written communication skills
  • Excellent team player, able to work with virtual teams
  • Ability to learn quickly in a dynamic start-up environment
  • Excellent leadership skills with the ability to lead and guide and groom the team
  • Self-motivated and capable of working independently with minimal management supervision
  • Able to talk to clients directly and report to clients/onsite
  • Flexibility to work on different Shifts and Stretch
  • Flexible to travel and relocate in India and Abroad
  • Industry Knowledge (Any one as per requirement)
  • Good Domain Knowledge of Investment Management & Finance/ Banking with Credit cards / Life insurance products / healthcare industry / Retail / telecom

Good to have

  • PL/SQL programming skills
  • Unix working knowledge
  • Exposure to Alteryx, Spot Fire, Jasper, Cognos BI is an added advantage.
  • Data Modelling

 

 

Job Category: Data Engineering
Job Type: Full Time
Min Experience: 10 years
Max Experience: 14 years

Apply for this position

Allowed Type(s): .pdf, .doc, .docx