Principle Duties and Essential Responsibilities:
• Experience managing big data platforms or large data warehouses and data bases (MySQL, Snowflake etc)
• Assume administrative and operational ownership of AWS-based Database services, including MySQL and PostgreSQL
• Conceptualize, build monitoring dashboards, thresholds, alerting to monitor ETL pipelines
• Collaborate with Data Platform engineering team to improve data observability, self recovery of jobs
• Support the high availability and disaster recovery options and work closely with SRE team
• Participate and lead efforts involving incident response and root cause analysis for SRE
• Serve as a subject matter expert on Database Performance, logging, data security and compliance best practices
• Own ETL related issues in production, work and collaborate across Services and engineering team to reduce ETL errors, improve reliability and automate self-healing
What you’ll need to be successful...
• 5-7 years of experience in managing data warehouse, databases in clouded environment
• 4-6 years of experience in ETL tools (eg. CopyStorm, Apache Gobblin)
• 1-2 years experience in supporting and managing snowflake in cost effective way
• Experience in managing production environments and managing enterprise dalalakes in the cloud environment
• Understand database design, caching, scalability, and disaster recovery
• Strong experience in supporting data operation in Public cloud providers (AWS, Google, Azure)
• Experience in CI/CD tools