Data Infra Platform Team Leader

Responsibilities:

• Data Ingestion automation pipeline system construction and management
• Data Lakehouse deployment management and automation
• Create and disseminate data platform usage guides
• Build and manage data catalog and lineage tracking system
• Data Infra Cost Optimization
• Support for ML organization and ML learning pipeline optimization work
• Define inefficient tasks that occur in the company-wide DataOps Lifecycle and perform automation tasks
• Research and PoC on various Data Infra Platform tools and systems constantly released in the market

Requirements:

• 5+ years of data engineering practical experience
• Anyone with a basic understanding of RDBMS and NoSQL
• A person who is able to skillfully implement what he/she wants to analyze using SQL
• A person who is proficient in using Python and, if necessary, has the development ability to build automation and in-house systems using API servers, etc.
• Experience using Tableau, Power BI, Looker, or similar BI tools
• Proficient in using Git/Git Actions
• Those who can implement reliable large-scale data pipelines using Databricks, Spark, etc.
• People who have experience handling various types of data logs and have experience with standard data log design and change management design
• A person who is proficient in Airflow (ETL) and has proactive troubleshooting experience
• Those who are capable of meeting and email communication based on English
• Anyone with experience using public cloud platforms such as AWS and Google Cloud
• Anyone who has experience managing data infrastructure through IaC tools such as Terraform
• You have the communication skills to collaborate with various stakeholders across the company and communicate complex engineering issues in an easy-to-understand manner.