Senior Data Engineer
GXBank
Date: 2 weeks ago
City: Petaling Jaya
Contract type: Full time
Responsibilities
- Design, develop, test, deploy, and maintain robust and scalable ELT data pipelines using dbt (data build tool) for data transformation within Snowflake.
- Orchestrate and schedule complex data workflows using Apache Airflow, ensuring timely and reliable data delivery.
- Develop connectors and scripts (primarily in Python) to extract data from various source systems (APIs, databases, files, streaming platforms) and load it into Snowflake.
- Implement data ingestion strategies (batch and streaming) using Snowflake's capabilities (e.g., Snowpipe, external stages).
- Optimize Snowflake warehouse usage, query performance, and overall data platform efficiency.
- Manage and monitor Snowflake resources, ensuring cost-effectiveness and scalability.
- Implement and enforce data governance, security (e.g., RBAC, data masking), and privacy best practices within Snowflake.
- Assist in schema design, table optimization (clustering, partitioning), and data loading strategies.
- Solve key business problems through using an appropriate mix of strategic thinking and computational methods.
- Develop and uphold best practices with respect to change management, documentation and data protocols.
- Bachelor/Master degree in Analytics, Data Science, Mathematics, Computer Science, Information Systems, Computer Engineering, or related technical field.
- Demonstrated mastery of complex SQL queries, analytical functions, stored procedures, and performance tuning.
- 5+ years of hands-on experience with SQL or any Data warehouse/Data Lake, including data loading, transformations, performance optimization, and security features.
- Proven experience in building and managing complex data transformation pipelines using dbt, including Jinja templating, macros, tests, and documentation.
- Solid experience in designing, developing, and deploying production-grade data pipelines using Apache Airflow (DAGs, Operators, Sensors, XComs).
- Strong Python scripting skills for data manipulation, API integrations, and Airflow DAG development.
- Analytical and independent problem solver. Meticulous with high attention to detail.
- Strong communicator with ability to switch hats between data/technical speak and business/layperson speak.
- Solid understanding of data warehousing concepts, dimensional modeling (star/snowflake schemas), and data lake architectures.
- Deep understanding of Extract, Load, Transform (ELT) or ETL principles and best practices.
- Familiarity with data quality frameworks, data lineage, and data governance principles.
- Experience working in a digital banking or financial services environment is highly advantageous, with an understanding of financial data concepts and regulatory requirements.
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Procurement Tactical Buyer II (Global Business Services)
Kimberly-Clark,
Petaling Jaya
2 days ago
Job DescriptionProcurement Tactical Buyer IIJoin the team behind iconic brands like Huggies, Kotex, Poise, Depend At Kimberly-Clark, it’s all here for you—innovation, growth, and the chance to make a real impact.You’re not the person who will settle for just any role. Neither are we. Because we’re out to create Better Care for a Better World, and that takes a certain...
AI Application Engineer
Lenovo,
Petaling Jaya
1 week ago
We are Lenovo. We do what we say. We own what we do. We WOW our customers.Lenovo is a US$83 billion revenue global technology powerhouse, ranked #153 in the Fortune Global 500, and serving millions of customers every day in 180 markets. Focused on a bold vision to deliver Smarter Technology for All, Lenovo has built on its success as...
RGM Data Scientist
FrieslandCampina,
Petaling Jaya
4 weeks ago
Are you interested in tackling complex data problems? Do you have a passion for applying data science to solve real-world challenges? Then we are looking for you!FrieslandCampina’s DS Team is looking for a motivated RGM Data Scientist to join our group of data scientists. You will have the opportunity to work on real-world projects and gain experience in developing data...