(Senior) Data Engineer
ROCKWOOL Group
Date: 3 weeks ago
City: Subang Jaya
Contract type: Full time
We are looking for a (Senior) Data Engineer based in our Malaysia location to join the global Data Science & Engineering team in ROCKWOOL to support the development of our global data platform for factory data collecting datasets from IoT infrastructure from our plants. This role involves working on a platform built on Azure, leveraging Databricks, Airflow, Docker, Blob Storage, and MongoDB. You will address technical challenges, implement new features, streamline CI/CD pipelines, automate processes, and enhance governance and monitoring. We are also planning a migration to a new tech stack most likely based on Databricks, Azure EventHub and Kafka, and you may contribute to tasks related to the new platform in the future.
You will join the operational part of a global Data & AI team where you will collaborate with colleagues in Poland and Denmark. The operational team in Malaysia will contain data scientists, data engineers and ML engineers and there will be a lot of collaboration with other parallel teams in other locations.
Key Requirements
You will join the operational part of a global Data & AI team where you will collaborate with colleagues in Poland and Denmark. The operational team in Malaysia will contain data scientists, data engineers and ML engineers and there will be a lot of collaboration with other parallel teams in other locations.
Key Requirements
- Technical Skills :
- 3-5+ years of experience in data engineering focused on data integration, ETL, and data warehousing,
- Proficiency in Databricks and Spark.
- Experience with Azure services and platform.
- Programming expertise in Python.
- Familiarity with DevOps/DataOps practices.
- Communication :
- Fluency in English (C1).
- Personal Attributes :
- Proactive and self-reliant in task execution.
- Capable of proposing solutions and effectively collaborating with stakeholders.
- Technical Expertise :
- Experience with MongoDB and NoSQL databases.
- Knowledge of scheduling tools, especially Airflow.
- Proficiency in containerization using Docker.
- Familiarity with advanced Databricks features like Unity Catalog or DLT.
- Expertise in SQL databases.
- Experience managing on-premises or cloud-based servers.
- Understanding of programming structures and algorithms.
- Version control expertise (Git, preferably GitHub).
- Advanced understanding of data pipelines and data architecture (data warehouses, lakes, vaults).
- Experience with IaC concepts and tools, preferably Terraform.
- Familiarity with LLM tools (e.g., ChatGPT, GitHub Copilot) to enhance productivity.
- Nice to Have :
- Experience with data modeling,
- Knowledge of additional programming languages (e.g., C#, Java, Scala),
- DBT,
- Snowflake,
- Kafka.
- Familiarity with Scrum/Kanban methodologies and tools like Jira.
- Ability to independently gather requirements and collaborate with business stakeholders.
- Experience working in an international team.
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Beauty Consultant
Headmistress Group Sdn Bhd,
Subang Jaya
MYR 3,000
-
MYR 5,000
per month
6 days ago
Job ResponsibilityProvide sales consultation to the clientsAbility to explain, negotiate and communicate with the potential clients, with the aim to close sales in meeting sales targetsCreate, develop, maintain and nurture good relationship with the clientsLead, supervise and manage a teamJob RequirementsHeadmistress (Subang branch) is looking for a driven, competent and experience Sales Consultant to drive sales activities including providing sales...
Product Marketing Manager
ASSA ABLOY Group,
Subang Jaya
1 week ago
Develop and manage product strategies, roadmaps, and lifecycle management. Identify and drive product innovation initiatives to materialize new product ideas and enhancement projects for existing products. Define product specifications and design requirements to address country-specific demands effectively. Compile, manage, and maintain comprehensive product specifications and data. Develop and document unique selling propositions (USP) for each product to ensure market readiness...
Facilities Coordinator
Cancer Research Malaysia,
Subang Jaya
2 weeks ago
SCOPE / PURPOSE OF JOB / JOB RESPONSIBILITIESHelpdesk Support:Attend to ticketing helpdesk requests and respond to user inquiries related to facilities and infrastructure.Procurement & Requisition:Handle procurement and requisition processes for preventive maintenance, laboratory equipment, centralized services, and facilities-related purchases.Vendor Engagement:Coordinate with vendors to schedule and oversee preventive maintenance of facilities and laboratory equipment.Routine Maintenance:Perform routine servicing and maintenance of utilities...
