Senior Data Engineer
Mandrill Tech Sdn Bhd
Date: 10 hours ago
City: Petaling Jaya
Contract type: Full time
Established in Kuala Lumpur since 2015, Mandrill Tech is a fast growing technology company. It serves many clients from various lines of industry.
Being an MSC certified company, Mandrill Tech is recognized as leaders in ICT industry development in Malaysia. It reflects our commitment to be the frontliner of technology innovation and advancements.
The Role
You Will Be Responsible For
Being an MSC certified company, Mandrill Tech is recognized as leaders in ICT industry development in Malaysia. It reflects our commitment to be the frontliner of technology innovation and advancements.
The Role
You Will Be Responsible For
- Design and develop scalable data architectures and systems that can handle large volumes of data and support real-time processing and analytics.
- Collect, extract, transform, and load data from various sources, including databases, data warehouses, and data lakes.
- Ensure data quality and integrity through the use of validation and cleansing processes and implement data security and privacy measures.
- Collaborate with data scientists, analysts, and business users to understand their data needs and requirements and provide them with access to the data they need.
- Develop and maintain ETL processes, data pipelines, and other data integration tools and technologies.
- Perform data modelling and database design and optimize data structures and queries for performance and scalability.
- Monitor and maintain data infrastructure and systems to ensure they are operating at peak performance and availability.
- Stay up to date with new and emerging technologies and techniques in the data engineering field, and recommend new tools and technologies as needed.
- Participate in team meetings, code reviews, and other collaborative activities to ensure the successful development and implementation of data infrastructure and systems.
- Bachelor's degree in Computer Science, Electrical Engineering, or related field (required), Master's degree in Computer Science or related field (preferred).
- Strong knowledge of data management and database technologies, such as SQL, NoSQL, and Spark.
- Minimum 8 years of experience with data integration tools and technologies, such as ETL, data pipelines, and data warehousing.
- Programming Languages: Strong proficiency in Python for data processing, scripting, and automation.
- Database Management: Hands-on experience with relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB).
- Data Warehousing: Solid experience in designing and implementing data warehousing solutions, with practical experience using Snowflake.
- Data Orchestration: Experience with data workflow orchestration tools such as Apache Airflow or Prefect.
- Data Pipelines: Proven experience with streaming and batch data processing technologies, including Apache Kafka, Apache Spark, and Apache Flink.
- Cloud Management: Strong experience managing and deploying data solutions on cloud platforms, preferably AWS.
- Data Transformation: Proficient in data cleaning, modeling, and transformation using tools and libraries like Pandas, dbt, and Spark.
- SQL Expertise: Advanced SQL skills, including extensive experience with CTEs, Window Functions, and Recursive CTEs for complex data analysis and manipulation.
- Work alongside & learn from best in class talent
- Excellent career development opportunities
- Great work environment
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Senior Manager Group Internal Audit
DKSH Scientific Solutions,
Petaling Jaya
11 hours ago
Title: Senior Manager Group Internal AuditLocation:Petaling Jaya, MY, MYGlobal Business Unit: OTHJob Function: AuditRequisition Number: 186061DescriptionJob Responsibilities:Relationship manager for the Malaysia Country Leadership Team (CLT)Build and maintain relationship with the Malaysia CLT (consisting of Head of Country Finance, Head of Country Management, BU Heads and other functional heads) and support them to strengthen internal control environment through delivery of audits,...
Executive Field Sales (FMCG, Pets Food)
DKSH Scientific Solutions,
Petaling Jaya
1 day ago
Title: Executive Field Sales (FMCG, Pets Food)Location:Petaling Jaya, MY, MYGlobal Business Unit: CGJob Function: SalesRequisition Number: 188539DescriptionJob SummarySell products/services to achieve sales targets for assigned businesses/territories and overall business objectivesGeneral ResponsibilitiesSupport superior in managing day-to-day operating expenditures against operating budgets to ensure efficient usage of resourcesImplement action plans (e.g. make regular calls/visits, take orders, etc.) to achieve sales targets for...
Sr Professional, Pre-Sales (System, Storage & Backup)
Ingram Micro,
Petaling Jaya
2 days ago
It's fun to work in a company where people truly BELIEVE in what they're doing!Ingram Micro is a leading technology company for the global information technology ecosystem.With the ability to reach nearly 90% of the global population, we play a vital role in the worldwide IT sales channel, bringing products and services from technology manufacturers and cloud providers to business-to-business...
