Data Engineer
Mandrill Tech Sdn Bhd
Date: 20 hours ago
City: Petaling Jaya
Contract type: Full time
Established in Kuala Lumpur since 2015, Mandrill Tech is a fast growing technology company. It serves many clients from various lines of industry.
Being an MSC certified company, Mandrill Tech is recognized as leaders in ICT industry development in Malaysia. It reflects our commitment to be the frontliner of technology innovation and advancements.
The Role
You Will Be Responsible For
Being an MSC certified company, Mandrill Tech is recognized as leaders in ICT industry development in Malaysia. It reflects our commitment to be the frontliner of technology innovation and advancements.
The Role
You Will Be Responsible For
- Develop scalable data architectures and systems that can handle large volumes of data and support real-time processing and analytics.
- Collect, extract, transform, and load data from various sources, including databases, data warehouses, and data lakes.
- Ensure data quality and integrity through the use of validation and cleansing processes and implement data security and privacy measures.
- Collaborate with data scientists, analysts, and business users to understand their data needs and requirements and provide them with access to the data they need.
- Develop and maintain ETL processes, data pipelines, and other data integration tools and technologies.
- Perform data modelling and database design and optimize data structures and queries for performance and scalability.
- Monitor and maintain data infrastructure and systems to ensure they are operating at peak performance and availability.
- Stay up to date with new and emerging technologies and techniques in the data engineering field, and recommend new tools and technologies as needed.
- Participate in team meetings, code reviews, and other collaborative activities to ensure the successful development and implementation of data infrastructure and systems.
- Bachelor's degree in Computer Science, Electrical Engineering, or related field (required), Master's degree in Computer Science or related field (preferred).
- Strong knowledge of data management and database technologies, such as SQL, NoSQL, and Spark.
- Minimum 5 years of experience with data integration tools and technologies, such as ETL, data pipelines, and data warehousing.
- Programming Languages: Experience developing with Python for data processing, scripting, and automation.
- Data Processing: Experience with batch and real-time data processing technologies, including Apache Spark and Apache Flink.
- Data Transformation: Proficient in data cleaning, modeling, and transformation using tools and libraries like Pandas, dbt, and Spark.
- Database: Hands-on experience with PostgreSQL.
- Cloud Familiarity: Familiarity with cloud platforms, preferably AWS.
- Work alongside & learn from best in class talent
- Excellent career development opportunities
- Great work environment
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Medical Science Liaison
DKSH Scientific Solutions,
Petaling Jaya
4 hours ago
Title: Medical Science LiaisonLocation:Petaling Jaya, MY, MYGlobal Business Unit: HECJob Function: Regulatory ServicesRequisition Number: 186211DescriptionJob SummarySupport the medical affairs strategy for DKSH Client and products related to them, in order to successfully deliver the integrated brand plan objectives, in accordance with business priorities.Identifies disease and product related medical needs in a defined geography.Establishes frequent and timely interactions with Thought Leaders...
Area Executive Retail Operations
DKSH,
Petaling Jaya
17 hours ago
Job ResponsibilitiesSalesDrive sales generating activities to achieve sales target of the assigned outlets.Ensure sales collection are in order and bank into company's account.Operations ControlTo supervise the performance of the PIC to carry out their duties in accordance with company SOP.To control all others operating costs i.e outlets expenses and outlet labour cost.To perform monthly cash audit check for outlets.Ensure outlet...
Senior Manager, Commercial
adidas,
Petaling Jaya
1 day ago
Purpose & Overall Relevance For The OrganizationTo drive adidas Golf Sales in the Malaysia to ensure market leadership, target achievement, and Brand Objectives in the areas.Key ResponsibilitiesPlanningDevelops effective business strategies to reach defined business goals on Malaysia NetSales and full country P&L’sTo develop Mainstream & Moonshot 2.0 (5 years Strategic Business Plan) to provide right company’s goals and key strategiesDevelops...
