Data Engineer
We are seeking a talented and motivated Data Engineer to join our data team. This position will be responsible for designing, developing, and maintaining our data architecture, pipelines, and infrastructure. The ideal candidate is a problem solver who is passionate about data, has a strong technical background, and is capable of working in a dynamic and collaborative environment.
Key Duties and Responsibilities:
Develop and maintain ETL processes to transform and load data into our data warehouse.
Design, implement, and manage data storage solutions, including data warehouses and data lakes.
Develop and maintain data models and schemas to support business requirements.
Optimize data structures for efficient querying and analytics.
Identify and resolve bottlenecks and issues in data processing.
Manage metadata to provide context and lineage information for datasets.
Implement data security measures to protect sensitive information.
Ensure data compliance with relevant regulations and policies.
Skills:
Operating System
SQL
Coding
Machine Learning
Data Architecture
Data Warehousing
Problem-solving
Apache Hadoop-Based Analytics
Requirements:
Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
Proven experience as a Data Engineer or in a similar role.
Strong proficiency in SQL and experience with database systems (e.g., PostgreSQL, MySQL).
Hands-on experience with ETL tools and frameworks (e.g., Apache Spark, Apache NiFi).
Proficiency in at least one programming language (e.g., Python, Java).
Familiarity with data warehouse solutions (e.g., Amazon Redshift, Google BigQuery).
Knowledge of data modeling concepts and techniques.
Experience with version control systems (e.g., Git) and collaboration tools.
Excellent problem-solving and troubleshooting skills.
Strong communication and teamwork abilities.
Experience with cloud computing platforms (e.g., AWS, Azure, Google Cloud Platform).
