We are looking for a skilled Big Data Engineer to build, develop, and optimize big data pipelines, ETL processes, and analytics platforms. The ideal candidate will work with large datasets, develop efficient data processing solutions, and support data-driven decision-making by ensuring data quality, reliability, and scalability.
Key Responsibilities
- Design, develop, and optimize big data pipelines and ETL processes.
- Build and maintain scalable data processing and analytics platforms.
- Integrate data from multiple sources and ensure data accuracy and consistency.
- Develop and optimize data workflows for efficient processing and storage.
- Collaborate with data analysts, data scientists, and engineering teams.
- Monitor data pipelines and troubleshoot performance issues.
- Implement data quality checks and validation processes.
- Maintain technical documentation and follow data engineering best practices.
Required Skills
- Knowledge of big data technologies and data processing frameworks.
- Understanding of ETL processes and data pipeline development.
- Familiarity with SQL and database systems.
- Knowledge of Python, Scala, or Java.
- Understanding of data warehousing and analytics platforms.
- Strong analytical, problem-solving, and communication skills.
