We are looking for a skilled Middle Data Engineer to join our team.

‍

As a Data Engineer, your primary responsibility is to design, develop, and maintain the systems and infrastructure necessary for data collection, storage, and processing. You will be a crucial part of the data team, collaborating with data scientists, analysts, and other stakeholders to ensure the smooth flow of data and support data-driven decision-making processes.

‍

Responsibilities:

‍

• Gathering requirements from internal customers
• Design, manage and maintain analytics products and pipeline solutions.
• Create new ETL/ELT processes and optimize existing by different tools (Python, PySpark, Databricks, etc.)
• Debugging, monitoring, and troubleshooting pipeline solutions
• Provide analysts and other internal customers with technical support related to data activity

‍

Requirements:

‍

• 2+ years experience working as a Data Engineer
• At least 2 years of experience with Python/PySpark/Databricks
• Experience in writing ETL\ELT Processes
• Knowledge in CI/CD and production processes and methodologies
• Have experience in designing, building, optimizing, and maintaining big data pipelines on the public cloud (preferably Azure).
• Knowledge in SQL.
• Working with Spark and ETL flows
• Good analytical skills and original thinking
• Good system-level understanding of problems
• ETL with Stream Technology - Big Advantage
• Experience in Azure data Factory, Azure Function and Azure databricks - Big advantage

‍

Preferred Skills:

‍

• Have scripting skills:(Python, SQL, CI/CD, SPARK, ETL/ELT Processes, Big Data, Databricks, PySpark).
• Be able to handle a stressful and dynamic working environment
• Excellent working relations with interfaces.

‍

If you have the required skills and experience, please submit your application for consideration.

‍