Senior Data Engineer

Arbisoft is looking for motivated Data Engineers to join our dynamic team. The ideal candidate has hands-on experience with Python, SQL, and AWS data services. This role involves designing, maintaining, and optimizing data pipelines, supporting ETL processes, and ensuring the integrity of our data infrastructure. It’s an excellent opportunity for someone passionate about data engineering and eager to grow with cutting-edge technologies.

Key Responsibilities:

• Design, develop, and maintain scalable data pipelines using Python and SQL.
• Implement ETL processes to clean, enrich, and transfer data across systems and cloud environments.
• Collaborate with data scientists, analysts, and stakeholders to ensure data quality and availability.
• Integrate AWS services (e.g., S3, Redshift, Glue, Lambda) into data workflows.
• Optimize database performance and query efficiency.
• Monitor and resolve data pipeline issues promptly.
• Ensure data security, integrity, and quality.
• Document technical processes and procedures.

Required Skills & Experience:

• Proficiency in Python for data processing and scripting.
• Strong SQL skills for data extraction, transformation, and manipulation.
• Experience with ETL processes and working with large datasets.
• Familiarity with AWS services such as S3, Redshift, Glue, Lambda, or similar cloud platforms.
• Basic understanding of data warehousing concepts and best practices.
• Effective communication and collaboration skills.
• Strong problem-solving mindset and attention to detail.

Preferred Qualifications:

• Hands-on experience with AWS data services (S3, Redshift, Glue, Lambda).
• Familiarity with workflow orchestration tools like Apache Airflow.
• Exposure to data modeling and database design.
• Knowledge of big data technologies (e.g., Apache Spark, Hadoop).
• Experience with version control systems like Git.
• Proficiency in AWS SageMaker for machine learning workflows.
• Experience working with Jupyter Notebooks for data analysis and visualization.

.