S P A R C

Cloud / Data Developer (Azure, Databricks, Spark)

Explore
Other Portfolio

Job Description:

 

We are seeking a skilled Cloud / Data Developer to join our dynamic team. The ideal candidate will have a strong background in designing, implementing, and managing Azure cloud-based infrastructures and applications, with proficiency in Databricks, Apache Spark, and other ETL tools. The role requires excellent communication skills and the flexibility to collaborate with our global team.

 

Responsibility:

 

  • Design, implement, and manage Azure cloud-based infrastructures and applications, ensuring alignment with business objectives and compliance with data privacy laws.
  • Develop and execute effective strategies for data migration to Azure, utilizing Databricks, Apache Spark, and other ETL tools to optimize performance and cost.
  • Monitor and maintain cloud-based systems, troubleshooting issues to ensure reliability and service continuity.
  • Craft backup and recovery plans that adhere to business continuity standards.
  • Effectively communicate cloud concepts and strategies to stakeholders, ensuring understanding of risks and benefits.
  • Apply DYNE's AGILE methodologies and leverage AzureML, MLflow, and ML-Ops to deliver compelling cloud solutions.
  • Stay updated with the latest cloud trends, particularly within the Azure ecosystem, to enhance our services.
  • Collaborate with cross-functional teams to deliver integrated solutions and support our clients throughout their cloud transition.
  • Design and implement event-driven and queue-based architectures, ensuring robust and scalable systems.
  • Develop and maintain microservice-based architectures, with experience in Terraform for infrastructure as code.

 

Qualification:

 

  • Bachelor's degree in Computer Science, IT, Systems Engineering, or a related field, with a higher degree or equivalent experience preferred.
  • 3-5 years of experience in cloud engineering, with a strong focus on Azure (experience with AWS or GCP is an asset).
  • Proficiency with Databricks, Apache Spark, and other ETL tools essential for cloud data engineering.
  • Experience with Azure ML, MLflow, and machine learning model deployment and management is a plus.
  • A solid grasp of cloud technologies, including data storage, networking, and cybersecurity.
  • Excellent problem-solving skills and the ability to work under pressure.
  • Strong communication skills, with proficiency in English.
  • Relevant certifications like the Microsoft Certified: Azure Solutions Architect Expert are a plus.