We are looking for a Senior Software Engineer to join the DIAL (Data Integration & Analytics Layer) team, responsible for building scalable, high-performance enterprise applications that power data preprocessing, observability, and data product pipelines.
Key Responsibilities
- Design and develop high-performance backend services using FastAPI, Pydantic, and SQLAlchemy
- Build and maintain API-driven data processing and orchestration frameworks within DIAL
- Implement asynchronous and concurrent processing using Python (asyncio) for scalable workloads
- Integrate with Azure services such as ADLS, ADF, Databricks, and related data platforms
- Develop robust data models, validation layers, and persistence mechanisms
- Ensure observability, logging, and monitoring for enterprise-grade applications
- Write unit and integration tests using Pytest to ensure code quality and reliability
- Collaborate with data engineers, architects, and product owners to deliver end-to-end solutions
- Participate in code reviews, design discussions, and performance optimization initiatives
- Contribute to CI/CD pipelines and containerized deployments
Required Skills & Experience
- Core Engineering
- Strong experience in Python backend development
- Hands-on experience with:
- FastAPI
- Pydantic
- SQLAlchemy
- Good understanding of REST API design and microservices architecture
- Cloud & Data Platforms
- Experience working with Microsoft Azure
- Familiarity with:
- ADLS (Azure Data Lake Storage)
- Azure Data Factory / Databricks (preferred)
- Concurrency & Performance
- Working knowledge of Python Asyncio
- Understanding of high-throughput and low-latency system design
- Testing
- Practical experience with Pytest
- Experience in unit, integration, and API testing
- DevOps & Deployment
- Experience with containerization (Docker / Kubernetes)
- Familiarity with CI/CD practices
- Preferred Skills (Nice to Have)
- Experience with performance testing and tuning
- Knowledge of Terraform / Infrastructure as Code (IaC)
- Exposure to observability frameworks (OpenTelemetry, logging, tracing)
- Experience in data engineering or data platform ecosystems
Soft Skills
- Strong problem-solving and analytical thinking
- Ability to work in cross-functional teams (engineering, product, operations)
- Good communication skills for enterprise stakeholder interactions
- Ownership mindset with focus on delivery and reliability
