Headquarters: London
URL: https://www.desia.ai/
We are seeking a skilled and motivated Backend Engineer (Data Platform) to join our team and help build a robust data platform. Your responsibilities will include:
- Developing and enhancing data pipelines: Create and expand existing data processing pipelines for both structured and unstructured datasets (mainly Python and SQL)
- Integrating with third-party systems: Work with external tools and APIs (e.g., Microsoft GraphAPI, financial data providers) to enable seamless data flow between third-party systems and Desia.
- Monitoring and optimizing performance: Track the performance of the data platform, analyze logs, and recommend infrastructure improvements using tools like GCP, Sentry, and CloudSQL.
- Collaborating on data modeling: Design and implement efficient data structures for relational and non-relational systems to support scalable and reliable data processing.
- Ensuring system reliability: Contribute to the stability and scalability of the platform by addressing bottlenecks, optimizing queries, and ensuring smooth operation of containerized environments (e.g., Docker, Kubernetes).
Must-Have Skills:
- Strong Python expertise: proven working experience in both scripting and object-oriented programming (OOP).
- Solid SQL skills: Experience with writing efficient queries and optimizing database performance.
- Data modeling: Hands-on experience designing and organizing data in both relational and non-relational formats.
- Communication skills: Excellent verbal and written communication in English.
- Adaptability: A quick learner who can bridge knowledge gaps to tackle new challenges effectively.
- Collaborative mindset: Open to sharing ideas, providing feedback, and contributing to discussions constructively.
Nice-to-Have Skills:
- Cloud experience: Familiarity with Google Cloud Platform (GCP).
- Containerization knowledge: Working familiarity with tools like Docker and Kubernetes.
- Database expertise: Experience with PostgreSQL.
- Scheduling: Working experience with task scheduling (ex. cron, dag’s like Airflow)
- Python libraries: Knowledge of libraries such as asyncio, pydantic, fastapi, and psycopg
- Search technologies: Familiarity with ElasticSearch or OpenSearch.
- System design: Experience with RESTful APIs and queue-based systems.
Qualifications
- Holding a Master’s degree in Computer Science or a related field or possessing similar practical experience.
- A minimum of 3 years professional experience in Data Platform Engineering or Backend roles
Compensation and benefits
- Salary depending on experience and skills (£40000 – £65000)
- Performance bonuses
- Stock options and retirement plan
To apply: https://weworkremotely.com/remote-jobs/desia-limited-backend-engineer-data-platform
