Summary

We at Santiment are looking for a Python Developer to join our fully remote team and help build an intuitive, high performance end-user experience. Whilst working with us, we guarantee many competitive tasks and fun.

Check out our team and our products on our webpage santiment.net.

Key Qualifications

Web Scraping & Data Acquisition

• Develop and maintain web scraping scripts using Python, Playwright or Selenium to extract data from various websites and social media platforms.
• Interact with APIs from third-party services and social media platformsfor data acquisition.

Pipeline Development

• Design and build robust pipelines for data acquisition, ensuring high performance and scalability.
• Automate data collection, cleaning, and processing workflows using Apache Airflow.

Containerization & Deployment

• Create Docker containers for all web scraping and data processing tasks.
• Deploy and manage applications on Kubernetes clusters, ensuring high availability and efficient resource utilization.
• Monitor, troubleshoot, and optimize existing scraping and data acquisition services setup in a Kubernetes environment.

Collaboration & Documentation

• Work closely with the data engineering and data science teams to align data collection processes with analytical needs.
• Document developed solutions thoroughly, including code, methodologies, and data schemas.