Python Data Engineer

  • New Delhi
  • Credhive

Position Overview

We are a seed-funded startup focused on using state-of-the-art AI technologies to revolutionize the credit industry. Our team consists of experts in machine learning and software engineers who have worked at top-tier US tech companies like Apple, Amazon, etc, and we are passionate about using AI to improve access to credit information for businesses. We have the product on the market, the first clients, and sufficient runway. We are seeking a highly skilled and innovative Python Data Engineer with a focus on parsing and scraping complex data from multiple sources . As a foundational member of our engineering team, you will play a crucial role in establishing and shaping our data team, focusing on extracting and managing large volumes of data essential for our services.


Key Responsibilities

  • Web Scraping and Data Collection:
    Design, build, and maintain robust web scraping systems to collect data from various online sources.
  • Strong Python:
    Ability to write clean and efficient Python while adhering to OOP principles. Able to parse and understand different kinds of data like XML, etc.
  • AWS Data Management:
    Set up and manage our data infrastructure on AWS, including services like S3, RDS and EC2.
  • Quality Assurance:
    Implement systems to ensure the accuracy and integrity of data, including validation and cleansing processes.
  • Innovative Problem-Solving:
    Stay ahead of the curve with emerging technologies and methodologies in data engineering and web scraping.


Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  • Strong experience in Python and web scraping tools and frameworks (such as BeautifulSoup, Scrapy,).
  • Basic experience in managing and scaling data on AWS.
  • Being scrappy!
  • Being interested in Data and solving problems to gather any kind of data useful for our services.


What We Offer

  • Significant impact on the company’s data strategy and infrastructure.
  • A collaborative, flexible, and dynamic work environment.
  • Competitive salary and benefits package.

Insert your email to proceed to Credhive's job offer

or