Engineering

Lead Data Engineer


Bengaluru   |   Full Time



smallcase is building a modern investing ecosystem - better investment products & technology platforms for the Indian capital markets - serving over 5mn individual investors & India's most trusted & respected financial brands. We are a young, passionate 300+ member team headquartered in Bangalore & are backed by top-tier investors. smallcase has also been recognized in the ecosystem & media as an innovator & change agent.


We’re looking for an analytical, result-driven lead who will work with the team setting up ETL pipelines and infra for data querying at scale


Responsibilities

  • Build a central data warehouse that serves as the "source of truth"
  • Build data pipelines to integrate data from multiple sources, or to push data to the data warehouse.
  • Ensure that these pipelines are reliable and can scale as the business scales.
  • Work with core engineering teams to ensure that data analytics requirements are met in our production systems.
  • Participating and collaborating with Product Owner/ Cross-functional teams in the organization to understand the business requirements and deliver solutions that can scale.

Skills & Experience

  • 6 - 9 years of experience in data engineering with a strong background in software engineering.
  • Strong fundamentals of object-oriented design, data structures, algorithms, and design patterns.
  • Data engineering — ETL processes, Kafka, Airflow, messaging systems e.g. Pubsub; in particular, building data warehouses, pipelines from scratch.
  • Databases and data systems - MongoDB, ElasticSearch, data warehouses e.g. BigQuery, relational databases e.g. Postgres.
  • Python, SQL, and experience with cloud platforms - AWS/GCP.
  • Working with high volume and diverse data sources, and quickly evolving business requirements.

Submit Your Application

You have successfully applied
  • You have errors in applying