smallcase is building a modern investing ecosystem - better investment products & technology platforms for the Indian capital markets - serving over 5mn individual investors & India's most trusted & respected financial brands. We are a young, passionate 300+ member team headquartered in Bangalore & are backed by top-tier investors. smallcase has also been recognized in the ecosystem & media as an innovator & change agent.
We’re looking for an analytical, result-driven lead who will work with the team setting up ETL pipelines and infra for data querying at scale
Responsibilities
- Build a central data warehouse that serves as the "source of truth"
- Build data pipelines to integrate data from multiple sources, or to push data to the data warehouse.
- Ensure that these pipelines are reliable and can scale as the business scales.
- Work with core engineering teams to ensure that data analytics requirements are met in our production systems.
- Participating and collaborating with Product Owner/ Cross-functional teams in the organization to understand the business requirements and deliver solutions that can scale.
Skills & Experience
- 6 - 9 years of experience in data engineering with a strong background in software engineering.
- Strong fundamentals of object-oriented design, data structures, algorithms, and design patterns.
- Data engineering — ETL processes, Kafka, Airflow, messaging systems e.g. Pubsub; in particular, building data warehouses, pipelines from scratch.
- Databases and data systems - MongoDB, ElasticSearch, data warehouses e.g. BigQuery, relational databases e.g. Postgres.
- Python, SQL, and experience with cloud platforms - AWS/GCP.
- Working with high volume and diverse data sources, and quickly evolving business requirements.