Terrascope Logo

Terrascope

Senior Data & Analytics Engineer

Posted 9 Days Ago
Be an Early Applicant
Remote
Hiring Remotely in Bengaluru, Karnataka
Senior level
Remote
Hiring Remotely in Bengaluru, Karnataka
Senior level
The Senior Data & Analytics Engineer will design and implement scalable data architectures for SaaS platforms, focusing on the AWS Data stack and Postgres. Responsibilities include optimizing materialized views, writing code in Python, Java, or Go, and managing large data processing workflows. The role aims to enhance data accessibility and performance for analytics and ensure the robustness of data platforms.
The summary above was generated by AI

Join us on a mission to save the planet!



Reversing the impact of climate change is one of the world’s biggest challenges. And businesses have a responsibility to lead the way. While individual consumer choices are important, over 80% of all the emissions reductions necessary for the world to reach Net-Zero, require business-level action. But despite the growing momentum and ambition from companies around the world to set Net-Zero goals, there are significant challenges to delivering on these ambitions. Business leaders don’t really know how they will get there. And the very first step, of getting emissions measurement right, is hard.



Terrascope is a smart carbon management and accounting platform that empowers corporations to decarbonise their operations, portfolios and supply chains in a trusted, confident, and secure manner. We are on a journey to build digital tools and analytics, datasets and algorithms, and an ecosystem of technical expertise and partnerships needed for companies to optimize their climate strategy



Terrascope is backed by one of the world’s largest food and agri companies and global leader in climate action and sustainability. With their significant strategic advantage and secure funding, the venture is uniquely positioned to drive profit with purpose; driving decarbonization in supply chains while generating outsized financial returns.



We are seeking a Senior Data & Analytics Engineer to design and implement scalable data architectures for SaaS platforms in both single-tenant and multi-tenant environments. This role will focus on leveraging the AWS Data Engineering stack, Postgres, and advanced analytics processing techniques, including the creation of materialised views to enable high-volume data analytics. The ideal candidate is skilled in Python scripting, Java or Go, and proficient in handling large-scale data processing workflows. This role will report into the Director of Engineering & Tech and will be crucial in shaping the future of climate-tech SaaS products.

In this role you will:

  • 100% hands-on role to build a robust and scalable data platform to support seamless data onboarding and management for a SaaS platform.
  • Design scalable single-tenant and multi-tenant SaaS data platforms, optimize materialized views for analytics, and develop pipelines using the AWS Data Engineering stack.
  • Design and implement efficient data migration scripts and workflows to enable smooth data onboarding for new and existing clients.
  • Write clean, efficient code in Python, Java, or Go, and design robust data models using Postgres ORM frameworks.
  • Process large-scale datasets, optimize Postgres databases for high performance, and implement best practices for scaling analytics solutions.
  • Index optimization in Postgres for query performance.
  • Creating materialized views and analytics-ready datasets for headless BI.
  • Implement row-level security and design multi-tenant database architectures for scalability and security.
  • Develop pipelines and processes to integrate diverse data connectors into the SaaS platform while ensuring data integrity and consistency.
  • Enable data accessibility and transformation for data science teams by creating analytics-ready datasets and facilitating model integration.
  • Ensure the data platform and migration workflows are optimized for scalability, high performance, and low latency.
  • Work closely with product, engineering, and data science teams to align platform capabilities with analytics and machine learning requirements.
  • Manage and scale AWS infrastructure and automate workflows using the GitHub DevOps stack.

You should have:

  • Bachelor’s degree in STEM field.
  • At least 5 to 8 years of extensive experience as a Data and Analytics engineer building data platforms for SaaS apps, large-scale data processing workflows, advanced analytics and processing techniques.
  • Experience in database migration projects.
  • Experience in build or migration of multi-tenant database projects.
  • Deep competence in Python scripting for writing ETL pipelines, custom migration scripts, and automating AWS tasks.
  • Deep competence in Java/Go for building high-performance, scalable tools to handle complex migration needs.
  • Deep competence in data storage and management using AWS RDS(postgres), S3 and Document DB.
  • Deep competence of Postgres database architecture and functionality, including indexes, partitioning, and query optimization.
  • Deep competence in Materialized Views, including their creation, refresh strategies, and use cases for analytics.
  • Advanced SQL skills to design complex queries that aggregate, filter, and transform data effectively for materialized views.
  • Deep competence in data processing using AWS Glue, Lambda and Step functions.
  • Have experience in AWS data migration service.
  • Deep competence in data processing and analytics using AWS Athena and AWS Redshift.
  • Deep competence in security and monitoring using AWS IAM, AWS CloudWatch and AWS CloudTrail. 
  • Experience in design mapping between MongoDB’s flexible schema and Postgres' relational schema.
  • Experience in data enrichment and cleaning techniques. 
  • Proven experience with scalable, large data sets and high-performance SaaS applications.
  • Strong ability to work with and optimize large-scale data systems
  • You are a data engineer with a strong background in building scalable analytics solutions in startup environments.
  • You are passionate about creating efficient data processing systems and driving analytics innovation.
  • You are a problem solver with excellent programming skills and a focus on performance optimization.
  • You are a collaborative team player who enjoys mentoring peers and sharing best practices.

Even better if you are:

  • Familiar with Rust programming language.
  • An entrepreneurial problem solver comfortable in managing risk and ambiguity.

We're committed to creating an inclusive environment for our strong and diverse team. We value diversity and foster a community where everyone can be his or her authentic self.

Top Skills

Go
Java
Python

Similar Jobs

Yesterday
India
Remote
11,000 Employees
Senior level
11,000 Employees
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
As a Senior Data Engineer at Atlassian, you will work with a world-class data engineering team, focusing on defining metrics, ensuring data quality, and optimizing data workflows. You will partner with product teams and data consumers to drive strategic decision-making by collecting and analyzing data, thus enhancing product experiences and business performance.
22 Hours Ago
Bengaluru, Karnataka, IND
Remote
3,000 Employees
Senior level
3,000 Employees
Senior level
Hardware • Information Technology • Security • Software • Cybersecurity • Conversational AI
The Senior Data Engineer will work with cross-functional teams to develop scalable ETL pipelines, manage the data warehouse, and ensure data privacy and compliance. They will analyze and maintain datasets, drive projects independently, and enhance the customer experience with data insights.
4 Days Ago
Bengaluru, Karnataka, IND
Remote
11,000 Employees
Senior level
11,000 Employees
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The Principal Data Engineer at Atlassian will enable engineering practices using data, develop backend systems and models, and build scalable data solutions for various business needs. The role includes maintaining data lakes and driving a data-driven culture within the organization.

What you need to know about the Dublin Tech Scene

From Bono and Oscar Wilde to today's tech leaders, Dublin has always attracted trailblazers, with more than 70,000 people working in the city's expanding digital sector. Continuing its legacy of drawing pioneers, the city is advancing rapidly. Ireland is now ranked as one of the top tech clusters in the region and the number one destination for digital companies, with the highest hiring intention of any region across all sectors.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account