How Heap Built an Analytics Platform that Auto-Tracks Every User Event

9,983
Heap
Heap automatically captures every user action in your app and lets you measure it all. Clicks, taps, swipes, form submissions, page views, and more. Track events and segment users instantly. No pushing code. No waiting for data to trickle in.

Written by Paul Jaworski and adapted from an interview with Dan Robinson, CTO of Heap




Dan Robinson, CTO of Heap Dan Robinson, CTO of Heap


When Dan Robinson joined Heap as the company's first engineer, it was unclear whether it was even possible to build the product to scale. And that's exactly why he joined. Most startups, he says, face a significant risk in finding product-market fit. He was absolutely confident that a need for this product existed. The real challenge would be a technical one.

Most analytics platforms require the user to choose the events they want tracked ahead of time. This requires significant developer time and the foresight to know which analytics events you'll care about later. Heap instead tracks everything up front and lets the user define events with a visual tool afterward.


Humble Beginnings

Heap was founded by Matin Movassate, a former Product Manager at Facebook, and Ravi Parikh. They entered the Winter '11 class of YCombinator with a simple MVP of the product: a single Node.js server running on EC2 with PostgreSQL. All of the persistent data had to be mirrored in memory for the queries to be fast. Dan joined soon after, and his first project was to rebuild the infrastructure to be able to handle more than ~200gb of data.

The early version of the product was a JavaScript snippet that customers could install on their site, tracking UI events. This was accompanied by a customer-facing dashboard written in jQuery and D3.js where users could graph their data, create conversion funnels, or do things like click on a recent user and see every single event Heap has tracked for them. These analyses were transformed into SQL queries for Postgres on the backend. Much of the data still had to be stored in memory for the queries to be fast enough to satisfy consumers, though they knew this was not a long-term solution.


Matin Movassate cutting Dan's welcome cake CEO Matin Movassate cutting Dan's "welcome cake"


PostgreSQL was an easy early decision for the founding team. The relational data model fit the types of analyses they would be doing: filtering, grouping, joining, etc., and it was the database they knew best. Shortly after adopting PG, they discovered Citus, which is a tool that makes it easy to distribute queries. Although it was a young project and a fork of Postgres at that point, Dan says the team was very available, highly expert, and it wouldn’t be very difficult to move back to PG if they needed to:

The stuff they forked was in query execution. You could treat the worker nodes like regular PG instances.

Citus also gave them a ton of flexibility to make queries fast, and again, they felt the data model was the best fit for their application.


Growing Pains

In early 2014, Heap released an event visualizer tool that allowed non-technical people to use the product, which Dan believes was the key piece in achieving product-market fit. As a result, the company grew to the point where they had users who were processing millions of events per month. They started to hit the limits of the initial Citus infrastructure. As larger customers began signing up, the large datasets they brought with them became difficult to handle. Eventually, the analyses became too slow to be viable, and simply “throwing more machines” at the problem was cost-prohibitive.

The early version Heap was using didn’t have much distributed systems functionality, so they had rolled their own solutions for things like recovering from a failed node, splitting data into different sharding schemes, and moving data between machines. That homegrown functionality was starting to have issues at scale.

The major breakthrough came when they found a way to cheaply index the event definitions users were creating. These were the only points of data that users were querying, and each event definition represented far less than 1% of the overall data Heap was collecting. It became clear that they could achieve substantial performance gains if they could build an infrastructure around indexing these events.

Heap searched for an existing tool that would allow them to express the full range of analyses they needed, index the event definitions that made up the analyses, and was a mature, natively distributed system. After coming up empty on this search, they decided to compromise on the “maturity” requirement and build their own distributed system around Citus and sharded PostgreSQL. It was at this point that they also introduced Kafka as a queueing layer between the Node.js application servers and Postgres.

The front end had also begun to grow unwieldy. The original jQuery pieces became difficult to maintain and scale, and a decision was made to introduce Backbone, Marionette, and TypeScript. Ultimately this ended up being a “detour” in the search for a scalable and maintainable front-end solution. The system did allow for developers to reuse components efficiently, but adding features was a difficult process, and it eventually became a bottleneck in advancing the product.


Reducing Cost and Improving Performance

Because of the massive amounts of data that Heap is ingesting, it’s taken a great deal of work to get to a cost-viable product. One of the major projects in reducing cost involved switching to ZFS, which allows compression at the file system level. That switch alone allowed them to compress their data by a factor of 2. Dan says they’re currently experimenting with even further improvements that could increase this compression to 3-3.5x. Additional gains have come from doing some low-level CPU profiling” to determine where their resources were being used on the EC2 instances.

Today, they’re doubling query speed each quarter and constantly seeking even more improvements. As Dan points out, the size of the customer they can support is directly correlated to the performance of the application.

If we can make queries 3x faster, we can support a customer who is 3x larger.


DevOps and Organizational Structure

Engineering teams at Heap are broken into 3-5 developers, and about half of them are working on infrastructure. This is mostly related to business priorities, since again, the primary challenge behind the product is not, “What new features should we add?” but “How do we scale to customers who are 100x larger?”.


Dan and engineers Dan with members of the engineering team


All of the code at Heap lives on GitHub, and they use CircleCI, which in turn kicks off Ansible scripts for deployment. They use Salt for managing machine configuration, and Terraform to manage all of their AWS configuration. Currently, everything is running on AWS for Heap, so Terraform was an easy choice, as they loved the modularity and “great dev workflows” it provides.


Lessons Learned

After 5 years of building one of the fastest growing tools for analytics and ingesting billions of events, Dan Robinson has some valuable advice for budding CTOs:

There are decisions you make that are hard to reverse and decisions that are easy to reverse - like one-way doors and two-way doors. Most things are two-way doors and it's better to just go fast and learn something.

He advises that if you’re building a serious distributed system where the performance is critical to the success of your application, one-way doors include things like selecting your data model and data system:

If you want to change from PostgreSQL to MySQL, that's going to be a rewrite.

If he could go back in time, Dan probably would have started using Kafka on day one. He’s learned that it’s a very good fit for an analytics tool, since you can handle a huge number of incoming writes with relatively low latency. Kafka also gives you the ability to “replay” the data flow: “It’s like a commit log for your whole infrastructure.”


Drawing out the current infrastructure


One of the biggest benefits in adopting Kafka has been the peace of mind that it brings. In an analytics infrastructure, it’s often possible to make data ingestion idempotent. In Heap’s case, that means that, if anything downstream from Kafka goes down, they won’t lose any data – it’s just going to take a bit longer to get to its destination. He’s also learned that you want the path between data hitting your servers and your initial persistence layer (in this case, Kafka) to be as short and simple as possible, since that is the surface area where a failure means you can lose customer data.

Dan also says he’s been “continuously shocked” at how often YAGNI has been true:

I remember writing our exports feature in 2014. It was a simple feature that let you get a nightly dump of your Heap data on S3. The code was littered with TODOs that I was completely sure we were going to need to resolve within the next few weeks – minor extensions of the feature, configurability options, operability improvements, or known technical debt items. A lot of those TODOs didn't come up for years, and some of them are still there.

Instead of focusing on writing perfect software, he believes it’s much more important to get something in front of users. This is something you may have heard by now from a product perspective, but it’s equally important for code:

You’ll learn what areas of your technical debt actually matter, and that learning is a lot more important than getting decisions right if the decisions are easily reversible.


The Present and Future of Heap

Today, the Heap product consists primarily of a customer-facing dashboard powered by React, MobX, and TypeScript on the front end. Data is sent up to a Node.js server, passed on to Kafka, and eventually ends up in PostgreSQL. All of the data customers perform analyses on in the dashboard comes, of course, from the JavaScript snippet installed on users’ websites.

Most recently, Heap has released a feature that also pulls in data from third-party providers like MailChimp, Stripe, Optimizely, and Shopify. The team there realized that a large percentage of their customers’ data didn’t actually live on their own platform, but instead was scattered around these various vendors.

Dan points out that the additional data volume hasn’t been a significant challenge - especially since events like payments are very high value from an analytics perspective. The real challenge has been learning the “language” of these providers. Each one has a different API, a different way to format event data, and different semantics for retrieving it.

Once the data is in Heap, they also had to figure out how to correlate that data with their own. How do you attribute an email sent in one system to a button click in another? The answer was building out their own UI for Heap users to tie the events together.

Beyond features, performance improvements continue to be a major focus today and in the future. Heap currently stores 1 petabyte of data, ingests 1 billion events per day, and performs over 250,000 analyses per week.




If your company has a great story behind your tech, email us to be featured!

Heap
Heap automatically captures every user action in your app and lets you measure it all. Clicks, taps, swipes, form submissions, page views, and more. Track events and segment users instantly. No pushing code. No waiting for data to trickle in.
Tools mentioned in article
Open jobs at Heap
HR Business Partner (Engineering, Pro...
<p><span style="font-weight: 400;">As we build and scale the People team at Heap, we need a dedicated team player and relationship builder to join the HRBP team.&nbsp;</span></p> <h3><strong><br>At Heap, this means you will:</strong></h3> <ul> <li style="font-weight: 400;"><span style="font-weight: 400;">Create and maintain relationships with leaders and their team members, to support cultural and organizational needs and to continue to build on our amazing culture.&nbsp;</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Through exceptional relationship building, you will fully understand the strategic direction of Heap and co-create People focused initiatives to support and promote the achievement of our organizational goals.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Help define and roll out the staple HR processes (performance management, compensation, leveling, feedback, retention etc.) in a way that delivers results, in close partnership with the business, and in alignment with Heap’s core values.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Focus on diversity, equity and inclusion as a key building block to everything we do, working closely with your colleagues in Recruiting, leaders throughout the business, and all Heaple to continually improve our culture and practices.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Educate and partner with managers on performance management, conflict resolution, and employee development goals.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Analyze employee data (e.g., compensation, attrition, and exit feedback) to guide decision-making and provide solutions to the leaders you support.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Champion our culture by promoting company values to guide decision-making and drive thoughtful and effective change management in a fast-paced environment.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Design and implement our Engagement Survey, following up with managers and driving action plans to respond to the results.</span></li> </ul> <h3><span style="text-decoration: underline;"><strong><br></strong></span><strong>30/60/90 Day Plan</strong></h3> <p><strong>Within <span style="text-decoration: underline;">30 days</span>, you will:&nbsp;</strong></p> <ul> <li style="font-weight: 400;"><span style="font-weight: 400;">Take over partnership and coaching of the functions and departments that you support.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Start to execute processes in partnership with HR Operations such as exit surveys, attrition analytics, compensation calibrations, etc.&nbsp;</span></li> </ul> <p><strong>Within <span style="text-decoration: underline;">60 days</span>, you will:&nbsp;</strong></p> <ul> <li style="font-weight: 400;"><span style="font-weight: 400;">You will help build our management team’s capacity through coaching, training, and programs.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">You will help build a culture of learning and feedback for manager through additional live trainings, a robust set of async resources and regular lunch &amp; learns where managers can learn from each other.</span></li> </ul> <p><strong>Within <span style="text-decoration: underline;">90 days</span>, you will:</strong></p> <ul> <li style="font-weight: 400;"><span style="font-weight: 400;">You will meaningfully contribute to the People strategy of the teams you support.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Advise managers and project manage the evolution of career ladders and leveling at Heap.</span></li> </ul> <h3><strong><br>What we’re looking for:&nbsp;</strong></h3> <ul> <li style="font-weight: 400;"><span style="font-weight: 400;">Embodies Heap’s core values.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Applies intermediate knowledge in employment law and HR fundamentals to partner with the business and advance people-related strategies and programs.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Has a strong ability to balance the needs of our people and the needs of the business.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Has built people policy and process, and is not afraid to get their hands dirty building from the ground up.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Effectively coaches both new and experienced managers, along with their teams, to build their skill sets over time.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Versed in conflict resolution, applying both EQ and IQ in demonstrating excellent judgment.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Has been an effective strategic partner and coach to executive-level leadership.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Communicates clearly and empathetically both face-to-face and in writing.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Excels at building relationships within and across teams.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Has integrity; understands how to handle confidential information and sensitive issues.</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Is agile and excels at multitasking, independently prioritizing and ensuring all needs are met.&nbsp;</span></li> <li style="font-weight: 400;"><span style="font-weight: 400;">Eagerness to learn, motivated, and active learner. If you don’t understand something, you figure out a way to learn about it, and you aren’t afraid to ask when you need help.</span></li> </ul> <hr> <p><span style="font-weight: 400;">People are what make Heap awesome. Regardless of age, education, ethnicity, gender, sexual orientation, or any personal characteristics, we want everyone to feel welcome. We are committed to building a diverse and inclusive equal opportunity workplace everyone can call home.</span></p> <p>Heap has raised $205M in funding from NEA, Y Combinator, Menlo Ventures, SVAngel, Sam Altman, Garry Tan, Alexis Ohanian, Harj Taggar, Ram Shriram, and others. We offer plenty of awesome benefits, and we were named #1 on&nbsp;<a class="c-link" href="https://www.glassdoor.com/blog/heap-bptw19/" target="_blank" data-stringify-link="https://www.glassdoor.com/blog/heap-bptw19/" data-sk="tooltip_parent" data-remove-tab-index="true">Glassdoor’s Best Places to Work (SMB)</a>. We'd love to hear from you!</p> <p><em>#LI-MM1</em></p>
Software Engineer, Infrastructure (Se...
<p data-renderer-start-pos="18">Heap's mission is to power business decisions with the truth. We're building infrastructure to automatically capture customer interactions on the web and mobile applications, make sense of them, and make them actionable for anyone. We want to enable everyone to understand their millionth customer as well as they understood their first.</p> <p data-renderer-start-pos="357">We're looking for a seasoned Infrastructure Engineer to take the lead on some of the most challenging projects on our Platform &amp; Infrastructure teams. As a member of the Platform group, you'll be responsible for extending and scaling the core platform that runs all of Heap. You'll remove bottlenecks in our event ingestion pipeline (Kafka / Scala) to help us scale to hundreds of billions of events every day. You’ll optimize and extend the distributed database engine that powers our analytical workloads (Postgres / Citus), and help build a new data lake system for batch querying. You'll help us break up monolithic services into smaller, more manageable chunks and define more explicit API boundaries and object schemas across Heap services.</p> <p data-renderer-start-pos="1106">For this role, we're looking to bring on an Infrastructure Engineer to help lead the DevOps side of this challenge. Help us de-risk our stack, add more 9s to our availability, and incorporate open source tooling.&nbsp;We're looking for more vital software engineering skills than a typical DevOps role requires. This is a building role that focuses on stability, operability, and tooling, not an ops role. You'll need to be able to understand our codebase and debug issues as they come up.</p> <p data-renderer-start-pos="1592">We're a distributed team that operates in&nbsp;<strong data-renderer-mark="true">US West (PT)</strong>&nbsp;and&nbsp;<strong data-renderer-mark="true">Australian (EST) time zones</strong>. We're open to hiring the right person anywhere within those time zones.<br><br></p> <h3 data-renderer-start-pos="1753"><strong data-renderer-mark="true">What we’re looking for:</strong></h3> <ul class="ak-ul" data-indent-level="1"> <li> <p data-renderer-start-pos="1779">A collaborative and intellectually curious approach to software development and infrastructure design. You enjoy learning from and teaching others, and aren't afraid of asking lots of questions.</p> </li> <li> <p data-renderer-start-pos="1977">Excellent communication skills, particularly in writing. We're a distributed team worldwide, so we pride ourselves on our ability to communicate complex ideas clearly in writing across the team.</p> </li> <li> <p data-renderer-start-pos="2175">A track record of leading projects to success over many years (5-7+ years of experience), with deep experience in building data platforms at scale for both ad hoc analytical and batch processing workloads.</p> </li> <li> <p data-renderer-start-pos="2384">You have experience with modern DevOps tooling, infrastructure as code, configuration management, CI pipelines, package managers - we need someone who has deep knowledge of the full DevOps ecosystem.</p> </li> <li> <p data-renderer-start-pos="2587">A strong understanding of cloud computing with 5+ years of working with AWS.</p> </li> </ul> <p data-renderer-start-pos="2667">Under the hood, Heap is powered by TypeScript, Golang, Scala, Spark, Kafka, and CitusDB (PostgreSQL) and Redis. For more about our architecture, check out&nbsp;<a class="css-tgpl01" href="https://heap.io/blog/engineering/virtual-events" data-renderer-mark="true">Virtual Events: Making Data-Driven Decisions a Reality</a>.</p> <hr> <p><span style="font-weight: 400;">People are what make Heap awesome. Regardless of age, education, ethnicity, gender, sexual orientation, or any personal characteristics, we want everyone to feel welcome. We are committed to building a diverse and inclusive equal opportunity workplace everyone can call home.</span></p> <p><span style="font-weight: 400;">Heap has raised $205M in funding from NEA, Y Combinator, Menlo Ventures, SVAngel, Sam Altman, Garry Tan, Alexis Ohanian, Harj Taggar, Ram Shriram, and others. We offer plenty of awesome benefits, and we were named #1 on </span><a href="https://www.glassdoor.com/blog/heap-bptw19/"><span style="font-weight: 400;">Glassdoor’s Best Places to Work (SMB)</span></a><span style="font-weight: 400;">. We'd love to hear from you!</span></p> <p>#LI-JB1</p>
Software Engineer, Data Platform (Sen...
<p data-renderer-start-pos="18">Heap’s mission is to power business decisions with truth. We’re building infrastructure to automatically capture customer interactions on web and mobile applications, make sense of them, and make them actionable for anyone. We want to enable everyone to understand their millionth customer as well as they understood their first.</p> <p data-renderer-start-pos="349">We’re looking for a seasoned backend platform engineer to take the lead on some of the most challenging projects on our Data Platform team. As a member of the Data Platform team you’ll be responsible for extending and scaling the core platform that runs all of Heap. You’ll improve bottlenecks in our event ingestion pipeline (Kafka / Scala) to help us scale to hundreds of billions of events every day, optimize and extend the distributed database engine that powers our analytical workloads (Postgres / Citus), and help build out a new data lake system for batch querying. You’ll help us break up monolithic services into smaller, more manageable chunks, and define clearer API boundaries and object schemas across Heap services.</p> <p data-renderer-start-pos="1082">We’re a distributed team that operates mostly in <strong data-renderer-mark="true">US West (PT)</strong> and <strong data-renderer-mark="true">Australian (EST) time zones</strong>. We’re open to hiring the right person anywhere within those timezones.</p> <p data-renderer-start-pos="1249"><strong data-renderer-mark="true">What we’re looking for</strong></p> <ul class="ak-ul" data-indent-level="1"> <li> <p data-renderer-start-pos="1275">A collaborative and intellectually curious approach to software development. You enjoy learning from and teaching others, and aren’t afraid of asking lots of questions.</p> </li> <li> <p data-renderer-start-pos="1275">Excellent communication skills, particularly in writing. We’re a distributed team all over the world, so we pride ourselves on our ability to communicate complex ideas clearly in writing across the team.</p> </li> <li> <p data-renderer-start-pos="1654">A track record of leading projects to success over many years (5-7+ years of experience), with deep experience in building data platforms at scale for both ad hoc analytical and batch processing workloads.</p> </li> <li> <p data-renderer-start-pos="1863">Experience in building high-volume streaming event architectures (Kafka or similar).</p> </li> <li> <p data-renderer-start-pos="1951">A strong understanding of cloud computing with 4+ years of working with AWS.</p> </li> </ul> <p data-renderer-start-pos="2031">Under the hood, Heap is powered by Node.js, TypeScript, Golang, Scala, Spark, Kafka, Redis, and PostgreSQL (using CitusDB). For more about our architecture, check out&nbsp;<a class="css-tgpl01" href="https://heap.io/blog/engineering/virtual-events" data-renderer-mark="true">Virtual Events: Making Data-Driven Decisions a Reality</a>.</p> <hr> <p><span style="font-weight: 400;">For New York City-based candidates, the base pay for this role is anticipated to be between $120,000-$200,000. The anticipated base pay range is based on information as of the time this post was generated. Actual compensation for successful candidates will be carefully determined based on a number of factors, including their skills, qualifications, and experience.</span></p> <p><span style="font-weight: 400;">People are what make Heap awesome. Regardless of age, education, ethnicity, gender, sexual orientation, or any personal characteristics, we want everyone to feel welcome. We are committed to building a diverse and inclusive equal opportunity workplace everyone can call home.</span></p> <p><span style="font-weight: 400;">Heap has raised $205M in funding from NEA, Y Combinator, Menlo Ventures, SVAngel, Sam Altman, Garry Tan, Alexis Ohanian, Harj Taggar, Ram Shriram, and others. We offer plenty of awesome benefits, and we were named #1 on </span><a href="https://www.glassdoor.com/blog/heap-bptw19/"><span style="font-weight: 400;">Glassdoor’s Best Places to Work (SMB)</span></a><span style="font-weight: 400;">. We'd love to hear from you!</span></p>
Engineering Manager, Core Services
<p data-renderer-start-pos="3052">Heap’s mission is to power business decisions with truth. We’re building infrastructure to automatically capture customer interactions on web and mobile applications, make sense of them, and derive actionable insights for anyone. We want to enable everyone to understand their millionth customer as well as they understood their first.</p> <p data-renderer-start-pos="3389">For this role, we’re looking for an Engineering Manager to grow and develop an engineering team within our Platform group. You’ll be responsible for technical strategy, execution, and delivery on a core part of our platform used by all of Heap’s engineering teams (Capture, Insights, Data Ecosystem, and Data Science) to deliver delightful products used by thousands of customers. You’ll hire, coach, and develop a diverse team of engineers, and work cross-functionally with a variety of teams across the company to inform direction and roadmap.</p> <p data-renderer-start-pos="3936">As the leader for our Bedrock team, you’ll be responsible for enabling Heap engineers with the tools to deploy, monitor, troubleshoot, and restore services with minimal overhead. This will include automating infrastructure behind our dev, test, staging, and production environments, build and CI/CD infrastructure, and observability and monitoring services and infrastructure. You will bring maturity to the team to ensure quality and predictability to the deliverables, and drive efficiency and optimization in execution. This is an extremely high-impact role with high visibility with the executive team.</p> <p data-renderer-start-pos="4547"><strong data-renderer-mark="true">What you’ll do</strong></p> <ul class="ak-ul" data-indent-level="1"> <li> <p data-renderer-start-pos="4565">Remotely manage a diverse group of 6-10 engineers ranging from junior to senior. Support their growth and development through continuous coaching and feedback.</p> </li> <li> <p data-renderer-start-pos="4565">Work closely with product management and other engineering leaders to understand the needs of the organization and help translate those into roadmap items for the team.</p> </li> <li> <p data-renderer-start-pos="4565">Anticipate the needs of the engineering teams as they grow and create strategic initiatives to ensure the platform team is ready for the future.</p> </li> <li> <p data-renderer-start-pos="4565">Own execution and delivery on your engineering team, and help the team balance new feature work with technical debt and platform investment.</p> </li> <li> <p data-renderer-start-pos="4565">Own the code - help lead system and technical design, and ensure code meets the highest standard of quality and maintainability by participating in code reviews.</p> </li> <li> <p data-renderer-start-pos="4565">Contribute to a fast-growing engineering organization and help us scale up processes and best practices across the entire company.</p> </li> </ul> <p data-renderer-start-pos="5481">We are a distributed team with members in Australia and US. We encourage a culture of close collaboration and high throughput communication and interaction among and within teams. For this role, we’re primarily looking for a manager working in the Pacific or Australia time zones.</p> <p data-renderer-start-pos="5763"><strong data-renderer-mark="true">What we’re looking for</strong></p> <ul class="ak-ul" data-indent-level="1"> <li> <p data-renderer-start-pos="5789"><em data-renderer-mark="true">A track record of leading projects to success over many years (5-7+ years of experience), with deep experience in infrastructure design and deployments at scale, preferably for large-scale web and data processing workloads.</em></p> </li> <li> <p data-renderer-start-pos="5789"><em data-renderer-mark="true">A solid engineering background that has kept pace with new technologies and a strong understanding of cloud computing (at least 5 years of experience in technical roles working with AWS).</em></p> </li> <li> <p data-renderer-start-pos="5789">Deep knowledge of the full DevOps ecosystem and significant experience with modern DevOps tooling, infrastructure as code, configuration management, CI pipelines, package managers.</p> </li> <li> <p data-renderer-start-pos="5789">Passion for coaching, developing, and managing diverse teams of engineers (at least 2+ years leading a team of 5+, including remote engineers).</p> </li> <li> <p data-renderer-start-pos="5789">Experience running team cadences in a fast-moving, Agile environment, working cross-functionally with product management to set a roadmap, and driving disciplined execution for results.</p> </li> <li> <p data-renderer-start-pos="5789">Excellent communication skills, particularly in writing. We're a distributed team worldwide, so we pride ourselves on our ability to communicate complex ideas clearly in writing across the team.</p> </li> </ul> <p data-renderer-start-pos="6915">We use a variety of technologies and tools to deploy and manage our infrastructure including Terraform, Packer, Docker, InSpec, Buildkite, and AWS services. The tech stack used by Heap engineers to build products includes Node.js, TypeScript, Golang, Scala, Spark, Kafka, Redis, and PostgreSQL (using Citus). For more about our architecture, check out&nbsp;<a class="sc-eHgmQL jxCPuk" href="https://heap.io/blog/engineering/virtual-events" data-renderer-mark="true"><u data-renderer-mark="true">Virtual Events: Making Data-Driven Decisions a Reality</u></a>.</p> <hr> <p><span style="font-weight: 400;">For New York City-based candidates, the base pay for this role is anticipated to be between $200,000-$290,000. The anticipated base pay range is based on information as of the time this post was generated. Actual compensation for successful candidates will be carefully determined based on a number of factors, including their skills, qualifications, and experience.</span></p> <p><span style="font-weight: 400;">People are what make Heap awesome. Regardless of age, education, ethnicity, gender, sexual orientation, or any personal characteristics, we want everyone to feel welcome. We are committed to building a diverse and inclusive equal opportunity workplace everyone can call home.&nbsp;</span></p> <p><span style="font-weight: 400;">Heap has raised $205M in funding from NEA, Y Combinator, Menlo Ventures, SVAngel, Sam Altman, Garry Tan, Alexis Ohanian, Harj Taggar, Ram Shriram, and others. We offer plenty of awesome benefits, and we were named #1 on </span><a href="https://www.glassdoor.com/blog/heap-bptw19/"><span style="font-weight: 400;">Glassdoor’s Best Places to Work (SMB)</span></a><span style="font-weight: 400;">. We'd love to hear from you!&nbsp;</span></p> <p><span style="font-weight: 400;"><em>#LI-CN1</em></span></p>
Verified by
You may also like