Hide table of contents

In the past I've been confused by level frameworks. They often read to me as "incremental steps towards becoming a manager" or "just do bigger projects over time" or "your level is your years of experience," in a way that doesn't feel tied to fundamental value.

Things got a lot clearer for me once I started using a simple polynomial model of career growth. The model answers these questions:

  • What does it mean to be a junior, mid-level, senior, and principal member of the team?
  • How do you grow within each level?
  • How do you level up?
  • What risks do you need to watch out for?
  • Why are senior people sometimes less effective at startups?

It's a crude model and reality is complex, but I've found it helpful as one tool in my toolbox, both for making my own work more impactful and helping our team do the same.


Framework

Your level is how your successful work adds value

To figure out your level in a role, look at the level of your successful contributions - how do they usually add value to the team? Here are the levels we’ll talk about:

  • Junior work is additive. It adds constant value per contribution.
  • Mid-level work keeps on giving even after it’s done, adding more value over time.
  • Senior work multiplies the value produced by your team.
  • Principal work increases our growth rate. It sets up feedback loops that lead to compounding growth.

Senior or principal work can be worse. It works in an environment that’s already productive at junior and mid levels, and companies that are just starting out aren't. If you multiply 0 value or 0 growth, you’re still at 0. As a company or function grows, the room for senior and principal work grows with it. Some of our functions still benefit most from junior and mid-level work.

What value means differs between roles

Ultimately, value is about how well we accomplish Elicit’s mission - scaling up good reasoning. Day to day, it’s usually more helpful to think about your function:

ProductHow well do we understand what’s needed to make Elicit capable?
EngineeringHow capable is Elicit?
HRHow many Elicians are on our team, and how effective are they?
SalesWhat’s our revenue?
SupportHow much value are users getting out of Elicit as it is?

Junior work is additive

The model

A junior contribution adds constant value to the team:

If v* is the new value function:

If your work were Cookie Clicker, you would be clicking to get a cookie. If your work were gardening, you would be watering a plant.

Successes

Much of our successful foundational work takes the shape of junior contributions:

Product

Interviewing a user and embedding with user teams to learn what our users want

Documenting a feature request and scoping out what's needed to implement it

Engineering

Implementing a simple feature

Reviewing code (without teaching generalizable lessons)

HR

Reaching out to an interesting person on Twitter to hire them

Interviewing an applicant and writing up a scorecard

Sales

Referring a sales prospect

Making a sale by following an established playbook

SupportResponding to an individual user request

Failures

The risk at this level is low. Failure usually means that work wastes your own time and that the opportunity cost wasn’t worth it. This has happened to us a lot, too:

Product
  • Creating designs that we didn't end up implementing and that didn't give us important new information
Engineering
  • Implementing functionality or accuracy improvements that get subsumed by the next generation of models
HR
  • Carefully reviewing inbound applicants. This usually has lower ROI than outreach.
  • Sending 1-1 messages through LinkedIn. Who reads LinkedIn messages?
  • Taking many 1-1 meetings at a conference that didn't have the right audience for our roles.
Sales
  • Cold email outreach that isn’t extremely well targeted. The response rate is too low for this to be worth it.
Support
  • Manually implementing account change requests from users. This is well-intentioned but lower ROI than writing scripts or UI to do this.

Career growth

Growth within the junior level means adding more value per contribution (e.g. implementing bigger features) and making more frequent contributions.

You’ll soon see patterns in your work, or ways to automate your own work. Maybe you also notice inefficiencies in your team or the organization. If you can find ways to set up systems that add more value than you could on your own, and that keep on giving even when you’re not investing in them, you may be ready to level up.

An equally important dimension of career growth is being aware of when junior work is needed. When senior employees join startups, they sometimes don't see that they'd be more valuable to the team if they contributed high-quality additive work at a rapid pace rather than make more leveraged contributions, and no one else on the team can tell whether that's the right call.


Mid-level work keeps on giving

The model

Mid-level work adds a permanent linearly growing contribution to the team:

That is:

This is mostly independent of other work by your team - you’re creating a source of value that keeps on giving over time, even without further investment.

In Cookie Clicker, you’d now be buying auto-clicking cursors and grandmas. As a gardener, you’d be sowing seeds that grow to be trees over time.

Successes

A lot - but not all - of this is infra that we’ve set up to automate work that our team did manually before:

Product
  • Creating a form for users to fill out when they sign up to Elicit that tells us what users are hoping to get out of it, and who our users are
Engineering
  • Setting up a search pipeline that updates our index every time new data dumps from Semantic Scholar come out
  • Creating a “user happiness” monitoring dashboard and monitor in Datadog that notifies us whenever user-visible metrics are out of bounds
HR
Sales
  • Setting up a Hubspot data collection form for sales leads, and auto-forwarding Hubspot form responses to different people based on the form values
  • Product-led growth: Building a good product first, then sales are much easier
Support

Failures

The risk at this level is significant.

The focus on setting up systems and doing indirect work can make you less effective than if you just made direct contributions. As a heuristic, if over 1-3 months you could have gotten more done with junior work than through more leveraged contributions, you or the team might not be ready for this level.

A few of the cases where we encountered this:

EngineeringAt Ought, the non-profit that incubated Elicit, we created ICE, a visual debugger for language model programs, in 2022. The project was ahead of its time but didn’t obviously result in a big impact of any kind.
HR

Providing and advertising a $5,000 hiring bonus for external referrals. We didn’t really get any referrals.

Podcast ads for recruiting haven’t led to many applicants

Recruiting agencies had a very low return of our time investment

Career growth

Career growth at mid-level means that you make increasingly big and frequent improvements to slope, i.e. your work increasingly has long-run benefits. Over time, you might notice that besides making these contributions directly, you can also make the rest of your team more efficient in a way that outpaces what you can do on your own. Usually mid-level and senior work happens around the same time for a person, and is sometimes hard to distinguish.


Senior work multiplies the team’s effort

The model

A senior contribution is a permanent multiplier on your team’s effort:

That is:

The more productive your team already is, the more this helps. If the team invests time and effort , we now maybe get  out of it instead of . If the team isn’t productive already, this won’t help.

As a senior Cookie Clicker, you’d be upgrading grandmas and using sugar lumps to level up buildings, multiplying your click rates. In gardening, you’d be sharing knowledge about synergistic plants with your team, like corn + beans + squash with the corn providing structure for the beans, the beans fixing nitrogen in the soil, and the squash suppressing weeds and retaining soil moisture.

Successes

As a team, we’re strong at making each other more productive, so there’s a lot in this category:

Product
  • Creating long-term strategy docs like this one on our core bets that make it easier to evaluate which features advance our mission
  • Having a regular routine of deploying a feature on Thursday, writing a launch email early the following week, and launching a feature every week to reduce overhead in thinking about when to launch what
  • Creating a design system that can be used for most React components so that we don't have to design each component from scratch
Engineering
  • Automatic evaluation has made it much easier to test and deploy new language models immediately after they come out
  • Deployment previews and continuous integration save time for every feature
  • Teaching other engineers lessons that generalize in code reviews and pairing improves all of their future work
  • Modeling what excellent looks like even for small contributions sets a standard for the team, improving product quality
  • Writing a strong standard library that is used for many features
  • Using LLMs as coding assistants effectively to speed up implementation
HR
  • Automated sourcing sequences with Gem and Ashby make it easier to successfully reach out to potential hires
  • We’ve set up a little bot for optional automated pre-interviews that often reveals useful additional information about applicants
Sales
  • We’ve documented our sales approach and made templates that save time for each enterprise sale
  • Setting up Hubspot so that sales are less likely to fall through the cracks
Support
  • Creating templates for the most common responses to users
  • Using Front for managing support tickets & shared inboxes
Misc
  • Senior consultants and part-time hires - we’ve had and have amazing experience with Peter Ahn, Adam Wiggins, and many others who really helped level up our team across multiple functions
  • Spot checking work - as a manager, random thorough spot checking of work can increase the quality across the board by providing motivation to keep quality high

Failures

Beyond potentially being less efficient than one-off work, systems can actively slow down progress. For example, suppose you require all PRs to have detailed descriptions; the cost to team efficiency could easily be higher than the gains. We haven’t encountered this a lot (that we know), but here are a few examples:

Even when senior work is helpful, it's easy to err on the side of complexity when a simpler solution would be more effective.

Product
  • Continuing with agent prototypes (exploratory work that could change direction) for longer than needed to refute that GPT-4 level models can do long-range tasks
Engineering
  • Arguably we’ve sometimes suffered from not-invented-here syndrome, building technologies ourselves when we could use off-the-shelf tools.
HR
  • A bad review tool - for our last 360 review cycle, we used 15Five which (in my opinion) made it so hard to find individual reviews that it would have been better to use docs or spreadsheets
  • Our employee referral program - we have a bonus similar to our external bonus for referring hires, which didn’t have negative consequences, but also didn’t change the referral rate
Misc
  • Some consultants didn’t obviously generate value

Career growth

Career growth at a senior level means using systems thinking to find ways to generate compounding growth. This requires setting up self-amplifying feedback loops, a rarity.


Principal work increases the growth rate

The model

A principal contribution permanently increases our growth rate, i.e. leads to growth that compounds more quickly.

That is:

This is powerful if the value is already big, but the magic of compound returns can turn even small starting values into huge outcomes given time.

Setting up feedback loops can happen as a manager, but doesn’t have to. It does benefit from being able to effectively work across functions and teams though.

In Cookie Clicker, you've reached the principal level if you're stacking golden cookie combos, or telling your nephew to keep clicking the upgrade button for you. In gardening, you’d be setting up ecosystems of perennial plants that grow and multiply over time with little intervention.

Successes

Both success and failure are rare here, mostly because it’s hard to spot any opportunities for compounding growth.

Product
  • Viral growth through word of mouth, thanks to product quality. Almost all of our growth comes from happy users telling other happy users, mostly in person or seminars, sometimes on Youtube or Tiktok
Engineering
  • Collecting data about what papers users click on that then feeds back into better search rankings, which results in better data being shown to users for feedback collection
HR
  • Setting a very high bar for hires early on, and never compromising on it. Candidates are usually excited about our team and so our offer acceptance rate is high, enabling us to keep the bar high.
Misc
  • Investing unused cash in money market funds - but the growth rate is small enough relative to startup timescales that it doesn’t make a big difference

Failures

Product

Early Elicit supported user-made tasks - worth trying, but almost all tasks that people actually used were made by us, so we didn’t see compounding growth here

Elicit previously supported sharing of URLs, which was used some but not enough to get a growth loop off the ground

Part of our long-term motivation for Elicit Notebooks is to let users define custom multi-step workflows that they can share with others; however, so far we’re mostly seeing usage with one or two steps

SalesFor enterprise sales, the compound growth loop is “more sales → more revenue → hire more sales people → more sales”. While our product is still changing rapidly, it’s hard to get this loop off the ground.

Career growth

Career growth at this level means bigger increases in growth rate and more frequent increases. Almost no one makes successful principal contributions with any regularity, so the first aim should be to do this repeatedly at all.


Caveat: It’s a simple model

Work can be additive within a single team, but multiplicative from another team’s point of view. For example:

  • Hiring a tech lead is additive from the HR team’s perspective, but multiplicative from the engineering team’s perspective.
  • Implementing a feature is additive from the engineering team’s perspective but can permanently increase returns from the product team’s perspective.

I’ve mostly thought about work from within each team’s perspective. A better model would take into account cross-team effects, and ideally the information value of exploratory work as well, but all of this is heuristics anyway so I didn't try to be super rigorous.


Summary

A company is an engine that generates value. Elicit aims to scale up good reasoning, so for us value is measured by how much we help with good reasoning.

Elicit is made out of many smaller engines, each with its own value metrics. Product defines what’s needed to scale up good reasoning, engineering figures out how to implement it, sales and support make it available to users and capture some of the value for our future growth, and hiring builds out the team.

In this picture:

  • Junior work adds constant value fuel to each engine, effectively providing a one-time jump ahead.
  • Mid-level and senior work tune existing engines so they’re more efficient, increasing the speed with which they generate value.
  • Principal work builds new engines or connects existing ones, increasing our growth rate.

To succeed at scale, view your work in the context of building more efficient and better engines. And if you're not at Elicit yet - join us!

 

Acknowledgments

Thanks to Jungwon Byun, Panda Smith, Adam Wiggins, and Venki Kumar for helpful feedback.

7

0
0

Reactions

0
0

More posts like this

Comments
Curated and popular this week
Relevant opportunities