Program Manager, Responsible Scaling Policy

New York , United States
Hybrid

AI overview

This role offers a unique opportunity to work on AI risk reduction by collaborating across various teams and addressing complex challenges in the field.

About Anthropic

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

About the role

We are seeking a pragmatic generalist to help grow capacity for our ongoing efforts to execute on (as well as improve) Anthropic’s Responsible Scaling Policy (RSP). 

Our RSP is a series of technical and organizational protocols that we have adopted to help us manage the risks of developing increasingly capable AI systems. Among other things, it involves maintaining:

  • Forward-looking plans for improving risk mitigation across the areas of Security, Alignment, and Safeguards. To maintain these plans, we work with stakeholders from across the company to set and iterate on ambitious but achievable goals, regularly check in on whether we’re on track to meet the goals, and problem-solve as needed to fulfill their spirit.
  • Ongoing assessments of how well we are executing on the vision of our RSP —especially the extent to which our AI systems may or may not pose catastrophic risks, in light of their capabilities as well as our risk mitigations. We monitor developments in our AIs’ capabilities, and changes in our risk mitigations, to keep these up to date and ensure that any adjustments to our operational practices are made deliberately and thoughtfully.

As the company grows and AI capabilities improve, executing on our RSP is becoming increasingly important, complex, and cross-functional. Our RSP team works to:

  • Set and check in on forward-looking goals for improving risk mitigations.
  • Check in on activity across the company to ensure that our activities and risk mitigations are in line with the RSP.
  • Partner with the Security, Alignment, and Safeguards teams to develop practical and effective risk mitigation strategies.
  • Propose RSP revisions to reflect what we’re learning.
  • Collaborate with our Policy team when the RSP is relevant to regulation.

This role offers a unique opportunity to work on the nuts and bolts of AI risk reduction, interacting with many different parts of the company. 

Success in this role means learning quickly about many aspects of our business; combining this with a deep understanding of the major catastrophic risks potentially posed by advanced AI; and bringing a pragmatic problem-solving attitude, constantly looking for the best and most practical ways to achieve risk reduction.

In this role, you will:

  • Build relationships with internal experts on Safeguards, Security, Alignment, capability evaluations, and other relevant areas.
  • Learn about ongoing questions and challenges faced by these teams, and help to find the best balance between AI risk reduction and pragmatism.
  • Gather information from across the company and assist in analyzing relevant risks.
  • Help to drive conversations about the ambitious-but-achievable plans we can make to level up our risk mitigations.
  • Collaborate with our Policy team, advising on regulation relevant to RSPs.
  • Generally work to identify the most promising risk mitigations to be further developed and/or exported to the rest of the AI industry.

You may be a good fit if you:

  • Have (or can quickly develop) a deep understanding of major catastrophic risks potentially posed by advanced AI.
  • Are passionate about reducing the harms and improving the benefits of AI  and align with Anthropic's safety mission and commitment to responsible AI development
  • Are a pragmatic problem-solver who relishes the opportunity to find the best balance between the goal of reducing catastrophic risks and staying on the frontier of AI development.
  • Can write quickly and clearly in a way that gives audiences an easy time understanding your reasoning and justifications for your claims
  • Are a flexible generalist who is excited to learn about many topics and evolve your work in unanticipated directions as we contend with a rapidly changing AI landscape
  • Are highly organized and excel at managing multiple projects simultaneously, maintaining clear priorities and delivering on tight timelines
  • Are comfortable operating in ambiguous environments, taking ownership of problems, and proactively driving initiatives with limited precedent
  • Are scrappy and hard-working, but also humble, genuinely collaborative, and a strong team player
  • Hold at least a Bachelor's degree in a related field

The annual compensation range for this role is below. For sales roles, the range provided is the role’s On Target Earnings ("OTE") range, meaning that the range includes both the sales commissions/sales bonuses target and annual base salary for the role. Our total compensation package for full-time employees includes equity and benefits.

Annual Salary:
$190,000$285,000 USD

Logistics

Education requirements: We require at least a Bachelor's degree in a related field or equivalent experience.

Location-based hybrid policy:
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.

Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.

We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed.  Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.

Your safety matters to us. To protect yourself from potential scams, remember that Anthropic recruiters only contact you from @anthropic.com email addresses. Be cautious of emails from other domains. Legitimate Anthropic recruiters will never ask for money, fees, or banking information before your first day. If you're ever unsure about a communication, don't click any links—visit anthropic.com/careers directly for confirmed position openings.

How we're different

We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.

The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.

Come work with us!

Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues. Guidance on Candidates' AI Usage: Learn about our policy for using AI in our application process

Perks & Benefits Extracted with AI

  • Equity Compensation: Our total compensation package for full-time employees includes equity and benefits.
  • Flexible Work Hours: We offer... flexible working hours.
  • Paid Time Off: We offer... generous vacation and parental leave.
  • Remote-Friendly: Location-based hybrid policy: Currently, we expect all staff to be in one of our offices at least 25% of the time.
  • Visa Sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate.

Anthropic is an AI safety and research company in San Francisco, specializing in building reliable, interpretable AI systems. Their AI assistant, Claude, offers fast, capable, and conversational support for tasks at any scale.

View all jobs
Salary
$190,000 – $285,000 per year
Ace your job interview

Understand the required skills and qualifications, anticipate the questions you may be asked, and study well-prepared answers using our sample responses.

Program Manager Q&A's
Report this job
Apply for this job