Tianyi Alex Qiu
Longtermism and future suffering

Tianyi Alex Qiu

Long-term moral progress in AI

Anthropic Fellows / Peking University

Bio

I build solutions to AI alignment, with a focus on how it uplifts human truth-seeking and moral progress - what I believe to be the most important problem of our time. Research projects I led on this front have received two Best Paper Awards at leading machine learning venues. Read more about me.

Mentee must-haves/nice-to-haves

  • The drive and willingness to learn everything on-the-fly; best if you are historically good at self-teaching.
  • If you pick/propose a technical project, you must have at least some amount of technical experience or background, whether formal or informal.
  • If you pick/propose a technical project with heavy ML experimentation elements, you must be at least familiar with Python and Linux. Exceptions are possible if you have a compelling case for your fit, so please don't hesitate to apply if that's the case.

Mentee role

By default, the mentee is expected to take ownership of the idea they choose while we give guidance/feedback (and as a result, they will be the first author of any publication resulting from such a mode of collaboration), unless someone is already working on it, in which case we will see what type of collaboration mode makes the most sense. This is less daunting than it may sound; even people who are completely new to research can do reasonably well in leading a project, as long as they have the relevant skillset & pick a tractable project.

❓ Sample mentee tasks

This depends heavily on the exact project chosen, but common tasks include:

  1. running ML / LLM experiments
  2. designing ML / LLM experiments with our guidance
  3. result analysis and visualization
  4. running human subject experiments
  5. building public-facing web demos
  6. writing papers

Mentor support

  • Guiding direction
  • Technical guidance (at ~2hr/wk capacity)
  • Facilitating connections
  • Feedback on anything

Questions for applicants

  1. What is the most impressive achievement you've done that's in the same category (experimental / mathematical / conceptual / organizational / etc.) as the project you picked or proposed? One sentence is sufficient.
  2. What is the most impressive idea or conceptual progress you've had in your past research or thinking? One sentence is sufficient.
  3. Describe the first thing (experiment for empirical project; a specific small question to answer for theoretical project; outreach/interest-gauging/etc. for field-building project) you want to try in the proposal you picked or proposed. List 2-3 most likely outcomes, and explain what each outcome means for your later course of action. Heed this advice.

Mentor-led project

Long-term moral progress in AI

Please refer to this document for a list of ~40 ideas instrumental to long-term moral progress in AI.

They have differing amounts of direct relevance, and feel free to pick the one(s) you think are most impactful.