Tianyi Alex Qiu
Long-term moral progress in AI
Anthropic Fellows / Peking University
Bio
I build solutions to AI alignment, with a focus on how it uplifts human truth-seeking and moral progress - what I believe to be the most important problem of our time. Research projects I led on this front have received two Best Paper Awards at leading machine learning venues. Read more about me.
Mentee must-haves/nice-to-haves
- The drive and willingness to learn everything on-the-fly; best if you are historically good at self-teaching.
- If you pick/propose a technical project, you must have at least some amount of technical experience or background, whether formal or informal.
- If you pick/propose a technical project with heavy ML experimentation elements, you must be at least familiar with Python and Linux. Exceptions are possible if you have a compelling case for your fit, so please don't hesitate to apply if that's the case.
Mentee role
By default, the mentee is expected to take ownership of the idea they choose while we give guidance/feedback (and as a result, they will be the first author of any publication resulting from such a mode of collaboration), unless someone is already working on it, in which case we will see what type of collaboration mode makes the most sense. This is less daunting than it may sound; even people who are completely new to research can do reasonably well in leading a project, as long as they have the relevant skillset & pick a tractable project.
❓ Sample mentee tasks
This depends heavily on the exact project chosen, but common tasks include:
- running ML / LLM experiments
- designing ML / LLM experiments with our guidance
- result analysis and visualization
- running human subject experiments
- building public-facing web demos
- writing papers
Mentor support
- Guiding direction
- Technical guidance (at ~2hr/wk capacity)
- Facilitating connections
- Feedback on anything
Questions for applicants
- What is the most impressive achievement you've done that's in the same category (experimental / mathematical / conceptual / organizational / etc.) as the project you picked or proposed? One sentence is sufficient.
- What is the most impressive idea or conceptual progress you've had in your past research or thinking? One sentence is sufficient.
- Describe the first thing (experiment for empirical project; a specific small question to answer for theoretical project; outreach/interest-gauging/etc. for field-building project) you want to try in the proposal you picked or proposed. List 2-3 most likely outcomes, and explain what each outcome means for your later course of action. Heed this advice.
Mentor-led project
Long-term moral progress in AI
Please refer to this document for a list of ~40 ideas instrumental to long-term moral progress in AI.
They have differing amounts of direct relevance, and feel free to pick the one(s) you think are most impactful.
