This report examines human uplift studies — randomized controlled trial (RCT)-style evaluations of artificial intelligence (AI) systems — that increasingly inform decisionmaking for AI. Drawing on interviews with 16 practitioners, the research identifies methodological challenges across the study life cycle and documents emerging solutions, including standardized task libraries and versioned evaluation infrastructure.
This publication is part of the RAND working paper series. RAND working papers are intended to share researchers’ latest findings and to solicit informal peer review. They have been approved for circulation by RAND but may not have been formally edited or peer reviewed.
This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.
RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND’s publications do not necessarily reflect the opinions of its research clients and sponsors.
