Analyst – LLM/Prompt Evaluation (3 Month Fellowship)

Position Summary

We are looking for an analyst to play a vital role in maintaining and improving the effectiveness, accuracy, and fairness of our Large Language Model-powered tools and analyses. As we increasingly leverage LLMs for tasks ranging from feature extraction in political videos and powering chatbots, to generating persuasive scripts and scoring content effectiveness, ensuring the quality, reliability, and responsible deployment of these systems is paramount. This role involves significant hands-on quality control, evaluation design, proactive red teaming, bias analysis, and performance measurement to ensure our LLM outputs meet high standards and drive real-world impact during the fellowship period.

This is a 3 month fellowship position with the potential for conversion to a full-time role based on performance and business needs.