Analyst - AI Applications

Job Description

Primary Responsibilities

The Analyst, AI Applications will support the evaluation, rollout, measurement, and ongoing management of AI-enabled and legal technology solutions across the firm. The role will serve as a shared resource across the AI Applications team, supporting the Director and Managers with evaluations, product tracking, reporting, coordination, research, and day-to-day execution. A key focus will be helping the team understand whether technology is working as intended. The Analyst will coordinate evaluations of pilots, new product capabilities, and model releases, track vendor roadmaps and product updates, monitor usage and adoption, and support decisions about broader rollout.

KEY RESPONSIBILITIES

Evaluations and Testing

• Coordinate evaluations of technology pilots, new product features, and AI model releases.
• Develop evaluation plans, test cases, success measures, and structured feedback processes.
• Coordinate participation from lawyers, business professionals, and subject-matter experts.
• Analyze qualitative and quantitative results and summarize findings for the AI Applications team.
• Maintain consistent evaluation methods, documentation, and historical results.
• Support recommendations regarding rollout, further testing, configuration changes, or other next steps.

Product and Roadmap Tracking

• Monitor product roadmaps, release notes, model updates, and new capabilities across key platforms.
• Maintain a clear internal view of upcoming releases and product changes.
• Assess which developments may be relevant to the firm and identify potential user groups or use cases.
• Work with Managers to determine which features require testing, communication, training, or phased rollout.
• Maintain product documentation, roadmap trackers, decision logs, and related team resources.

Measurement and Rollout

• Track product usage, adoption, engagement, and other measures of success.
• Develop recurring reports and dashboards for the AI Applications team.
• Identify trends, adoption gaps, and areas requiring further investigation.
• Support phased rollouts of new products, models, and features.
• Gather post-launch feedback and measure the impact of new capabilities.
• Help Managers determine where additional training, communications, or product changes may be required.

Team Coordination and Operational Support

• Serve as a shared coordination resource across the AI Applications team.
• Support the Director and Managers with meeting preparation, research, follow-up items, and project coordination.
• Maintain team trackers, action items, project plans, calendars, documentation, and status updates.
• Coordinate internal and external meetings, product demonstrations, testing sessions, and other team activities.
• Prepare briefing materials, presentations, summaries, and decision documents.
• Track commitments, deadlines, dependencies, and outstanding actions across multiple initiatives.
• Help ensure information is organized, current, and easily accessible to the team.
• Support ad hoc projects and requests from the Director and Managers.

Research and Continuous Improvement

• Conduct research on legal technology, AI products, market developments, and emerging capabilities.
• Compare product functionality and summarize relevant developments for the team.
• Gather user feedback and help identify opportunities to improve products and workflows.
• Support the development of consistent templates, processes, and standards across the AI Applications team.
• Work collaboratively with Knowledge Management, Innovation, Technology, Data Science and AI Engineering, and other firm functions.

Qualifications

REQUIRED EDUCATION, KNOWLEDGE & EXPERIENCE

• Bachelor’s degree or equivalent professional experience.
• Two or more years of experience in legal technology, technology consulting, business analysis, project coordination, product operations, or a related field.
• Strong analytical, organizational, and problem-solving skills.
• Ability to manage multiple priorities, follow through on details, and keep complex workstreams organized.
• Strong written and verbal communication skills.
• Ability to work effectively with technical and nontechnical stakeholders.
• Comfort working with data, product information, and new technology.

PREFERRED SKILLS & KNOWLEDGE

• Experience within a law firm, legal department, legal technology company, or professional services organization.
• Experience supporting technology evaluations, pilots, implementations, or product teams.
• Familiarity with AI-enabled products and legal technology.
• Experience with reporting, dashboards, project tracking, or product analytics.

PHYSICAL REQUIREMENTS

• Ability to sit and stand for extended periods.
• Ability to lift up to 15 pounds.

The expected salary range for this position is $110,000 - $130,000. Final compensation will be determined based on several factors, including but not limited to, relevant experience, qualifications, skill set, and geographic location.

Pillsbury Winthrop Shaw Pittman LLP is an Equal Opportunity Employer.

If you require an accommodation in order to apply for a position, please contact us at [email protected].