AI Compliance Analyst II - Healthcare preferred

Job Summary:

The AI Compliance Analyst II is responsible for developing, configuring, and optimizing AI solutions and agents that support business processes and operational objectives. This role serves as a trusted partner to stakeholders by identifying opportunities for AI enablement, recommending improvements, and ensuring solutions deliver measurable business value while aligning with governance requirements.

Essential Functions:

Designs, builds, and administers moderately complex AI solutions and agents using Copilot, Copilot Studio, Power Automate, Nintex and other approved tools.

Provides ongoing oversight of AI solutions at the business level.

Evaluates and optimizes AI solution behavior and identifies opportunities for configuration improvements.

Monitors metrics and business outcomes.

Performs testing, validation, and quality review of AI solution outputs to ensure accuracy, usability, and alignment with expected business outcomes.

Maintains documentation related to AI solution configuration, workflows, prompts, user guidance, and performance observations.

Collaborates with technical, governance, compliance, and business partners to support responsible use, adoption, and ongoing enhancement of AI solutions.

Perform any other job related duties as requested.

Education and Experience:

• Bachelor's degree in a related field required
• Equivalent years of relevant work experience may be accepted in lieu of required education
• Three (3) years of experience in healthcare operations, business analysis, automation, digital transformation, technology solutions, or a related field required
• Experience to include a background in AI-enabled tools, digital engagement, automation, or conversational technologies required
• Experience setting up or improving service journeys, knowledge resources, workflows, or AI-enabled experiences in a cross-functional environment preferred
• Experience in healthcare, health insurance, or another regulated industry is preferred

Competencies, Knowledge and Skills:

Understanding of generative AI tools, AI agents, large language model behavior, prompt patterns, agent instructions, model limitations, knowledge retrieval, and evaluation methods

Aptitude for designing AI-enabled healthcare service experiences, customer or employee journeys, conversational flows, and operational workflows

Ability to translate complex healthcare operation’s needs into clear AI experience designs, prompts, agent instructions, business requirements, acceptance criteria, and quality standards

• Ability to support testing, validation, and quality review of AI solution outputs to ensure accuracy, usability, and alignment with expected business outcomes
• Analytical, critical thinking, problem-solving, facilitation, communication, and documentation skills
• Knowledge of responsible AI principles, privacy considerations, accessibility, security, risk controls, and human-in-the-loop review practices
• Ability to establish and maintain effective working relationships with cross-functional stakeholders
• Ability to manage multiple assignments, prioritize work, meet deadlines, and adapt in a fast-paced environment
• Proficiency with Microsoft Office tools, including Word, Excel, PowerPoint, Outlook, Teams, and related collaboration tools
• Working knowledge of Nintex Workflows

Licensure and Certification:

None

Working Conditions:

General office environment; may be required to sit or stand for extended periods of time

Travel is not typically required