Llm Evaluator Pro
# LLM Evaluator ⚖️ LLM-as-a-Judge evaluation system powered by Langfuse. Uses GPT-5-nano to score AI outputs. ## When to Use - Evaluating quality of search results or AI responses - Scoring traces
AI Summary
This tool helps evaluate the quality of AI responses by scoring them on relevance, accuracy, and helpfulness using an AI judge and integrating with Langfuse for tracking.
Install
claw install aiwithabidi/llm-evaluator-pro Security Analysis
How we score →6
Security Score
Composite score from AI analysis of code safety, publisher trust, scope clarity, permission surface, and community signals.
Preliminary score — detailed analysis pending.
review
Verdict
Derived from the security score:
Safe (7+) · Review (5-6) · Suspicious (3-4) · Malicious (1-2)
N/A
Risk Level
Overall risk assessment: Low (safe to use), Medium (review recommended), High (use with caution), Critical (do not use).
This entry has preliminary scoring. Detailed multi-criteria analysis is in progress.
Repository Insights
0
Contributors
Frequently Asked Questions
What is Llm Evaluator Pro?
This tool helps evaluate the quality of AI responses by scoring them on relevance, accuracy, and helpfulness using an AI judge and integrating with Langfuse for tracking.
Is Llm Evaluator Pro safe to use?
Llm Evaluator Pro has been analyzed by ClawGrid's security engine and rated "review" with a security score of 6/10. See the Security Dashboard for more.
How do I find more AI & LLMs tools?
Browse all AI & LLMs tools on ClawGrid, or explore all skills and agents.
Similar AI & LLMs Tools
Afrexai Grant Writer
by 1kalin
This skill helps users write grant proposals by generating various sections like needs statements, project narratives, and budget justifications based on provided project details.
Afrexai Onboarding
by 1kalin
This skill helps users create and manage systematic onboarding processes for their clients, including checklists, welcome sequences, and success metrics.
Afrexai Sprint Retro
by 1kalin
This skill helps teams run structured sprint retrospectives by collecting feedback, identifying themes, and generating actionable items with owners and deadlines.
Optical Quantum Skill
by aadipapp
This skill simulates a quantum computer that calculates the similarity between two data vectors using optical physics principles.
Krumpklaw
by arunnadarasa
This skill allows an AI agent to participate in the Krump dance culture on Moltbook by posting training content, battle rounds, and event information.
Aibrary Growth Plan
by asoiso
Helps you create a personalized learning and development plan with book recommendations, milestones, and weekly tasks.
You Might Also Like
Hardcover
by asaphko
This skill helps you manage your book reading lists and access book data from Hardcover.app.
Travel Manager
by alvarobcmed
This skill helps you plan and manage complex travel arrangements, including international trips, multi-destination itineraries, and family travel logistics.
Jk Archivist Tiktok Packager
This skill helps you create 6-slide portrait PNG slideshows with captions for TikTok.
Talkspresso
by baron-talkspresso
Manages your Talkspresso business, including services, appointments, products, clients, and earnings, by interacting with the Talkspresso API.