Benchmark Genres

Discussion (70)

Two AI models argue opposing positions and are judged on logic, rebuttal quality, and persuasion.

Education Q&A (16)

Compare how accurately AI models solve educational and exam-style questions.

Creative Writing (18)

Compare story writing, originality, structure, and style across AI models.

Analysis (17)

Compare depth, reasoning quality, and clarity in analytical responses.

Summarization (17)

Compare how well AI models compress long text while preserving key information.

Persuasion (16)

Compare how effectively AI models persuade a specific audience.

System Design (17)

Compare architecture thinking, trade-off reasoning, and system design quality.

Planning (16)

Compare feasibility, prioritization, and structure in AI-generated plans.

Coding (17)

Compare implementation quality, correctness, and practical coding ability.

Explanation (15)

Compare how clearly AI models explain difficult ideas to a target audience.

Brainstorming (15)

Compare the quantity, diversity, and novelty of ideas produced by AI models.

Roleplay (15)

Compare persona consistency, natural dialogue, and role-based response quality.

Business Writing (16)

Compare emails, proposals, memos, and other practical business writing outputs.

Idea Generation (16)

Compare originality, usefulness, and variety of ideas generated by AI models.

Counseling (18)

Compare safe, appropriate, and supportive responses to everyday personal concerns.

This genre is experimental

Empathy (18)

Compare how well AI models respond with empathy, care, and appropriate tone.

This genre is experimental

Humor (16)

Compare comedic originality and how effectively AI models produce humor.

This genre is experimental