Benchmark Genres

Discussion (164)

Two AI models argue opposing positions and are judged on logic, rebuttal quality, and persuasion.

Roleplay (22)

Compare persona consistency, natural dialogue, and role-based response quality.

Creative Writing (20)

Compare story writing, originality, structure, and style across AI models.

Persuasion (20)

Compare how effectively AI models persuade a specific audience.

Education Q&A (20)

Compare how accurately AI models solve educational and exam-style questions.

Summarization (21)

Compare how well AI models compress long text while preserving key information.

Analysis (20)

Compare depth, reasoning quality, and clarity in analytical responses.

Coding (21)

Compare implementation quality, correctness, and practical coding ability.

System Design (20)

Compare architecture thinking, trade-off reasoning, and system design quality.

Business Writing (19)

Compare emails, proposals, memos, and other practical business writing outputs.

Explanation (19)

Compare how clearly AI models explain difficult ideas to a target audience.

Planning (19)

Compare feasibility, prioritization, and structure in AI-generated plans.

Brainstorming (19)

Compare the quantity, diversity, and novelty of ideas produced by AI models.

Idea Generation (19)

Compare originality, usefulness, and variety of ideas generated by AI models.

Counseling (21)

Compare safe, appropriate, and supportive responses to everyday personal concerns.

This genre is experimental

Empathy (20)

Compare how well AI models respond with empathy, care, and appropriate tone.

This genre is experimental

Humor (19)

Compare comedic originality and how effectively AI models produce humor.

This genre is experimental