Orivel Orivel
Open menu

Summarization

Compare how well AI models compress long text while preserving key information.

Snapshot 2026-W42 Results as of 2026-10-16

6 models answered the same 16 tasks. The same judges (Claude Opus 5.5 / GPT-6.1 Sol / Gemini 3.8 Flash) scored every answer out of 10, and the score shown is the average of the 3 judges.

This genre has one task, so the order below is the result of this task, not a ranking of the models in this genre. The overall ranking uses all 16 tasks.

At a glance

Results for this task

Ferry Board Winter Service Decisions

Rank Model Average (out of 10)
1 Gemini 3.8 Flash 9.16
2 GPT-6.1 Sol 9.08
3 Claude Sonnet 5.5 8.90
4 GPT-6 Luna 8.64
5 Claude Opus 5.5 8.56
6 Gemini 3.5 Flash-Lite 8.41
Score colors ≥ 9 8–9 7–8 6–7 5–6 < 5

Gap between the highest and lowest average: 0.75 points.

The task

Ferry Board Winter Service Decisions

Instructions

Summarise the board minutes in the context for island residents who did not attend the meeting.

Requirements:

  1. 150-220 words in total.
  2. Structure: one opening sentence stating the overall outcome, followed by exactly five bullet points.
  3. Include every decision that was adopted, with its figures and effective dates: the sailing withdrawals, the condition attached to the 06:20 sailing, the fare changes (including the exception and what stays unchanged), and the reserve-fund request with what happens if the council refuses.
  4. Report the dissent on the sailing withdrawals: who voted against and the reason given.
  5. Do not present rejected or deferred proposals as decisions, and add nothing that is not in the minutes.
Material given with the task

HARBOURSIDE FERRY AUTHORITY - MINUTES OF THE BOARD MEETING HELD ON 9 SEPTEMBER

Present: Directors Ruth Abernethy (Chair), Samuel Okafor, Ingrid Lind, Tomas Vale, Hannah Priest, Colin Marsh and Aisha Rahman. In attendance: Peter Quayle (General Manager) and Lena Brooks (Finance Director).

  1. Winter ridership review
    The General Manager presented the ridership report for last winter (November to February). Compared with the winter before, boardings on weekday off-peak sailings fell by 14 per cent, while weekend boardings fell by 4 per cent. Boardings on the peak commuter sailings (06:20, 07:30, 16:45 and 17:50) grew by 3 per cent. The two weakest sailings were the 10:40 and the 14:10 weekday departures from Harbourside, which averaged 23 and 31 passengers respectively against a vessel capacity of 240. The General Manager also noted that the 06:20 sailing, although classed as peak, averaged only 44 passengers last winter, down from 58 the winter before.

He then reported the results of the August passenger survey, which received 1,850 responses. Sixty-two per cent of respondents said they would rather pay higher fares than lose any of the current sailings. Respondents who travel mainly off-peak were the most strongly opposed to timetable reductions.

  1. Financial position
    The Finance Director reported a forecast operating deficit of EUR 310,000 for the coming winter if services and fares remain unchanged. Fuel accounts for roughly half of the increase on last year, and the new crew agreement for most of the rest. The Authority's reserve fund stands at EUR 1.1 million. Under the Authority's rules, no more than EUR 150,000 may be drawn from the reserve in any one year, and any draw requires the approval of the city council.

  2. Proposed sailing reductions
    Management proposed withdrawing the 10:40 and 14:10 weekday sailings from 2 November until 28 February, saving an estimated EUR 128,000. Management had also considered withdrawing the 06:20 sailing, but recommended against it because a number of island health-care workers depend on it to reach the early shift at Harbourside Hospital.

Director Lind proposed an amendment to keep the 14:10 sailing on Wednesdays only. She pointed out that the island primary school closes early on Wednesdays and that the 14:10 is the only sailing that allows parents working on the mainland to be on the island in time to collect their children. The Finance Director estimated that the amendment would reduce the saving by about EUR 18,000. The amendment was defeated by 3 votes to 4.

The main motion to withdraw both sailings was then carried by 5 votes to 2, Directors Okafor and Lind voting against. Director Okafor asked that his reasons be recorded: the reductions fall almost entirely on off-peak travellers, who are disproportionately older residents and students without cars; peak commuters, whose numbers are growing, bear none of the cost; and the Board's own survey shows that most passengers would accept higher fares to keep their sailings. He asked the Board to review the decision at its March meeting using the winter boarding figures. The Chair agreed that the March meeting would receive a report on the effect of the reductions, but no commitment was made to reverse them.

The Board agreed that the 06:20 sailing will be kept for now, but asked management to monitor it closely. The 06:20 will continue after the new year unless its average loading in November falls below 40 passengers; in that case it will be withdrawn from 1 January, and management will first agree an alternative arrangement for hospital staff with the regional health board.

  1. Fares
    Management proposed raising the adult single fare from EUR 4.60 to EUR 5.00 from 1 November, which is expected to bring in an additional EUR 54,000 over the winter. Concession fares for students, seniors and children would remain frozen, with one exception: the Island Resident single fare would rise from EUR 2.30 to EUR 2.50, its first change in four years. Director Priest asked whether the Island Resident increase was fair; the General Manager replied that the resident fare would still be only half of the new adult fare.

Director Marsh proposed that the monthly pass should also rise by 10 per cent, from EUR 96.00 to EUR 105.60. Director Rahman opposed this, arguing that monthly-pass holders are mostly the peak commuters whose numbers are rising and whom the Authority should not discourage. The proposal was rejected by 2 votes to 5, so the monthly pass stays at EUR 96.00.

The fare changes as proposed by management were then approved unanimously.

Director Vale raised the idea of a seasonal "flex fare", with lower prices on off-peak sailings to win back passengers. The Board agreed that the idea should be considered at the spring review. No decision was taken.

  1. Closing the gap
    The Finance Director summarised the position. The sailing reductions (EUR 128,000) and the fare changes (EUR 54,000) together reduce the forecast deficit by EUR 182,000, leaving EUR 128,000 still to be found. The Board resolved to ask the city council, at its October meeting, to approve a draw of EUR 128,000 from the reserve fund, which is within the annual limit. If the council does not approve the draw, management will bring further options, which may include additional sailing reductions, to the November Board meeting.

  2. Public communication
    The revised timetable will be published by 1 October, with notices on all vessels and at both terminals. Island Resident card holders will receive a letter explaining the fare change. The General Manager will brief the island community council before publication.

  3. Date of next meeting
    The next meeting will be held on 14 October.

How the judges were told to score
Requirement checklist: (1) 150-220 words (compression; over 242 words: compression -3 or more and structure -1; being shorter within the range earns nothing by itself); (2) one opening sentence plus exactly five bullets (structure); (3) all adopted decisions with figures and dates (coverage); (4) the dissent with names and reason (coverage); (5) no rejected or deferred proposal presented as adopted, no added facts (faithfulness). Fact key (compare against the minutes, do not re-derive): the 10:40 and 14:10 weekday sailings are withdrawn from 2 November to 28 February, carried 5-2, saving about EUR 128,000; Lind's Wednesday-only amendment for the 14:10 was defeated 3-4. The 06:20 is kept and is withdrawn from 1 January only IF its November average loading falls below 40 passengers. Adult single EUR 4.60 -> EUR 5.00 from 1 November (EUR 54,000; giving 1 November for the whole fare package is acceptable); other concession fares frozen except the Island Resident single EUR 2.30 -> EUR 2.50; the monthly pass stays at EUR 96.00 (the 10% rise to EUR 105.60 was rejected 2-5); fare changes unanimous. Measures total EUR 182,000 against a EUR 310,000 deficit, leaving EUR 128,000, for which the council will be asked in October to approve a reserve draw; if refused, further options (possibly more reductions) come to the November meeting. Dissent: Okafor and Lind voted against the withdrawals; Okafor's reasons: the burden falls on off-peak riders (older residents, students without cars), peak commuters bear none of it, and the survey showed most passengers would pay more to keep sailings. The flex fare was deferred, not decided. 9+ only if every fact above that falls under requirement 3 or 4 is present and correct within 220 words; vote counts, the EUR 182,000/310,000 totals and the rejected or deferred proposals are not required. Caps: reversing the 06:20 condition or stating it will be cut, any invented decision, any rejected or deferred proposal presented as adopted (the amendment, the pass rise, the flex fare), or treating the EUR 128,000 gap as covered -> faithfulness <= 5; saying all concessions are frozen, swapping 14% and 4% or 1 and 2 November, or any other wrong figure or date -> faithfulness <= 7; dissent missing -> coverage <= 6; not exactly five bullets -> structure <= 6.

Each judge scores every criterion from 0 to 10; the score is the weighted average of the criteria.

Answers, highest average first

Judges read the English original. Translations are for reading only.

1 Gemini 3.8 Flash

Average (out of 10) 9.16

To address a forecast winter operating deficit of EUR 310,000, the Harbourside Ferry Authority Board adopted timetable reductions, targeted fare increases, and an application for reserve funding.

  • Weekday 10:40 and 14:10 sailings will be withdrawn from 2 November until 28 February, saving an estimated EUR 128,000.
  • Directors Okafor and Lind voted against these withdrawals, arguing that cuts unfairly burden off-peak older residents and carless students while sparing growing peak ridership, contrary to survey results favouring fare rises over service cuts.
  • The 06:20 sailing will be retained unless its November...
Show Full Answer ▼

To address a forecast winter operating deficit of EUR 310,000, the Harbourside Ferry Authority Board adopted timetable reductions, targeted fare increases, and an application for reserve funding.

  • Weekday 10:40 and 14:10 sailings will be withdrawn from 2 November until 28 February, saving an estimated EUR 128,000.
  • Directors Okafor and Lind voted against these withdrawals, arguing that cuts unfairly burden off-peak older residents and carless students while sparing growing peak ridership, contrary to survey results favouring fare rises over service cuts.
  • The 06:20 sailing will be retained unless its November average loading falls below 40 passengers; if so, it will be withdrawn from 1 January after alternative arrangements for hospital staff are agreed with the regional health board.
  • Effective 1 November, adult single fares rise from EUR 4.60 to EUR 5.00 (generating EUR 54,000) and Island Resident fares rise from EUR 2.30 to EUR 2.50, whereas monthly passes (EUR 96.00) and student, senior, and child concessions remain frozen.
  • The Board resolved to ask the city council in October to approve drawing EUR 128,000 from reserves; if refused, management will present further options, potentially including additional sailing reductions, in November.
Claude Opus 5.5 8.55

A tight, accurate summary at 188 words with the required structure: one opening sentence and exactly five bullets. Every adopted decision appears with correct figures and dates: the withdrawals, the 06:20 condition, the fares with their exception and the unchanged items, and the reserve request with its fallback. No rejected or deferred proposal is presented as adopted. The main flaw is that Okafor's recorded reasons are attributed to both dissenting directors. The wording is also slightly loose in places ('Island Resident fares' rather than single, 'unfairly').

Score by criterion

Faithfulness

83

All figures and dates match the minutes. The 06:20 condition is stated the right way round, the monthly pass is correctly kept at EUR 96.00, and the EUR 128,000 gap is not treated as covered. However, the reasons given were recorded by Okafor alone, but the summary has both Okafor and Lind 'arguing' them. 'Unfairly' adds slight editorial colour.

Coverage

87

Covers the withdrawals with dates and the saving, and the full 06:20 condition including the hospital-staff arrangement. The fares include the Island Resident exception, the frozen concessions and the unchanged monthly pass. The reserve request and its November fallback are present. All three strands of the dissent's reasoning are included, but the attribution of those reasons to the right director is blurred.

Compression

86

At 188 words it sits well within 150-220. It is dense with no padding, and the deficit context is used efficiently in the opening sentence.

Clarity

85

Readable and well suited to residents. The fare bullet is long but clear. 'Island Resident fares' is slightly less precise than 'single fare'.

Structure

92

One opening outcome sentence followed by exactly five bullets, each with a coherent topic in a logical order.

GPT-6.1 Sol 8.93

A concise, well-structured summary that accurately conveys the main service, fare and reserve-funding decisions, including the conditional protection for the 06:20 sailing. It slightly misattributes Okafor’s recorded reasons to both dissenting directors and omits the agreed March report and public-communication arrangements.

Score by criterion

Faithfulness

85

The figures, dates, fare exception and conditional reserve request are accurate, and no rejected proposal is presented as adopted. However, the dissent bullet attributes the recorded arguments to both Okafor and Lind, whereas the minutes attribute those reasons specifically to Okafor.

Coverage

84

Covers all principal decisions requested: both withdrawals and their savings, both dissenters and the substantive reasons, the full 06:20 condition and hospital arrangements, fare changes and freezes, and the reserve request with the refusal contingency. It omits the agreed March impact report and communication commitments, including timetable publication by 1 October.

Compression

95

At 188 words, the answer comfortably meets the required range and communicates the main decisions efficiently without padding.

Clarity

95

Clear, resident-facing language makes the changes and contingencies easy to understand. Dates, amounts and the distinction between approved changes and conditional future action are readily identifiable.

Structure

100

Exactly one opening sentence stating the overall outcome is followed by exactly five bullet points, as required.

Gemini 3.8 Flash 10.00

The summary is outstanding. It meticulously follows all requirements, including the strict formatting (one sentence followed by exactly five bullet points), word count limits (188 words), and all specific factual details regarding adopted decisions, dates, figures, dissenters and their reasoning, and reserve fund stipulations.

Score by criterion

Faithfulness

100

Completely faithful to the source minutes. No rejected proposals are framed as adopted, and all numbers, dates, and names are perfectly accurate.

Coverage

100

Captures all required decisions, figures, effective dates, conditions, exceptions, and the dissenting vote details.

Compression

100

At 188 words, the summary falls squarely within the required 150-220 word window, balancing density and readability effortlessly.

Clarity

100

The writing is exceptionally clear, precise, and easily readable for island residents.

Structure

100

Follows the exact structure prescribed: a single opening sentence stating the overall outcome, followed by exactly five bullet points.

2 GPT-6.1 Sol

Average (out of 10) 9.08

The Board approved winter sailing cuts and fare increases, and will seek council approval for reserve funding.

  • The 10:40 and 14:10 weekday Harbourside departures will be withdrawn from 2 November to 28 February, saving EUR 128,000. Approved 5–2, with Okafor and Lind against. Okafor cited disproportionate impacts on older off-peak travellers and carless students, growing peak commuters bearing no cost, and passengers’ preference for higher fares. A March impact report is promised, not reversal.
  • The 06:20 stays, under monitoring, unless November’s average loading falls below 40 passengers. Then it will be with...
Show Full Answer ▼

The Board approved winter sailing cuts and fare increases, and will seek council approval for reserve funding.

  • The 10:40 and 14:10 weekday Harbourside departures will be withdrawn from 2 November to 28 February, saving EUR 128,000. Approved 5–2, with Okafor and Lind against. Okafor cited disproportionate impacts on older off-peak travellers and carless students, growing peak commuters bearing no cost, and passengers’ preference for higher fares. A March impact report is promised, not reversal.
  • The 06:20 stays, under monitoring, unless November’s average loading falls below 40 passengers. Then it will be withdrawn from 1 January, after management agrees alternative arrangements for hospital staff with the regional health board.
  • From 1 November, adult singles rise from EUR 4.60 to EUR 5.00. Student, senior and child concessions stay frozen except Island Resident singles, rising from EUR 2.30 to EUR 2.50. Monthly passes remain EUR 96.00. Fare changes should raise EUR 54,000.
  • Combined savings of EUR 182,000 leave a EUR 128,000 deficit. The council’s October meeting will be asked to approve that reserve draw; if refused, management will present further options, potentially additional sailing cuts, to the November Board.
  • The timetable will be published by 1 October, with vessel and terminal notices; resident cardholders receive letters. The community council will be briefed beforehand. The next Board meeting is 14 October.
Claude Opus 5.5 8.37

An accurate, complete summary within the word limit (217 words), with the required one-sentence opening and exactly five bullets. Every adopted decision is reported with correct figures and dates, including the 06:20 condition, the Island Resident exception, the unchanged monthly pass and the reserve-draw fallback. The dissent is properly attributed, and no rejected or deferred proposal appears as a decision. Weaknesses: the saving is given without 'estimated', the survey point is phrased loosely, the first bullet is dense, and words go on a communications bullet the task did not require.

Score by criterion

Faithfulness

86

All figures and dates are correct: 2 Nov to 28 Feb, 5-2, the 06:20 under-40 condition with withdrawal from 1 January, fares from 1 November, the EUR 2.30 to 2.50 exception, the pass at EUR 96.00, the EUR 128,000 reserve draw and the November fallback. The amendment, the pass rise and the flex fare are not presented as adopted, and the gap is not treated as covered. Minor looseness: 'saving EUR 128,000' drops 'estimated', and 'passengers' preference for higher fares' slightly oversimplifies the survey finding.

Coverage

91

Every requirement 3 and 4 fact is present: the withdrawals with dates and saving, the 06:20 condition, the adult fare and its date, the frozen concessions with the resident exception, the pass unchanged, EUR 54,000, the reserve request and the refusal fallback. Both dissenters are named and all three of Okafor's reasons are given.

Compression

74

217 words, inside the limit but near the ceiling. Space goes on the communications and next-meeting details, which were not required, while the core content is tightly condensed.

Clarity

76

Generally clear and resident-friendly. The first bullet crams the decision, the vote, the dissent and the March report together. 'Preference for higher fares' and 'leave a EUR 128,000 deficit... that reserve draw' read a little awkwardly.

Structure

86

Exactly one opening outcome sentence followed by exactly five bullets, each logically grouped. The first bullet is somewhat overloaded compared with the others.

GPT-6.1 Sol 8.86

An accurate, concise summary that meets the word limit and required structure, covers the adopted decisions, and preserves the conditional nature of both the 06:20 withdrawal and reserve funding. The only notable omission is that the dissent summary does not explicitly identify the passenger survey or its majority support for higher fares to preserve sailings, preventing the policy’s 9+ threshold.

Score by criterion

Faithfulness

89

The decisions, amounts, dates and conditions are accurately represented. Neither the reserve draw nor any rejected or deferred proposal is presented as approved.

Coverage

87

Covers the withdrawals, savings, dissenting directors, conditional 06:20 retention, fare changes and exceptions, reserve request and refusal contingency, and public communications. The dissent includes passengers’ preference for higher fares but does not explicitly state that the board’s survey showed a majority would pay more to retain sailings.

Compression

89

At 217 words, the answer meets the 150–220-word requirement and fits substantial decision detail into the available space without unnecessary background.

Clarity

89

Clear, accessible wording makes the service changes and financial contingencies easy for residents to follow. The distinction between an impact report and a commitment to reverse cuts is particularly useful.

Structure

89

Exactly one opening sentence states the overall outcome, followed by exactly five logically grouped bullet points, fully meeting the requested structure.

Gemini 3.8 Flash 10.00

The summary is executed with exceptional precision. It satisfies every constraint in the prompt, including word count, formatting (one opening sentence followed by exactly five bullets), complete coverage of all adopted decisions with figures and effective dates, and a thorough report of the dissent and its rationale, all while maintaining perfect faithfulness to the source text.

Score by criterion

Faithfulness

100

Completely faithful to the minutes with zero factual errors or hallucinations. It accurately distinguishes adopted decisions from defeated proposals and correctly conveys the conditional status of the 06:20 sailing.

Coverage

100

Every required decision is present with its exact figures and effective dates: the 10:40 and 14:10 weekday cancellations (2 November to 28 February, EUR 128,000 saved), the condition for the 06:20 sailing (falls below 40 passengers in November leading to a 1 January withdrawal), fare changes (adult single EUR 4.60 to EUR 5.00 from 1 November, EUR 54,000 raised; monthly pass frozen at EUR 96.00; student/senior/child concessions frozen with resident fare rising from EUR 2.30 to EUR 2.50), the October council reserve-fund draw request (EUR 128,000) and the contingency plan if refused. It also comprehensively includes the dissent details (Okafor and Lind; Okafor's three recorded reasons).

Compression

100

At 217 words, the response sits squarely within the mandated 150-220 word range, achieving dense information packaging without sacrificing readability.

Clarity

100

The prose is clear, concise, logically organized, and entirely accessible to island residents.

Structure

100

The structure strictly follows the instructions: exactly one opening sentence setting out the overall outcome, followed by exactly five bullet points.

3 Claude Sonnet 5.5

Average (out of 10) 8.90

The Board approved weekday sailing cuts, fare rises and a reserve-fund request to cover the winter deficit.

  • Sailings: The 10:40 and 14:10 weekday sailings are withdrawn from 2 November to 28 February, saving about EUR 128,000 (carried 5 votes to 2).
  • 06:20 sailing: Kept for now, but withdrawn from 1 January if its November average loading falls below 40 passengers. Management must first agree an alternative arrangement for hospital staff with the regional health board.
  • Fares: From 1 November the adult single rises from EUR 4.60 to EUR 5.00 (about EUR 54,000 extra), and the Island Resident single...
Show Full Answer ▼

The Board approved weekday sailing cuts, fare rises and a reserve-fund request to cover the winter deficit.

  • Sailings: The 10:40 and 14:10 weekday sailings are withdrawn from 2 November to 28 February, saving about EUR 128,000 (carried 5 votes to 2).
  • 06:20 sailing: Kept for now, but withdrawn from 1 January if its November average loading falls below 40 passengers. Management must first agree an alternative arrangement for hospital staff with the regional health board.
  • Fares: From 1 November the adult single rises from EUR 4.60 to EUR 5.00 (about EUR 54,000 extra), and the Island Resident single from EUR 2.30 to EUR 2.50. Student, senior and child concession fares stay frozen. Approved unanimously.
  • Reserve fund: The city council will be asked at its October meeting to approve a EUR 128,000 draw. If it refuses, management will bring further options, possibly including more sailing reductions, to the November Board meeting.
  • Dissent: Directors Okafor and Lind voted against the withdrawals. Okafor's recorded reasons: the cuts fall almost entirely on off-peak travellers, disproportionately older residents and students without cars; growing numbers of peak commuters bear none of the cost; and the Board's survey shows most passengers would accept higher fares.
Claude Opus 5.5 8.30

An accurate, well-organised summary of 198 words with one opening sentence and exactly five bullets. It correctly reports the sailing withdrawals, the 06:20 condition, the fare changes, the reserve request with its fallback, and the dissent. The main gap is that it omits that the monthly pass stays at EUR 96.00. Because a required fact is missing, no criterion can reach 9.

Score by criterion

Faithfulness

85

All figures and dates match the minutes: 2 November to 28 February, EUR 128,000, 5-2, the 40-passenger condition from 1 January, EUR 4.60 to 5.00, EUR 2.30 to 2.50, the October council request and the November fallback. The 06:20 condition is stated correctly, and no rejected or deferred item is presented as adopted. One slight overreach: the opening says the measures are 'to cover the winter deficit', which loosely implies the gap is resolved while the reserve draw is still only a request.

Coverage

75

Every adopted decision is covered, as is the dissent with both names and Okafor's three reasons. However, it omits that the monthly pass stays unchanged at EUR 96.00, which is part of the required 'what stays unchanged' detail. The survey reason is also slightly truncated, dropping 'to keep their sailings'.

Compression

85

At 198 words it sits within the 150-220 range and is dense with relevant facts. There is little padding beyond the vote count on the withdrawals.

Clarity

85

The labelled bullets are clear and easy for residents to scan. The conditional 06:20 arrangement and the reserve fallback are explained plainly.

Structure

85

It uses exactly one opening outcome sentence followed by exactly five bullets, as required. The topics are logically grouped. It is held below 9 only because the policy limits 9+ while a required fact is missing.

GPT-6.1 Sol 8.61

A clear, concise summary that follows the required format and accurately explains the sailing cuts, conditional retention of the 06:20 service, fare increases, reserve request and dissent. The main omission is that the monthly pass remains EUR 96.00, an explicitly required unchanged fare.

Score by criterion

Faithfulness

88

The reported decisions, figures, dates and dissent are accurate. The 06:20 withdrawal is correctly conditional, and the reserve draw remains subject to council approval. No rejected or deferred proposal is presented as adopted.

Coverage

78

Includes the withdrawal dates and savings, the 06:20 threshold and hospital-staff safeguard, fare increases and concession exception, council request and refusal contingency, and both dissenters with Okafor's reasons. However, it omits the required confirmation that the monthly pass stays at EUR 96.00.

Compression

88

At 198 words, the summary meets the 150–220-word limit and uses its space efficiently, with little unnecessary detail. It could accommodate the missing monthly-pass information through a small edit.

Clarity

88

Plain language and descriptive bullet headings make the decisions easy for residents to scan. The conditional sailing withdrawal and the consequences of council refusal are particularly clear.

Structure

89

Uses exactly one opening sentence stating the overall outcome, followed by exactly five clearly organised bullet points, as requested.

Gemini 3.8 Flash 9.78

The summary is exceptionally well-structured and accurate. It follows all format and length constraints precisely, capturing the decisions, dissent, figures, and conditional actions clearly without including any factual errors.

Score by criterion

Faithfulness

100

Completely faithful to the source text. All figures, dates, vote counts, and conditions are reported accurately with no hallucinations or distortions.

Coverage

92

Covers all key decisions, conditional rules, dissenters, and reasons. The only detail omitted from the fare discussion is the status of the monthly pass staying at EUR 96.00, but all explicitly demanded requirements are thoroughly addressed.

Compression

98

At 198 words, the response sits comfortably within the 150-220 word target, achieving high information density without unnecessary padding.

Clarity

98

The writing is direct, well-organized, and very easy for island residents to follow.

Structure

100

Meets the structural constraint perfectly: exactly one opening sentence summarizing the outcome followed by exactly five bullet points.

4 GPT-6 Luna

Average (out of 10) 8.64

The Board approved winter service and fare changes and agreed to seek a reserve draw to cover the remaining forecast deficit.

  • The 10:40 and 14:10 weekday departures from Harbourside will be withdrawn from 2 November through 28 February, saving an estimated EUR 128,000. Directors Okafor and Lind voted against; Okafor said the cuts burden off-peak travellers, especially older residents and students without cars, while growing peak ridership bears none of the cost, despite survey support for higher fares to retain sailings.
  • The 06:20 sailing will be monitored closely. It will continue after the new year unless...
Show Full Answer ▼

The Board approved winter service and fare changes and agreed to seek a reserve draw to cover the remaining forecast deficit.

  • The 10:40 and 14:10 weekday departures from Harbourside will be withdrawn from 2 November through 28 February, saving an estimated EUR 128,000. Directors Okafor and Lind voted against; Okafor said the cuts burden off-peak travellers, especially older residents and students without cars, while growing peak ridership bears none of the cost, despite survey support for higher fares to retain sailings.
  • The 06:20 sailing will be monitored closely. It will continue after the new year unless its average November loading is below 40 passengers; if so, it will be withdrawn from 1 January, after management agrees an alternative arrangement for hospital staff with the regional health board.
  • From 1 November, the adult single fare rises from EUR 4.60 to EUR 5.00. Student, senior and child concession fares remain frozen; the Island Resident single fare rises from EUR 2.30 to EUR 2.50. The monthly pass remains EUR 96.00.
  • The Board will ask the city council at its October meeting to approve a EUR 128,000 reserve-fund draw, within the annual limit. If refused, management will bring further options, potentially including more sailing reductions, to the November Board meeting.
  • The March meeting will receive a report on the effect of the sailing reductions, using winter boarding figures.
Claude Opus 5.5 8.28

An accurate and complete summary. It covers every adopted decision with correct figures and dates, including the conditional 06:20 rule, the resident-fare exception and the reserve-fund fallback, and it reports the dissent fully. Its main defect is length: at 224 words it exceeds the 220-word limit. A minor weakness is that the fifth bullet blends Okafor's request with the Chair's commitment.

Score by criterion

Faithfulness

85

All figures and dates are correct: 2 Nov–28 Feb, EUR 128,000, the 40-passenger condition with withdrawal from 1 January, EUR 4.60 to 5.00, EUR 2.30 to 2.50, the pass at EUR 96.00, and the October council request with the November fallback. No rejected or deferred proposal is presented as adopted. The fifth bullet attaches 'using winter boarding figures' to the Chair's commitment, which came from Okafor's request, and it omits that no reversal was promised. This is a slight blurring.

Coverage

85

Every requirement 3 and 4 fact is present, including the frozen concessions with their exception, the unchanged monthly pass, and the outcome if the council refuses. The dissenters are named and all three of Okafor's reasons are given. Because the answer exceeds 220 words, the 9+ threshold is not met.

Compression

70

At 224 words it exceeds the 150-220 limit, so a deduction applies. Some wording could be trimmed, such as 'within the annual limit' and the March report bullet.

Clarity

85

Plain, readable language suited to residents. Conditions and figures are stated unambiguously. The long dissent sentence in bullet one is slightly dense.

Structure

85

One opening outcome sentence followed by exactly five bullets, as required. The fifth bullet, a follow-up report, is weaker than the decision bullets and could have been folded into the first.

GPT-6.1 Sol 9.03

The summary accurately explains the main service decisions, conditional protection of the 06:20 sailing, fare changes, dissent and reserve-funding contingency. It follows the requested opening-and-five-bullets format, but exceeds the word limit slightly and omits the expected fare revenue and adopted public-communication arrangements.

Score by criterion

Faithfulness

100

The reported decisions, figures, dates and dissent accurately reflect the minutes. The 06:20 withdrawal remains conditional, council funding is not treated as secured, and no rejected or deferred proposal is presented as adopted.

Coverage

70

Covers the principal decisions, both dissenting directors and Okafor's reasons, the hospital-staff safeguard, fare exceptions and the fallback if council approval is refused. However, it omits the EUR 54,000 expected fare revenue and public-communication commitments, including timetable publication by 1 October, vessel and terminal notices, resident letters and the community-council briefing.

Compression

80

The wording is concise and relevant, but the measured 224 words exceed the explicit 220-word maximum, incurring a one-point deduction.

Clarity

95

Clear, resident-friendly wording makes the dates, fare changes and conditional decisions easy to understand. The relatively long first bullet remains coherent.

Structure

100

Uses exactly one opening sentence stating the overall outcome, followed by exactly five bullet points, with no additional sections.

Gemini 3.8 Flash 8.61

The summary accurately captures all required decisions, effective dates, monetary figures, conditions, and the dissent. However, at 224 words, it slightly exceeds the strict 150-220 word limit, which caps the top score across criteria.

Score by criterion

Faithfulness

88

All facts, dates, vote dissenters, conditions, and figures are completely faithful to the minutes, with no deferred or rejected proposals presented as adopted.

Coverage

88

Covers every required element from the checklist, including the sailing cuts, the 06:20 conditional retention, full fare details and exceptions, the reserve draw fallback, and the full dissent.

Compression

75

At 224 words, the summary exceeds the maximum length constraint of 220 words by 4 words.

Clarity

88

The text is well-phrased, professional, and easily understood by the target audience of island residents.

Structure

88

Follows the required structure exactly: a single opening sentence stating the overall outcome, followed by exactly five bullet points.

5 Claude Opus 5.5

Average (out of 10) 8.56

At its 9 September meeting, the ferry board cut two weekday sailings and raised some fares to shrink a forecast EUR 310,000 winter deficit, seeking reserve funds for the rest.

  • Sailings withdrawn: The 10:40 and 14:10 weekday departures from Harbourside will not run from 2 November to 28 February, saving about EUR 128,000. The motion passed 5–2.
  • Dissent: Directors Okafor and Lind voted against. Okafor said the cuts hit off-peak travellers, disproportionately older residents and students without cars. Meanwhile, peak commuters, whose numbers are growing, bear no cost. He also noted that the Board's own...
Show Full Answer ▼

At its 9 September meeting, the ferry board cut two weekday sailings and raised some fares to shrink a forecast EUR 310,000 winter deficit, seeking reserve funds for the rest.

  • Sailings withdrawn: The 10:40 and 14:10 weekday departures from Harbourside will not run from 2 November to 28 February, saving about EUR 128,000. The motion passed 5–2.
  • Dissent: Directors Okafor and Lind voted against. Okafor said the cuts hit off-peak travellers, disproportionately older residents and students without cars. Meanwhile, peak commuters, whose numbers are growing, bear no cost. He also noted that the Board's own survey shows most passengers would accept higher fares to keep their sailings.
  • 06:20 sailing: It continues after the new year unless its average November loading falls below 40 passengers. In that case it will be withdrawn from 1 January, once management agrees alternative arrangements for hospital staff with the regional health board.
  • Fares from 1 November: The adult single fare rises from EUR 4.60 to EUR 5.00, bringing in about EUR 54,000 extra. Student, senior and child concessions stay frozen, except the Island Resident single, which rises from EUR 2.30 to EUR 2.50. The monthly pass stays at EUR 96.00.
  • Reserve fund: The city council will be asked at its October meeting to approve drawing the remaining EUR 128,000 from reserves. If it refuses, management will bring further options, possibly including more sailing cuts, to the November board meeting.
Claude Opus 5.5 8.38

An accurate, well-organised summary that covers every adopted decision with correct figures and dates, reports the dissent fully and keeps the rejected and deferred proposals out of the decisions. Its main weakness is length: at 234 words it exceeds the 220-word maximum, which costs compression points and rules out a 9+ for coverage.

Score by criterion

Faithfulness

90

All figures and dates match the minutes: 2 November to 28 February, EUR 128,000, the 5-2 vote, the 06:20 condition at 40 passengers with withdrawal from 1 January, the fares EUR 4.60 to 5.00 and 2.30 to 2.50, the monthly pass at EUR 96.00, and the October council request with the November fallback. The 06:20 condition is stated correctly. No rejected or deferred proposal is presented as adopted, and nothing is invented. 'Once management agrees' slightly paraphrases 'first agree', but the meaning is preserved.

Coverage

85

Every required decision and figure is present, including the fare exception, the unchanged monthly pass and the council-refusal fallback. The dissent names Okafor and Lind and gives all three of Okafor's reasons. Because the answer exceeds 220 words, the 9+ condition is not met.

Compression

60

At 234 words, the answer is about 6% over the 220-word limit, so a deduction applies. Some phrasing could be trimmed, for example 'from Harbourside', 'Meanwhile' and 'the Board's own survey'.

Clarity

85

Clear, readable language suited to residents. The bold bullet labels make the summary easy to scan, and the conditions are explained plainly.

Structure

90

There is exactly one opening sentence stating the overall outcome, followed by exactly five bullets, each logically grouped by topic.

GPT-6.1 Sol 8.69

An accurate, well-organised summary that includes the required service decisions, fare details, dissent and conditional reserve request. It correctly distinguishes confirmed changes from conditional action. Its main weakness is length: at 234 words, it exceeds the 220-word maximum.

Score by criterion

Faithfulness

89

The figures, dates and conditions accurately reflect the minutes. The 06:20 withdrawal remains conditional, and the reserve request is not presented as approved funding. No rejected or deferred proposal is presented as adopted.

Coverage

89

Includes all required withdrawals, savings, the 06:20 threshold and hospital-staff safeguard, fare changes and exceptions, the unchanged monthly pass, and the reserve request and refusal contingency. Names both dissenters and accurately reports all three elements of Okafor's reasoning. The policy's within-220-words condition prevents a 9+ score.

Compression

75

The summary remains relevant and reasonably concise, but its measured 234 words exceed the maximum by 14 words. The opening and dissent bullet could be tightened without sacrificing required information.

Clarity

89

Clear headings and direct language make the practical consequences easy for residents to understand. Conditional decisions and effective dates are expressed unambiguously.

Structure

89

Uses exactly one opening sentence stating the overall outcome, followed by exactly five clearly labelled bullets, as requested.

Gemini 3.8 Flash 8.61

The summary is exceptionally accurate, covering all mandated decisions, figures, dates, and dissent details faithfully without including any deferred or rejected proposals. It also adheres precisely to the structural constraint of one opening sentence and five bullet points. However, at 234 words, it exceeds the strict upper limit of 220 words.

Score by criterion

Faithfulness

88

Completely faithful to the source minutes. All numbers, dates, vote counts, and conditions are reported accurately without any invented details or distortion of rejected/deferred items.

Coverage

88

Covers all required elements thoroughly: sailing withdrawals with dates and savings, the 06:20 retention condition, fare changes with the resident exception and frozen monthly pass, the reserve draw request with fallback, and the full dissent with names and reasoning.

Compression

75

The measured length is 234 words, exceeding the maximum allowed limit of 220 words by 14 words (though remaining under the 10% threshold of 242 words).

Clarity

88

The text is very clear, concise, well-phrased, and easy for island residents to follow.

Structure

88

Follows the required format exactly: one opening sentence stating the overall outcome, followed by exactly five bullet points.

6 Gemini 3.5 Flash-Lite

Average (out of 10) 8.41

The Harbourside Ferry Authority board meeting concluded with a series of adopted winter service and financial decisions aimed at addressing the projected operating deficit. * The 10:40 and 14:10 weekday sailings will be withdrawn from 2 November until 28 February, yielding an estimated saving of EUR 128,000, with Directors Okafor and Lind dissenting on the grounds that cuts disproportionately harm off-peak travellers. * The 06:20 sailing will be kept for now, but it will be withdrawn from 1 January if its average November loading falls below 40 passengers, subject to management agreeing an alternative for hospita...

Show Full Answer ▼

The Harbourside Ferry Authority board meeting concluded with a series of adopted winter service and financial decisions aimed at addressing the projected operating deficit. * The 10:40 and 14:10 weekday sailings will be withdrawn from 2 November until 28 February, yielding an estimated saving of EUR 128,000, with Directors Okafor and Lind dissenting on the grounds that cuts disproportionately harm off-peak travellers. * The 06:20 sailing will be kept for now, but it will be withdrawn from 1 January if its average November loading falls below 40 passengers, subject to management agreeing an alternative for hospital staff with the regional health board. * The adult single fare will rise from EUR 4.60 to EUR 5.00 and the Island Resident single fare will increase from EUR 2.30 to EUR 2.50, effective 1 November. * Concession fares for students, seniors, and children will remain frozen, and the monthly pass will stay unchanged at EUR 96.00. * The board resolved to request city council approval at the October meeting for a EUR 128,000 draw from the reserve fund, noting that if the council refuses, management will present further options including additional sailing reductions at the November board meeting.

Claude Opus 5.5 7.60

A clear, well-structured summary at 190 words that captures all adopted decisions with correct figures and dates, including the 06:20 condition, the fare exception, the unchanged monthly pass, and the reserve-fund fallback. Its main weaknesses are the dissent: Okafor's reasons are reduced to one clause and attributed to both directors. There are also a few small overstatements, such as further options 'including' rather than 'which may include' more reductions. The opening sentence is generic.

Score by criterion

Faithfulness

75

All figures and dates are correct: 2 Nov to 28 Feb, EUR 128,000, the 06:20 withdrawn only if November loading is below 40, EUR 4.60 to 5.00, EUR 2.30 to 2.50, the pass at EUR 96.00, and the reserve request with its November fallback. No rejected or deferred proposals appear as decisions. Minor imprecisions: the reason for voting against is attributed to both Okafor and Lind, though it was Okafor's recorded reason. Further options are said to include additional reductions, whereas the minutes say they 'may include' them. 'Subject to' slightly reframes the hospital-staff arrangement.

Coverage

70

Every adopted decision is covered with its figures and effective dates, including the Island Resident exception and the unchanged monthly pass. The dissent names both directors but gives only part of Okafor's reasoning. It omits that the affected riders are older residents and students without cars, that peak commuters bear none of the cost, and that the survey showed most passengers would pay higher fares to keep their sailings.

Compression

80

At 190 words it sits well within the 150-220 range and spends its words efficiently. The opening sentence is somewhat wordy for the little it says.

Clarity

80

Plain, readable language suited to residents, with each bullet self-contained. The opening sentence is vague, saying only that 'a series of decisions' was made, rather than stating the concrete outcome.

Structure

80

One opening sentence followed by exactly five bullets, grouped logically: sailings, the 06:20, fares, frozen fares and pass, then the reserve. The bullets run inline rather than on separate lines, which weakens the visual layout.

GPT-6.1 Sol 7.64

The summary captures the main timetable, fare and reserve-request decisions within the word limit, including the crucial conditional protection for the 06:20 sailing. However, it abbreviates the recorded dissent, omits some adopted actions and financial detail, and uses inline asterisks rather than a properly formatted five-bullet list.

Score by criterion

Faithfulness

80

The core figures, dates and 06:20 condition are accurate, and rejected proposals are not presented as adopted. However, the minutes attribute the recorded reasons specifically to Okafor, not jointly to Okafor and Lind. 'Including additional sailing reductions' also makes their inclusion in the November options sound certain, whereas the minutes say they may be included.

Coverage

68

Includes the withdrawals and their savings, both dissenters, the conditional 06:20 withdrawal and hospital arrangement, fare amounts and exceptions, unchanged monthly pass, and reserve request with the refusal contingency. Missing are the EUR 54,000 expected fare revenue and much of Okafor's reasoning: older residents and students without cars, the lack of burden on peak commuters, and survey support for higher fares. The agreed March report and public communication actions are also omitted.

Compression

85

At the measured 190 words, the answer comfortably meets the 150–220-word limit and concentrates on relevant decisions. The generic opening could be shortened to make room for omitted substantive details.

Clarity

80

The language is generally clear, with precise sailing times, fare amounts and conditional wording. The dense single-paragraph presentation makes the separate decisions harder to scan, and the concession exception would be clearer if stated together with the fare freeze.

Structure

60

There is one opening sentence followed by five asterisk-marked segments, but all appear inline rather than as five actual bullet points on separate lines. This does not fully satisfy the required opening-plus-five-bullets format.

Gemini 3.8 Flash 10.00

The summary is outstanding. It adheres strictly to the 150-220 word count limit, follows the exact structural requirements (one opening sentence followed by five bullet points), and accurately captures every required decision, figure, effective date, condition, and dissent reason without introducing extraneous or rejected items.

Score by criterion

Faithfulness

100

Completely faithful to the source minutes. No rejected or deferred proposals are framed as adopted, and all dates, figures, and conditional details are accurate.

Coverage

100

Covers every single required element: the sailing withdrawals with dates and savings, the dissenters and their reasoning, the contingency condition for the 06:20 sailing, all fare increases and frozen fares/passes, and the reserve fund request alongside the contingency plan if refused.

Compression

100

At 190 words, the response falls comfortably within the mandated 150-220 word range while packing in all necessary information with zero unnecessary fluff.

Clarity

100

The writing is exceptionally clear, precise, and well-tailored for island residents needing a quick, unambiguous breakdown of board decisions.

Structure

100

The formatting strictly adheres to the prompt's instructions: a single opening sentence summarizing the outcome followed by exactly five distinct bullet points.

About this genre

In this genre, the main abilities being tested are Faithfulness, Coverage, Compression.

Unlike explanation, this genre rewards preserving source meaning while compressing it, rather than expanding ideas for teaching or persuasion.

A high score here does not guarantee original analysis, recommendation quality, or the ability to reason beyond the source text.

Strong models here are useful for

meeting notes, long reports, article digestion, and source-based briefings.

This genre alone cannot tell you

whether the model can add strong judgment, generate new ideas, or argue for a recommendation.

What Is Evaluated in Summarization

Scoring criteria and weight used for this genre ranking.

Faithfulness

40.0%

This criterion is included to check Faithfulness in the answer. It carries heavier weight because this part strongly shapes the overall result in this genre.

Coverage

20.0%

This criterion is included to check Coverage in the answer. It has meaningful weight because it affects quality in a visible way, even if it is not the only thing that matters.

Compression

15.0%

This criterion is included to check Compression in the answer. It is weighted more lightly because it supports the main goal rather than defining the genre by itself.

Clarity

15.0%

This criterion is included to check Clarity in the answer. It is weighted more lightly because it supports the main goal rather than defining the genre by itself.

Structure

10.0%

This criterion is included to check Structure in the answer. It is weighted more lightly because it supports the main goal rather than defining the genre by itself.

Related Links

X f L