Automated Quality Assessment
Council Bill Summary Evaluations
Rubric-based scoring by Claude — completeness & faithfulness per dimension
Evaluation Dimensions
- Headline Accuracy
- Does the headline faithfully represent the bill’s core change?
- Proposed Intent
- Does “What Was Originally Proposed” reflect the introduced text?
- Final Text Fidelity
- Does “What The Final Text Does” match the enacted/amended language?
- Amendment Accuracy
- Are amendments and votes described accurately and completely?
- Accessibility
- Is language plain enough for a non-lawyer Seattle resident?
- Neutrality
- Is the summary free of editorial framing or political spin?
Each dimension is scored 1–5 for completeness (nothing important omitted) and faithfulness (nothing stated that isn’t in the source). Percentages shown in the summary row are averages across all six dimensions, converted to a 0–100% scale.
CB 121173 Seattle Updates Land Use and Zoning Ordinance 63% 70%
The headline is accurate and faithful to the source text, which is about updating land use and zoning ordinance. However, it is quite generic and does not capture the specific scope or intent of the changes listed in the source.
The summary makes specific claims about the One Seattle Plan, housing density near transit, racial equity focus, and housing affordability crisis that are NOT present in the provided source text. The source only lists amendments and page numbers with no discussion of intent, so the summary appears to have hallucinated these details rather than deriving them from the source.
The summary claims the bill focuses on housing, transit, displacement prevention, and equity—none of which are mentioned in the source text. The source provides only a title and list of amended sections; the summary invents substantive policy goals without source support.
The summary correctly states that no amendments have been proposed and no votes have been recorded, which matches the source metadata (Amendments: 0, Votes: 0).
The summary uses clear plain language and is structured logically, but it provides no actual substantive information about what the bill does because the source text is largely unavailable. The accessibility is hampered by the fact that the summary invents content rather than explaining the actual bill.
The summary maintains a neutral tone and does not editorialize on the merits or drawbacks of the legislation. However, the invented content about racial equity and housing affordability is presented as factual, which could be seen as non-neutral framing if those were not the actual bill's intent.
CB 121177 Seattle Approves Skagit River Hydroelectric Project Relicensing Agreements 90% 100%
The headline accurately captures the core subject matter - Seattle approving relicensing agreements for the Skagit River Hydroelectric Project. It is concise and directly reflects what the ordinance authorizes without omission or overstatement.
The summary correctly captures the main intent (authorizing the Mayor to execute agreements for FERC relicensing) and mentions the settlement agreement and five Off-License Agreements. However, it adds details about stakeholder involvement and negotiation duration not explicitly stated in the source title/ordinance description, though these may be inferred context.
The summary accurately describes what the final text does - authorizing execution of the Comprehensive Settlement Agreement and five Off-License Agreements, and ratifying prior acts. It includes relevant stakeholder entities mentioned and the purpose of obtaining a new long-term license, though the source provides limited detail on these specifics.
The summary correctly states that there are no amendments (0 amendments noted in source) and no votes recorded, matching the source metadata exactly.
The summary uses plain language and explains the purpose of the agreements (balancing tribal interests, environmental protection, community needs), making it accessible to general readers. It could slightly improve by briefly defining FERC or explaining what relicensing means, but overall remains clear and understandable.
The summary maintains a neutral, factual tone throughout without advocating for or against the legislation. It presents the subject matter objectively without loaded language or bias.
CB 121179 Seattle Ordinance Limits Police Surveillance Data Collection 67% 87%
The headline accurately captures the core of the bill—a limitation on police surveillance data collection through a mandatory pause. It is faithful to the source and covers the main subject matter, though it could be slightly more specific about the 60-day pause.
The summary identifies the 60-day pause and mentions privacy concerns around reproductive health and gender-affirming care, which are important stated purposes. However, the source text does not explicitly detail the specific intended protections for refugees, immigrants, or the full scope of sensitive activities mentioned in the summary.
The summary describes general intent but lacks critical details about what the final text actually specifies—particularly the specific conditions that trigger the mandatory pause and the detailed mechanics of how the pause operates. The source indicates amendments to Ordinances 127044 and 127297, but the summary does not explain what those prior ordinances contained or what the specific amendments entail.
The summary correctly notes that there are 0 amendments, which matches the source text metadata indicating 'Amendments: 0'. This section is complete and accurate.
The language is generally plain and accessible, using clear terminology and explaining what CCTV and ALPR systems are. However, the summary lacks specific operational details (e.g., what conditions trigger the pause, how it is implemented) that would help readers fully understand the practical implications.
The summary maintains a mostly neutral tone but phrases like 'promote a safe and supportive environment' and the framing around protecting sensitive activities could be perceived as subtly sympathetic language rather than purely descriptive. The source text itself may contain such language, but the presentation leans toward emphasizing the protective intent without balancing counterarguments.
CB 121180 Seattle Updates Immigration Status Inquiry Policy 77% 93%
The headline accurately captures the bill's focus on updating immigration status inquiry policy. It is faithful to the source material and appropriately neutral, though it could be slightly more specific about the alignment with state law.
The summary correctly identifies the intent to amend SMC and align with state law, and mentions the Keep Washington Working Act. However, it lacks specificity about what the actual changes are—the source title only indicates the requirements are being changed to align, but the summary doesn't clearly explain what the old restrictions were or what the new ones become.
The summary describes the bill's intent but provides minimal detail about what the final text actually does. It notes that Section 4.18.015 is amended but does not explain the substantive changes in the actual ordinance language, which is a significant omission for a summary of final legislative text.
The summary correctly notes that there are zero amendments (as stated in the source metadata), providing accurate information about the legislative process.
The summary is written in plain language and is generally accessible to a non-expert reader. It avoids excessive jargon and explains the basic purpose of the ordinance, though it could be more concrete about the specific policy changes.
The summary maintains a neutral tone throughout, presenting the bill's purpose and provisions without advocating for or against the legislation or inserting subjective commentary.
CB 121181 "City Seeks Tax Increase for Library Upgrades" 80% 90%
The headline accurately captures the essence of the ordinance—a tax increase for library upgrades. It's concise and faithful to the source. However, it could be slightly more specific about the ballot measure nature (August 2026 election submission).
The 'What Was Originally Proposed' section comprehensively and accurately covers all key elements from the title: the seven-year levy, the state limitation exception, library operating hours, collections, technology, programming, maintenance, access expansion, and seismic retrofit. Nothing important is omitted and nothing is unsupported.
The 'What the Final Text Does' section introduces '$410 million' and specific revenue dates (2027-2033) with detailed financial projections and homeowner costs that are NOT present in the source text provided. This is hallucination. The source text does not specify a dollar amount or annual cost details.
The summary correctly states no amendments have been proposed (Amendments: 0) and accurately reports that no votes have been recorded (Votes: 0), which matches the source document exactly.
The summary is written in clear, plain language and uses a logical structure with headers that help readers navigate the information. The only minor gap is that the summary could have been clearer that this requires voter approval at the August 4, 2026 election, though this is implied.
The language is largely neutral and factual throughout. The headline 'City Seeks Tax Increase' is straightforward without loaded language, and the body text presents the proposal objectively. The summary avoids advocacy or opinion statements.
CB 121182 Ordinance Approves Claims Payment for March 9-13, 2026 73% 87%
The headline accurately captures the core subject matter—an ordinance approving claims payment for a specific week in March 2026. It is faithful to the source and appropriately concise, though it could have been slightly more specific about the nature of claims (salaries/payroll).
The summary mentions the bill proposed appropriating money for claims and includes numerical figures ($146M in various categories, $73M in payroll), but the source text does not contain these specific dollar amounts or categorical breakdowns—these appear to be inferred or fabricated details. The core intent (appropriating money for claims) is faithful but the supporting details lack sourcing.
The summary provides specific payment amounts ($19.9M for mechanical warrants, $106,423 for e-payables, $56.9M for electronic transactions, $73.8M in gross payrolls) and references RCW 42.24.180, none of which appear in the source text. While the general concept of authorizing claim and salary payments is correct, the specific financial figures are not supported by the provided source material.
The summary correctly states that no amendments have been proposed, which matches the source text showing '0' amendments. This section is accurate and complete.
The summary uses clear, plain language appropriate for a general audience and is well-organized into logical sections. The language is accessible, though the inclusion of unsourced financial figures may create confusion about what information is actually in the bill.
The summary maintains a neutral, factual tone throughout, without editorial commentary or political language. The presentation is objective in describing what the ordinance does.
CB 121183 City Sells Surplus Property to Snohomish County 83% 93%
The headline accurately and concisely captures the main action of the ordinance: a city property sale to Snohomish County. It directly reflects the source text's core purpose without omission or hallucination.
The summary accurately conveys the bill's intent to sell surplus City Light property to Snohomish County for road purposes with a reserved easement. However, it adds specific details (43rd Avenue SE location, $452,216 fair market value) not found in the source title or stated amendments/votes section, making it difficult to verify completeness from the available source text.
The 'WHAT THE FINAL TEXT DOES' section mirrors the proposed intent section with the same added details (location, amount, purpose). While these details may be in the full bill text, they cannot be verified against the provided source information, raising concerns about potential hallucination.
The summary correctly states that there are 0 amendments proposed, which directly matches the source metadata showing 'Amendments: 0'. This is handled accurately and completely.
The summary uses clear, plain language appropriate for non-specialist readers and is well-organized with logical sections. The terminology is accessible, though reliance on specific details not verified in the source text slightly limits the dimension.
The summary maintains neutral language throughout, avoiding partisan framing or emotional language. It presents the legislative action and its consequences in factual, objective terms without bias.
CB 121184 Seattle Expands Lease Authority for Encampments 77% 87%
The headline accurately captures the main subject matter of expanding lease authority for encampments and is directly supported by the bill's title. While it could be slightly more specific about the Director's role, it effectively conveys the essential content.
The summary correctly identifies the core intent: expanding the Director's authority to execute leases for transitional encampment purposes and amending Section 3.127.020. However, the source text provided does not explicitly detail what rental payment limits and square footage restrictions exist, so that level of detail goes slightly beyond what can be verified from the source.
The summary correctly states the bill's core function (expanding Director authority for transitional encampments and amending Section 3.127.020), but introduces claims about supporting '1,000 new shelter and emergency housing beds by 2026' and 'accelerating creation of new shelter units' that are not present in the provided source text. This represents significant content not supported by the source material.
The summary accurately reports that there were 0 amendments, which matches the source metadata stating 'Amendments: 0.' This information is complete and faithful.
The summary uses plain language and is well-organized with clear sections. A general reader could understand that the bill expands lease authority for encampments, though some details about the specific code section could be explained more simply.
While mostly neutral in tone, the summary introduces framing about the city's goal to open 1,000 new shelter beds and addressing homelessness that is not present in the source text. This added context, even if well-intentioned, goes beyond the neutral recitation of what the bill actually contains and adds interpretive framing not supported by the source.
CB 121185 City Council Addresses Homelessness in Budget Update 70% 83%
The headline accurately captures the bill's core subject matter (homelessness response via budget update) and is appropriately neutral. It is faithful to the source text, though it could be slightly more specific about the budget amendment nature.
The summary claims specific dollar amounts ($8.2M total, broken down as $1.59M, $3.32M, $3.32M) that cannot be verified against the provided source text. The source only lists 'changing appropriations' without providing numerical details, so this represents added information not found in the source.
The summary provides extensive specific details about the bill's provisions (1,000 beds, $17.55M total, $9M start-up, $8.5M ongoing, 500 units by June 1) that are not present in the provided source text. While these may be accurate from the full bill text, they cannot be verified against the limited source information provided.
The summary correctly and clearly states that no amendments have been proposed, which matches the source text indicating 'Amendments: 0' and appropriately explains the lack of voting activity.
The summary uses clear, plain language with helpful section headers and explanations. It is well-organized and accessible to general readers, though some specific budget figures lack supporting context.
The summary maintains a neutral tone throughout, presenting information as fact without editorial commentary or advocacy. Language choices remain objective and appropriate.
CB 121186 Ordinance Approves Payment of Claims for March 16-20, 2026 80% 87%
The headline accurately and faithfully captures the bill's core purpose: appropriating money to pay claims for a specific week in March 2026. It is concise and directly reflects what the source text describes.
The summary provides specific dollar amounts ($96,945,015.81) and categorizes payment types, but the source text only states 'certain claims' without providing these details. The summary appears to add information not present in the source title, making it impossible to verify completeness against the limited source provided.
The summary includes detailed breakdowns of payment amounts ($96,899,915.81 total with specific allocations) that cannot be verified from the source text provided, which only contains the title and metadata. This raises concerns about whether the information is hallucinated or drawn from unavailable full text.
The summary correctly states that no amendments have been proposed, which is consistent with the source metadata indicating 'Amendments: 0'. This section is accurate and complete.
The summary is written in clear, plain language suitable for a general audience. It uses straightforward explanations and organizes information logically with clear sections, making it highly accessible.
The summary maintains a neutral, factual tone throughout, presenting the bill's provisions without advocacy, opinion, or emotional language. It simply describes what the ordinance does.
Evaluations generated by the Claude Haiku 4.5 model.