Automated Quality Assessment
Council Bill Summary Evaluations
Rubric-based scoring by Claude — completeness & faithfulness per dimension
Evaluation Dimensions
- Headline Accuracy
- Does the headline faithfully represent the bill’s core change?
- Proposed Intent
- Does “What Was Originally Proposed” reflect the introduced text?
- Final Text Fidelity
- Does “What The Final Text Does” match the enacted/amended language?
- Amendment Accuracy
- Are amendments and votes described accurately and completely?
- Accessibility
- Is language plain enough for a non-lawyer Seattle resident?
- Neutrality
- Is the summary free of editorial framing or political spin?
Each dimension is scored 1–5 for completeness (nothing important omitted) and faithfulness (nothing stated that isn’t in the source). Percentages shown in the summary row are averages across all six dimensions, converted to a 0–100% scale.
CB 121207 Seattle Establishes Forensic Digital Evidence Pay Scales for Police Department 83% 100%
The headline accurately captures the main subject (Forensic Digital Evidence classification and pay scales in Seattle Police Department). It's concise and faithful to the source. Minor completeness issue: doesn't explicitly mention the employment context, though this is implied.
The summary correctly identifies the main intent: establishing a new classification series with new titles and pay rates effective December 31, 2024. The information is accurate and supported by the source metadata. No significant omissions or hallucinations detected.
The summary accurately describes the FDE classification series with four job titles and five-step salary progressions. However, it lacks specific details about what the titles are, how many were created versus renamed (the source says 'two new' and 'two renamed'), and the actual pay amounts, which would provide fuller context of what the final text does.
The summary correctly and repeatedly states that no amendments were proposed (matching the source metadata stating 'Amendments: 0'). The statement is clear, accurate, and appropriately emphasized throughout the document.
The summary uses accessible language and is well-organized with clear sections. The explanation of job classifications and pay scales is understandable to a general audience. The structure with headings and bullet points aids comprehension, though some specific title names or salary details would have enhanced clarity.
The summary maintains neutral tone throughout, presenting facts without editorial comment or political bias. The language is objective and straightforward, appropriately describing administrative/employment matters without advocacy.
CB 121233 Emergency Ordinance Authorizing Street Closures for Public Safety (SMC 11.16.125) 93% 97%
The headline accurately captures the core purpose of the ordinance—emergency authorization for street closures related to public safety and the specific SMC section amended. All essential elements from the source are represented.
The summary clearly explains that the ordinance grants the Director of Transportation authority to close public streets (expanding from alleys only) for public safety reasons, and mentions the context of violence in the North Aurora area. However, the source text itself provides minimal detail on the original intent or context—the summary infers the motivation from the title, which is reasonable but represents some extrapolation beyond what the source explicitly states about the proposal's origins.
The summary accurately describes what the final ordinance does: expands the Director of Transportation's authority from closing only alleys to closing public streets for public safety purposes, and notes the emergency effective date and 3/4 vote requirement. All material elements from the source are captured.
The summary correctly notes that there were 0 amendments to this legislation, as stated in the source text. This information is accurately and completely conveyed.
The summary is written in clear, plain language that a general reader can easily understand. Technical terms (like 'SMC 11.16.125') are preserved for specificity but the overall explanation of what the ordinance does is accessible and well-organized into logical sections.
The summary maintains a largely neutral tone in describing what the ordinance does and its vote history. However, the phrase 'where residents had already begun blocking streets themselves to increase safety' in the proposed intent section contains a subtle interpretive framing that goes slightly beyond what the source text explicitly states, introducing some narrative context that could be seen as adding editorial perspective.
CB 121239 Ordinance Appropriating Funds for Claims (June 15–19, 2026) and Ratifying Prior Acts 100% 100%
The headline accurately captures the core content of the ordinance: appropriating funds for claims during a specific week and ratifying prior acts. All essential elements are represented.
The summary accurately presents the original proposal as stated in the source text, with specific dollar amounts ($51 million for claims, $73.8 million for payroll) and time periods clearly identified.
The final text section accurately describes what the ordinance authorizes, including specific appropriations and fund sources, with precise dollar amounts matching the source material.
The summary correctly states that no amendments have been proposed, consistent with the source indicating 0 amendments. The information is complete and accurate.
The summary is well-organized with clear headings, plain-language explanations, and specific details presented in an easy-to-understand format. Vote records are clearly itemized, enhancing accessibility.
The summary maintains a neutral, factual tone throughout, presenting only information contained in the source without editorializing or inserting subjective commentary.
CB 121241 City Light Power Acquisition Authority and Municipal Code Amendment 83% 97%
The headline accurately captures the main substance of the ordinance (City Light power acquisition authority and Municipal Code amendment). It is faithful to the source and identifies the key action, though it could be slightly more specific about the 'long-term agreements' aspect.
The summary captures the core intent: authorizing long-term power purchase agreements to meet rising electricity demand from decarbonization, EVs, and data centers. However, the source text itself is minimal on the underlying motivations; the summary appears to infer some context that may go beyond what is explicitly stated in the ordinance title.
The summary accurately describes the amendment to the Municipal Code, the authorization for long-term agreements, the 240-month term limit, and the intended applications (electricity, transmission, ancillary services). The source text is brief, and the summary faithfully represents what is stated without adding unsupported claims.
The source explicitly states '0 Amendments,' and the summary correctly reports no amendments have been proposed and the text remains unchanged. This is completely accurate and comprehensive.
The summary is written in accessible plain language and clearly explains the ordinance's purpose, vote history, and what the final text does. The use of headers and structured sections enhances readability, though adding a very brief one-sentence elevator pitch at the top could improve accessibility further.
The summary maintains a neutral tone throughout and presents factual information without advocacy or editorial commentary. Phrases like 'aims to remain competitive' and 'ensure a stable supply' are descriptive of the policy goals rather than promotional, appropriately neutral language.
CB 121243 Temporary Zoning Amendments to Streamline Housing Design Review Processes 87% 100%
The headline accurately captures the core purpose of streamlining housing design review processes with temporary zoning amendments. It faithfully reflects the source without overstatement, though it could be slightly more specific about the affordability component.
The proposed intent section accurately and completely describes the bill's dual approach: exempting affordable housing from Design Review and allowing voluntary administrative review for other housing. It faithfully represents the source text without adding unsupported claims.
The final text section accurately describes the six-month temporary nature and the two main mechanisms (exemption for on-site affordable units and optional administrative review). However, it slightly oversimplifies by characterizing this as 'suspends mandatory design review' when the source is more precise about which projects are affected.
The summary correctly reports that no amendments have been proposed (per source: 'Amendments: 0'), matching the source text precisely.
The summary uses plain language effectively to explain complex zoning concepts. It could be slightly more explicit about what 'Mandatory Housing Affordability' and 'on-site performance units' mean for a general audience, but is otherwise well-structured and accessible.
The summary maintains a neutral tone overall. The phrase 'accelerate the production of affordable housing' at the end of the final text section, while not strictly inaccurate, adds implied purpose that goes slightly beyond what the source explicitly states.
Evaluations generated by the Claude Haiku 4.5 model.