Toronto's Digital Archives Struggle With Thousands of Duplicate Photos

Toronto's municipal digital image library contains tens of thousands of duplicate photographs, the same streetcar on Queen Street West filed under three different department codes, the same Scarborough construction site catalogued twice by separate procurement teams, the same stock headshot of a city planner archived in four unconnected servers. The City of Toronto's Information and Technology Division flagged the redundancy problem formally in 2024, but the conditions that created it stretch back to at least 2011, when the city launched its first large-scale digitization push without a unified metadata standard.

The issue matters right now because Toronto is mid-way through an ambitious open-data expansion tied to the 2023-2026 Digital Infrastructure Modernization Plan, which earmarks funds for public-facing portals on everything from Eglinton Crosstown construction progress to affordable housing unit counts across the former inner suburbs. Duplicate images don't just waste storage, they corrode search results, slow down Freedom of Information responses, and force staff to manually verify whether two files showing, say, the same stretch of Finch Avenue West are genuinely different records or clerical echoes of each other.

A Decade of Siloed Systems

The root cause is structural. After amalgamation in 1998, Toronto inherited the IT architectures of six former municipalities, Etobicoke, North York, Scarborough, York, East York, and the old City of Toronto, each with its own filing conventions. Departments never fully merged those conventions. By 2015, the city's Planning Division, Toronto Water, and the Economic Development and Culture office were each maintaining separate digital asset management systems with no automatic cross-referencing.

The Toronto Public Library's digitization program, which has scanned more than 700,000 historical images through its Toronto Reference Library branch on Yonge Street at Asquith Avenue, developed its own cataloguing vocabulary that didn't map cleanly onto city hall's internal taxonomy. When departments pulled archival images for reports or web content, duplicates migrated across platforms. The problem compounded every time a new content management system was procured, a cycle that happened at least three times between 2010 and 2022 across various divisions.

A 2023 audit of the city's open-data holdings, conducted by the City Clerk's Office, found that image deduplication had never been mandated as part of any digitization contract. Vendors were paid to ingest and index files, not to reconcile them against existing holdings. That audit has not been made fully public, but references to its findings appear in the agenda documents from the September 2023 meeting of the City's Technology Steering Committee, available through the city's online council records.

What the Fix Looks Like, and Who Pays for It

Toronto is now piloting a deduplication software tool across three divisions: City Planning, Parks Forestry and Recreation, and Toronto Buildings. The pilot, which began in February 2026, uses perceptual hashing, a technique that identifies visually similar images even when file names and metadata differ, to flag likely duplicates for human review. The Technology Steering Committee approved an initial allocation for the pilot, though the full remediation budget across all divisions has not yet been tabled at council.

The practical consequences of inaction are visible at the ground level. Staff at the Scarborough Civic Centre on Borough Drive have described spending significant time manually sorting image folders before preparing public consultation materials for development applications, time that could otherwise go toward processing a backlog of planning files that has grown considerably as the city targets 285,000 new housing units over the next decade under its Housing Action Plan.

City councillors on the Infrastructure and Environment Committee are expected to receive a progress report on the deduplication pilot in September 2026. If the tool performs as projected, a phased rollout across all 16 city divisions could begin before the end of the year, with a target completion date sometime in 2027. For residents who rely on the city's open-data portals, whether tracking transit construction near Eglinton and Mount Pleasant or searching archival neighbourhood photos through the Toronto Archives on Spadina Avenue, a cleaner image library means faster, more reliable results. The messy back-end work, largely invisible to the public, is what makes the front-end promise of open government actually function.