Main index Financial Markets index About author

Valid HTML 4.01 Transitional

Rotting of links: DMO versus BoE

Julian D. A. Wiseman

Abstract: In December 2017 both the UK DMO and the BoE rotted most incoming links. The BoE did it worse. Both could and should have websites that are more robust, with links that are effectively permanent.

twitter

Publication history: only at www.jdawiseman.com/papers/finmkts/20171231_Rotting_links_DMO_BoE.html. Usual disclaimer and copyright terms apply.

Contents: • Introduction; • The DMO; • The BoE; • Recommendations (Keep history; File structure = database; Data and link density); • Afterwords (From the DMO, Tuesday 2nd January 2018).


Introduction

In December 2017 both the Bank of England and the UK Debt Management Office rotted most incoming links. That is, pages were moved such that external deeplinks were broken. Perhaps their webmasters would describe this as a re-arrangement of the website, necessitating changes of URLs. Perhaps.

Each has done this before: the DMO in September 2006 (before, after), and the BoE on 1st March 2012 (before, after).

The Bank of England, prior to its 2012 link-rotting, had been a model internet citizen: links from the start of its website in 1996 still worked. But somebody wanted to install aspx, and didn’t care two hoots about incoming links.

Back to 2017: both the DMO’s and BoE’s link-rottings are needlessly bad, but the BoE’s is considerably worse.

The Debt Management Office

The DMO’s website was clunky. Pages such as “What’s New” would work if clicked from the main page, but not if that link were in a bookmark. Because one could not jump straight to the relevant page, a modernisation had a proper purpose. But it broke almost all incoming links.

The link www.dmo.gov.uk/publications/?offset=0&itemsPerPage=99999&startMonth=1&startYear=1990 shows all publications, sorted by date. Helpfully, nearly all file names were not changed, which was an act of mercy for me, as it was enough to allow mostly-automated substitution of old links.

Further, the DMO discarded very little of its history. Almost all files on the old website are present on the new. The few exceptions known to this author are as follows (the text is that of the pre-Dec2017 link, the link is to web.archive.org).

Out of several thousand documents, that’s not bad. (Doubtless there are others, but these are the missing pages to which there were links on my pages of conventionals and non-conventionals.)

The new website itself is mediumly good. In for a penny, in for a pound: I shall venture a few criticisms.

It has on the front page a small display, “Latest News”. For market professionals, often as not, this is the most important thing. But—inevitably there was going to be a ‘but’—not all is perfect.

The Bank of England

Until 2012 the Bank of England was a model internet citizen. But for the second time the BoE has rotted many incoming links.

Recommendations

What should be done?

Keep history

The UK DMO and the BoE are public institutions, whose pronouncements are matters of record. For aeons these will interest historians, macro-economists, and micro-economists. Do not attempt to conceal this history. All announcements and publications that have ever been online should remain so. And to them should be added more from the pre-internet age.

File structure = database

Database software enforces its own structure on everything. The BoE’s switch to Microsoft’s aspx in 2012 forced all links to look like that: mass link rot. But know that today’s database will not necessarily sit happily with tomorrow’s hardware | operating system | database licensing cost | webmaster’s preferences | seemingly random orders from a boss. It just won’t.

Understand that the DMO and the BoE are not Amazon, nor British Airways, nor Sainsbury’s. Large companies selling to consumers want to change their prices many times a day. They want to experiment with presentations and offers, showing different things to different customers to discover what works at this moment. Millions of differently constructed pages might be shown each day, the software recording the pages shown to whom and when, and what action the customer took. All of which requires a powerful database.

That is not the DMO, nor the BoE. Entities producing fixed documents of record, which will be of interest in a century, need to be more robust by being more primitive.

There is no need for database software: the file structure can do that. Files should be static, and each file’s URL should be its directory path (prefixed by the domain name). I.e., the file structure is the ‘database’, and the ‘database’ is the file structure. That allows links to resemble www.bankofengland.co.uk/2017/12/MPC/20171214_minutes.pdf, and ….html. Each directory should have a simple index.html page, pointing to each file in that directory and to the index.html page in each sub-directory (these pages could be made by a script, but once generated would then be static files).

This simplicity has multiple benefits.

There will be some pages, such as those providing economic time series, for which a database might be better. If there are only a few possible outputs (such as static details of all gilts issued since 1945), then these can be fixed pre-generated files in which a few tens of kilobytes contain all the data, tab-separated. But the BoE has very many economic time series, with too many updates for this, so the whole website cannot be robust to database misery. But much of it can, even most. Indeed, much of it should, even most.

Data and link density

Webmasters should know the childishness of the target audience. If that audience comprises academics and market professionals, then favour data density and link density over anything that is content-free. If something looks like vacuous fluff, if your audience might perceive it to be obstructive content-free decoration, delete it. If you can’t bring yourself to delete it, shrink it, and then delete it. Yes yes, branding—sigh!—keep it small, so small that it is unobstructive even on a very small screen. A company that is all branding is all branding and that can’t be dodged, but the public sector should prioritise function over adornment.

Rephrased, decide whether you hate your target audience, and act fully on that decision.

— Julian D. A. Wiseman
London, 31st December 2017
www.jdawiseman.com


Afterwords

From the DMO, Tuesday 2nd January 2018

On Tuesday 2nd January, the first business day after this essay was published (impressive responsiveness), the DMO replied. The following gathers extracts from the reply and subsequent correspondence.

I have had a looked through your ‘rotten links’ page and would like thank you for pointing out that some of the links have indeed been lost. This was not the plan when migrating to the new website and so I have asked for the documents to be added in ASAP.

I would like to point out however, that of the 7 documents listed within ‘The Debt Management Office’ section, 4 of the documents can actually be found on the website. For ease, I provide the new links … [1, 2, 3, 4]

The web team have confirmed that the other documents have been published and the links are below. [ 6, 7, 8 ]

Thank you for adding the missing documents, and so quickly.

Comment on making links more robust by being database-free would be welcome; as would comment on the user-interface matters.


Main index Top About author