Free Our Data: the blog

A Guardian Technology campaign for free public access to data about the UK and its citizens


Archive for July, 2009

..but we’re just as quick: more questions re the international man (or woman) of mystery

Friday, July 31st, 2009

We’ve taken on Nicholas Verge’s suggestion and sent another FOI request to OS about the international expert.

So once more unto the breach:

Dear Sir or Madam,

Thank you for your previous reply re the international expert who reviewed OS’s internal study on International Funding Models.

I note that the person does not wish to be named. I would like to request further details about the person, none of which I believe will require their identity to be revealed:

1) is the “internationally recognised expert (a) British or (b) a foreign national?

2) Is he or she a (a) currently employed in a UK academic institution, or (b) employed in the UK, or (c) employed in a UK government department, or (d) a UK government agency or trading fund.

3) If so, which institution, business/fund or arm of Government?

4) Has the person retired from any of those listed in (2)?

5) Has the person ever been employed by the Ordnance Survey and if so on what basis (eg full-time, continuous part-time, etc)?

5) Has the person ever been employed by a foreign National Mapping Association, and if so on what basis (eg full-time, continuous part-time, etc)?

Editing error: there are two questions 5. Let’s hope this doesn’t somehow invalidate the whole thing…

(I’m considering setting up a separate category for the IM/WOM. Any thoughts?)

Update: and just for completeness, we have asked Ed Parsons – formerly of OS, now of Google – whether he is the IM/WOM.

He responds, emphatically, that he is not. One less person…

Well, that was quick: OS responds to FOI re international expert; mystery deepens (if that’s possible)

Friday, July 31st, 2009

Following yesterday’s – yesterday’s! – questions to the Ordnance Survey about the identity of the international expert, we’ve had a response.

Here it is (emphasis added):

Thank you for your email dated 30 July 2009 requesting: the following information regarding the internationally recognised expert in Geographical Information and National Mapping, which I believe does not identify them personally.

We are pleased to provide you with the following information with regard to your request.

1) Does the “internationally recognised expert” work in a full-time or continuous part-time capacity for Ordnance Survey? – No.

2) If the answer to (1) is no, was the person formally commissioned on a contract basis by OS to review its study? – No.

3) If the answer to (1) and (2) is no, on what remunerative basis did the person review the study? – None.

So the international expert isn’t employed on any basis by OS, and reviewed the study for free.

Now I’m really fascinated. Who is this person? Why would they review this study for nothing? (Remember, we’ve ruled out Steven Feldman, Max Craglia and Robin McLaren.

Remember the definition: an “internationally recognised expert in Geographical Information and National Mapping”. More candidates, please. Or suggestions on how we can narrow their identity down further – while noting that they don’t want to be identified.

OS publishes almost unredacted version of international study

Sunday, July 26th, 2009

The OS has at last, in response to my FOI request (thank you whatdotheyknow.com) published an almost unredacted version of its international study, fully known as ” International Comparison of Geographical Information Trading Models – Study report”.

You can download it from the OS’s page about it, which contains the interesting addition (or is it that we only just noticed it?) that this is a study “which was commissioned by the Parliamentary Under Secretary of State for Communities and Local Government, Iain Wright MP, and formed one input to the Trading Funds Assessment undertaken by the Shareholder Executive and HM Treasury.”

Mm.

Anyhow, your opinions on what the study tells us – and especially whether it actually does manage to confirm any of the things that it was trying to confirm – are extremely welcome. Comments as ever are open.

That international consultant and man of mystery is… (updated)

Thursday, July 23rd, 2009

…is still a mystery. Ordnance Survey today responded at 18.18 BST (by my computer’s timestamp) to my request for the name of the international consultant who looked over the OS’s study justifying its own findings.

And the outcome:

I can confirm that Ordnance Survey does hold this information

I suppose it might have been done by anonymous peer review, but it’s unlikely..

however I regret to inform you that your request falls within the ‘Personal information’ exemption under section 40 (2) (a) of the Freedom of Information Act 2000 (FOIA). We believe this exemption applies because having contacted the person concerned Ordnance Survey has been requested to withhold their name in this instance, therefore we will not be releasing this information to you.

This person is turning in to some kind of remarkable beast. Let’s just remind ourselves of what we wanted to know: who is it that OS described as an “internationally recognised expert in geographical information and national mapping” who OS said had reviewed its study into how it should organise and charge for its service, and who “agreed with the analysis and conclusions”.

And now this person turns out to be such a shrinking violet that they don’t want to have their names in the papers and on the web?

This “internationally recognised expert” doesn’t want to be named? Doesn’t want to be named on a strategic study into one of the most important mapping agencies in the world?

This is, quite frankly, ridiculous.

We will now begin making representations to the minister ostensibly in charge of OS, Iain Wright.

And we haven’t even looked at the latest version of the study itself that arrived by email. Wonder what non-gems are buried in that.

Meanwhile, the search for Spartacus goes on…

Update: First: OS points out that since a recent reshuffle, Iain Wright is no longer the minister responsible; it’s now Ian Austin.

Second: following comments, I have put the question directly to Robin McLaren of Know Edge (mentioned in the comments below as a possible International Consultant and Man of Mystery). His reply, besides that in the comments below where he says Know Edge was not retained, is:

No, I have not been involved in the creation or review of the Ordnance Survey study. Like you, I am mystified as to who this ‘International Consultant’ may be.

Interesting: ’severable improvements’ and derived data and Ordnance Survey

Wednesday, July 22nd, 2009

An interesting blogpost by cloudsourced about “Why OpenSpaces and GeoVation Vexes Me So“, talking about the key question – generally – about trying to build stuff using the Ordnance Survey’s OpenSpace API: why does OS want to demand that what you build with it becomes OS’s property?

Derived Data. The single most stifling element of the Ordnance Survey’s licensing regime is the practice of claiming copyright over any data derived from an OS base map. This has massive implications to anyone in a public sector body, or anyone who wishes to use their data. Any geographical data created by a public sector body (who almost exclusively use OS data) is not their’s to do what they like with, it is claimed by the Ordnance Survey under their copyright. Local authorities cannot share the location of its rubbish bins with the public, does this sound absurd to anybody else? Derived Data stops dead any effective sharing of public geographic data, and any innovation that would come from it.

This is a topic we’ve gone over and over. Interestingly, cloudsourced links to the terms & conditions of the OpenSpace API, which goes like this in section 5.4 on Derived Data:

5.4.1 You may create Derived Data, and You may permit End User’s to create Derived Data, in connection with Your Web Application. In the event that You or any End User creates Derived Data, such Derived Data shall be owned by Us

Flipping heck! Same old rubbish. But hang on, what’s this?

save that if any Derived Data is created which is a severable improvement (as defined by Commission Regulation (EC) No 772/2004, known as the Technology Transfer Block Exemption) of the Ordnance Survey Data then such Derived Data shall be owned by the person or entity creating the same.

Now the “severable improvement” bit caught my attention suddenly. Never noticed that before. But what is a “severable improvement”? It’s explained a little by crschmidt, who links to a discussion on the OpenStreetMap mailing list, where Richard Fairhurst describes it as

In practice, then, I read that to mean that if you use the Sustrans webmapping to find out where the routes go, this information is solely copyright Sustrans (who might be more willing to give permission) and not OS, even though it’s delivered through the medium of a derived work. So, if you had the wiggly lines already (whether mapped by GPS or NPE), you could tag them as NCN routes if Sustrans were ok with that.

My reading: if you’ve got something that didn’t come from OS, and which you can stick onto one of its maps wholesale, and remove wholesale, then it’s not – and cannot be – claimed as derived data by OS. But that doesn’t help if you don’t have it in some separate form; if you use OS as a base, then it’s derived data.

As Ed Parsons (formerly OS, now Google) points out in the comments

There is a relatively simple way to define derived information, and that is to ask what is not… If i create a new feature that is not represented as a feature on the original map/dataset it cannot be derived from it. If the OS would just agree with this it world more things forward.. but then we have been asking for this for years… At some point you have to move beyond cock-up territory to conspiracy…

We like Ed’s definition. It makes sense. I wonder quite what the effect on OS would be of adopting that definition. How sizeable a reduction in licence fees?

Sounds like fun: Society of Cartographers summer school

Monday, July 13th, 2009

(A public service announcement for our cartographic readers.)

Booking is now open for the Society of Cartographers Summer School at the University of Southampton from 7-9th Sept 2009.

If you want to:

  • hear the Director General of the Ordnance Survey talking about the future of the National Mapping Agency
  • hear about the new UKMap large scale map database
  • take part in a workshop on Google mashing, OS OpenSpace or OpenLayers
  • keep up to date on crowdsourcing
  • see how people are using OpenStreetMap data in the real world
  • hear the latest ideas on emergency mapping, transport mapping, 3d mapping and wayfinding
  • network with your peers and leaders in developments in cartography

then check out the programme at:
http://www.soc.org.uk/southampton09/program.htm
and register at: http://www.soc.org.uk/southampton09/index.htm

Naughty, very naughty: Ernest Marples frees the postcodes

Saturday, July 11th, 2009

An interesting new site – ernestmarples.com/ – is trying to make postcodes free.

The people behind it (the whois details tell you that it’s registered to a location in SW1A 1AA, which happens to be Buckingham Palace) are Harry Metcalfe and Richard Pope.

They insist, when asked the question of “where does the data come from?” that

We’re not saying. But, just to be clear: we don’t hold a copy of the postcode database ourselves, neither in complete form nor as part of a cache.

But their aim is clear enough:

Post codes are really useful, but the powers that be keep them closed unless you have loads of money to pay for them. Which makes it hard to build useful websites (and that makes Ernest sad).

So we are setting them free and using them to run PlanningAlerts.com and Jobcentre Pro Plus. We’re doing the same as everyone’s being doing for years, but just being open about it.

Hopefully the Government and Royal Mail will realise the value of this service and license us to offer it officially and for free. If not, and this website gets shut down, we’ll close the websites we’ve made that make use of this site’s lookup service. Permanently.

There’s a long list of people who have supported it. We’ll add our voice. The Free Our Data campaign thinks it’s a good idea to make postcodes freely available.

OS expert isn’t Max Craglia either… so who is it?

Friday, July 10th, 2009

You’ll recall the famous scene in the film Spartacus (directed of course by the same man who went on to direct 2001: A Space Odyssey) in which the Roman troops have captured the rebel slaves, and are trying to find out which of them is Spartacus, their leader.

At which one man stands up and says “I’m Spartacus!” And another, and another…

Well, the search for the identity of Ordnance Survey’s “internationally recognised expert” who looked over its calculations for its international comparison of mapping agency funding models is like that. Only in reverse. “I’m not Spartacus!” seems to be what people are saying.

In response to a suggestion in the comments that the person in question might be Dr Max Craglia, of the Joint Research Centre of the European Commission, a specialist in geographic information policies. So we sent off a quick email to him, asking if he was the one. (Don’t know who he is? main profile, another profile.)

“I regret I am not the expert you are looking for,” he responded, sounding more like Obi Wan Kenobi in Star Wars than Spartacus.

We’ve noted this in a roundup of what also happened at the Activate 09 summit, organised by the Guardian and part-sponsored by Ordnance Survey.

Among the other issues there were whether OS’s maps are fit for 21st-century digital economy purpose (Tom Watson MP, formerly of the Cabinet Office, thinks not) and also whether National Rail – the company owned by the train operating companies, rather than the nationalised success to Network Rail – should make its train running times available for free. Since it’s private-sector data, it doesn’t fall under the FOD campaign’s “government-owned or -generated non-personal data” umbrella.

Then again, the reaction on Twitter also suggests that with so many government billions being poured into the private rail sector, it would make sense to demand the data for free as a quid pro quo. It’s an argument that does have merits.

So in the meantime does anyone have any more (realistic) suggestions for who OS’s Spartacus is?