A quick roundup to start the new year
Hope you’ve all come through the new year without suffering too many leap-last-year problems. I thought it would be interesting to round up a few things that I’ve seen but not really had enough brainpower to turn into anything more than notes.
First, Public Data Sets stored on Amazon Web Services. (Via Richard Allan.) An interesting idea: got public datasets? Well, why not get them stored somewhere really cheap where people can access them but you only pay per download. It’s the ultimate outsourcing, and you also get to see how many people are downloading it without the capital costs of the servers.
Public Data Sets on AWS provides a centralized repository of public data sets that can be seamlessly integrated into AWS cloud-based applications. AWS is hosting the public data sets at no charge for the community, and like all AWS services, users pay only for the compute and storage they use for their own applications. An initial list of data sets is already available, and more will be added soon.
It’s already got the Human Genome and the US Census data. The idea of hosting UK public datasets on AWS was floated in the Cambridge Economics report released with the Budget back in March. Any takers?
Second, Municipalities open their GIS systems to citizens (thanks, Gerry Gavigan, who points out that “As well as innovation and the other usual unexpected benefits, it points to the existence, alas without quantification, of financial benefits.”) The article explains:
For instance, the online burning permit sales service of the Minnesota Department of Natural Resources (DNR) allows citizens to declare precisely where they would like to burn woody debris. High precision is essential in deciding whether a permit is obtainable, as well as when and under what conditions: if there is a high fire risk in the area and day for which a user asks for a permit, the software must refuse it. The Web site, however, makes it easy to enter the location with the greatest possible resolution: users first type an address into a form to get an approximate location on the map, then zoom at will and finally click on the exact spot for which they are applying for a permit.
And, more pertinently:
The success of initiatives like OpenStreetMap or the availability of Yahoo! and Google Maps APIs may make you think that people may create services like these and many more all by themselves, without getting any bureaucrat involved. However, in order to benefit the most from digital maps and other spatial data, citizens need such data to be officially inserted in, and completely integrated with, the maps and databases public administrations use to plan roads, zoning, and everything else.
Citizens may use Web sites like those mentioned here to request services as different as bus stops, trekking permits, or new post offices. Other uses may include signalling construction abuses, damages to public property, or illegal dumpsters. We may draw our preferred public bus routes on a map in our City Council official Web site.
Of course, to make all this work in practice, public administrations should also clarify the data ownership situation. Who owns data directly and freely provided from citizens? What license should apply to those data or any derived ones? This, however, is a separate issue, not really related to open source software.
And finally, some interesting questions being asked in Parliament by John Howell (of the Tories) about Ordnance Survey income from local authorities, and on use of OS vector data for commercial use (and, previously, about discussions between OS and Google over mapping licences; Ed Parsons, formerly OS and now Google, says the minister’s answer is wrong); while Mike Gapes, a Labour MP, about London mapping payments to OS and payments to OS for use of its data by various government authorities.
We’d be interested in any comments on what Gapes and Howell are trying to unearth here… and of course your comments on anything else. And happy new year!
- The following posts may be related...(the database guesses):
- OS expert isn't Max Craglia either... so who is it? (10 July 2009; score: 30.5%)
- Today in The Guardian: readers respond to the start of the campaign (16 March 2006; score: 17.58%)
- ..but we're just as quick: more questions re the international man (or woman) of mystery (31 July 2009; score: 17.15%)
- Well, that was quick: OS responds to FOI re international expert; mystery deepens (if that's possible) (31 July 2009; score: 16.88%)
- Locus trade association responds to Free Our Data (4 April 2006; score: 15.66%)

January 2nd, 2009 at 7:32 am
We should also note an interesting shift in the political wind – under the Place Matters strategy, Defra has replaced Communities and Local Government as the lead Whitehall department for geographical information. Defra is also charged with implementing the Inspire directive in the UK this year: potentially a very exciting development.
January 4th, 2009 at 1:18 pm
There is also Dabble DB for sharing public data (if it’s Creative Commons Licensed) – up to 100,000 rows (not that massive) can be stored for free and Dabble DB has a lot of nice manipulation tools (I’m not associated with them by the way, nor have I actually used their service, but I have heard good things)…
http://dabbledb.com/
January 10th, 2009 at 7:50 pm
If you’re interested in making public data available, this recent Robert Scoble interview is interesting.
http://www.kyte.tv/ch/6118/297359
From 20th Dec 2008
(couldn’t find the Scobleizer blog post to accompany this)
The interviewee is a guy called Carl Malamud who buys USA government data then does the hard slog and puts it up for free on http://public.resource.org
He’s a hero.