Grading Agencies’ High-Value Data Sets
I wrote here a few weeks ago about the “high-value data sets” — three per agency — that the federal government would soon be releasing at Data.gov. They were released on January 22nd, and we’ve been poring over them ever since. More on that below.
Tomorrow, agencies are supposed to have their “open government” sites put up — sites where they make their data feeds available and easily findable for the public. There are a couple of different sites monitoring when those sites are going up.
Data, data, data — that means more direct oversight of the government by more people. We talked about all this at our December 2008 policy forum, Just Give Us the Data!
When I wrote recently about the release of agencies’ high-value data sets, though, I worried:
Rather than substantive insight into government management, deliberations, and results, we might get a lot of data-oriented play-toys… [P]ublic choice economics predicts that the agencies will choose the data feeds with the greatest likelihood of increasing their discretionary budgets or the least likelihood of shrinking them.
So I decided to grade them:
To help focus agencies on releasing the data that is high-value for genuine government transparency, I plan to examine the three data-streams each agency releases and grade the agencies on whether their releases provide insight into agency management, deliberations, or results.
With the help of Cato interns Solomon Stein and Sasha Davydenko, I assigned three points to each feed that had to do with management, deliberation, or results. The resulting numerical scores — 9, 6, 3, or 0 — translate into grades: A, B, C, or D respectively. F was reserved for agencies that didn’t produce feeds.
The results follow these few comments:
Is Government Transparency Headed for a Detour?
With a year in office, and perhaps under some pressure to deliver on promises of transparency and change, the White House went on a little PR offensive this week. It rolled out a blog post and a video claiming the transparency successes of the administration’s first year. A lot has gone on, and it’s worth a review. It’s also worth noting some signals that the government transparency project could be heading for a slight detour.
In the video — a little infomercial-y, but tolerable and interesting — federal chief technology officer Aneesh Chopra cites several examples of government use of technology. A system called ISDS Distribute helps the government monitor flu outbreaks, for example, akin to Google.org’s Flu Trends. Chopra touted the benefits of machine readability and the Agriculture Department’s release of data about a thousand most commonly eaten foods. (I’m not sure if this is it, but if not it’s probably something similar. Someone like Mike could use it to build a site that is further along than 1996′s state-of-the-art.) And Chopra discussed the platforms they are building at apps.gov to help agencies draw on the participation and engagement of the public. Putting aside how these illustrate the federal government’s distended role, these are all fine things.
White House ethics counsel Norm Eisen cited the release of visitor records as “one of the big innovations in the White House” over the past year. (Good, yes. But “big”?) Eisen dodged the question about why health care negotiations are not on C-SPAN.
In response to a question about putting federal advisory committees online, Chopra told of a recent meeting of the President’s Council of Advisers for Science and Technology, which was telecast live on the web and archived.
Finally, Chopra touted the planned January 22nd roll-out of data feeds from every federal agency under a recent open government memorandum — three “high-value data sets” per agency. In working toward this, Chopra said, “the conversation is all about what would help you do what you do better. How can we advance our shared goals of reducing disparities in health care, improving our commitment to renewable energies, advancing our collective educational results?”
This language and some of the examples cited in the video cause me to worry that the transparency effort may be heading for a detour. Rather than substantive insight into government management, deliberations, and results, we might get a lot of data-oriented play-toys.
#OpenGov and the Road from Serfdom
Like Jim, I watched this morning’s Open Government Initiative launch with an eyebrow reflexively arcing skyward. Like Fox Mulder, I want to believe, but it’s not just the track record that gives me pause; it’s the tension in one of Vivek Kundra & Aneesh Chopra’s answers to a pointed question that came in from the Web: How do you actually implement this? How do you get all the agencies on board, persuade (or compel) them to open up, embrace openness, and free their data? Because the public pitch is that the great benefit of open government is accountability, which requires information that may reflect badly on an agency and generate bad publicity to be released. But since they’re limited in their ability to enforce this on an alphabet soup of agencies, the pitch to leaders within government is: Imagine how cool it would be to have the entire population as your clickworkers. So transparency is carrot and stick in one—a carrot stick, if you will: Take a nibble between thrashings, it’s delicious! This is not totally crazy, since there will probably be data whose release opens an agency to greater scrutiny, but still benefits them on net because it lets some tasks be offloaded to the cloud. But insofar as those two things come apart, it’s not hard to guess which one agencies will want to focus on, and the mandate to ensure “data quality” makes a good stock excuse for withholding.
I don’t want to be entirely cynical, though, because openness—as I’ve harped on before, and as Jim often stresses—can be an important structural limitation on government. And if I can riff for a moment, I think it’s worth distinguishing two aspects of “limited government” through the lens of the argument F.A. Hayek makes in his seminal The Road to Serfdom. Very crudely, the idea goes something like this: As government takes on responsibility for ever more complex forms of planning, via a growing tangle of interdependent rules, it becomes increasingly difficult for that power to be checked by democratic mechanisms. Expansion in the scope of state authority goes hand-in-hand tends to be associated with more centralized, opaque, and autocratic exercise of that authority, compounding the disempowerment of ordinary citizens. Call them, if you want to be dramatic, the Orwell problem and the Kafka problem, respectively. But state functions that are not amenable to democratic oversight by the crowd may be amenable to peer-produced oversight by the cloud. Libertarians focus—with good reason—on limiting the scope of state power, which we might think of as a kind of external boundary. The internal boundaries are at least as important. But folks who are centrally concerned about limited government don’t often choose a career in the federal bureaucracy, and the ones who get elected to office, let’s face it, often lack the skill and disposition for the nitty gritty details of governance.
One implication of this is that a more open and networked government, if it ever does come about, may demand a disorienting cultural shift of libertarians—where on top of the big political-philosophy level ideas, it begins to behoove us to pick a pet agency and get interested in the profoundly unsexy details of how it operates. It lacks the frission of taking to the streets quoting Paine, to be sure, but at least engagement no longer demands more pernicious incentives—either venal or, heaven forfend, idealistic.
On Transparency, Talk Trumps Action
In the heady first days of the administration, President Obama issued a memorandum on transparency and open government that seemed it would set the ship of state on a course for transparency, participation, and collaboration. Many people expected that within the 120-day time-frame stated in the memo, the administration would issue the “Open Government Directive” it called for.
Well, 120 days from January 21 was May 21—and 200 days after that, we are finally going to see that open government plan. An announcement of it will be streamed live on the White House web site at 11:00 am.
It turns out that administrators didn’t fall woefully behind on President Obama’s instructions. His memorandum directed the not-yet-appointed Chief Technology Officer and others “to coordinate the development by appropriate executive departments and agencies, within 120 days, of recommendations for an Open Government Directive . . .” It was an instruction to coordinate on the writing of a directive, and within 120 days, people were surely coordinating.
Given the exciting campaign mantra of “change,” one could forgive people expecting the administration to set its course for good governance early. How un-change-like it is that nearly a quarter of the way through President Obama’s term (an eighth if he’s reelected), with old habits established and unlikely to be dislodged, we finally get that “open government plan.”
If only this good-government priority had been pursued as steadfastly as President Obama’s big-government priorities.
While coordinating and planning has gone on, President Obama has specifically declined to carry out an open government promise he made on the campaign trail. In fact, more than 100 times since he has been in office, he has declined to post online the bills sent him by Congress for five days of public review before he signs them. I’ll put up a new chart covering all the laws President Obama has signed sans sunlight later today.
Since I last wrote about this favorite topic, I learned of a new development, however. At some point earlier this year, the White House began posting links on Whitehouse.gov to bills that were heading its direction, a half-measure the White House told the New York Times it would take.
I failed to notice the existence of these pages, but I think it is forgivable error. There is no uniform structure to them, and there is no link I can discover on Whitehouse.gov that would bring anyone to them.
Based on my spot-checking, they haven’t been crawled by any search engine, so the only way a person could find them is by searching on Whitehouse.gov for phrases on the yet unseen pages or by searching the House or Senate bill numbers of bills that you know to look for because they have already passed into law.
This doesn’t fulfill the spirit of the Sunlight Before Signing pledge. It doesn’t give the public an opportunity to review final bills and comment before the president signs them. I doubt if a single one of the people who cheered when President Obama made his Sunlight Before Signing pledge has visited one of these pages and commented to the president as he told them they would be able to do.
There are further curiosities: The pages themselves are undated, but their “posted” dates, which appear in search results, are sometimes well beyond the date on which they became law. A Whitehouse.gov search for H.R. 2131, which became Public Law 111-70 on October 9th, shows that it was posted for comment on October 23rd.
Today the White House announces plans for dramatic steps forward on government transparency. But the steps it could have taken starting on day one remain promises unfulfilled. President Obama’s “Sunlight Before Signing” campaign pledge breaks every time he signs a bill without posting its final version at Whitehouse.gov for five days of public review before signing it.
Transparency: Good News / Bad News
Last week was an interesting week for transparency, with some good news and some bad news.
On the “good” side of the ledger, the administration rolled out “Data.gov,” a growing set of data feeds provided by U.S. government agencies. These will permit the public to do direct oversight of the kind I discussed at our “Just Give Us the Data!” policy forum back in December.
My metric of whether Data.gov is a success will be when independent users and Web sites use government data to produce new and interesting information and applications. The Sunlight Foundation has a contest underway to promote just that. Get ready for really interesting, cool, direct public oversight of the government.
Also under the White House’s new “Open Government Initiative,” an Open Government Dialogue “brainstorming session” began last week. The public can submit ideas for making the government more transparent, participatory, and collaborative. This is important stuff, an outgrowth of President Obama’s open government directive, issued on his first full day in office.
That directive called for the Office of Management and Budget to require specific actions of agencies “within 120 days,” which meant the final product was due last week. And that missed deadline is where we start to slide into the “bad” on the transparency ledger.
Last week, President Obama gave an important speech on national security (which I blogged about here and here). But you couldn’t find the speech in the “Speeches” section of the Whitehouse.gov Web site. It’s buried elsewhere. That’s “basic Web site malpractice,” I told NextGov.com. And I cautioned my friends in the transparency community not to forget Government 1.0 for all the whiz-bang Gov 2.0 projects flashing before our eyes. Whitehouse.gov should be a useful, informative resource for average Americans.
The current top proposal on the “brainstorming” site referred to above is to require a 72-hour mandatory public review period on major spending bills. This is reminiscent of President Obama’s promise to hold bills five days before signing them. But, as Stephen Dinan reports in the Washington Times, the president signed several more bills last week without holding them the requisite time.
The White House protests that they posted links to bills on the Thomas Web site at the Whitehouse.gov blog. But that does not give the public meaningful review of the bills in their final form, as they have come to the president from Congress. “Posting a link from WhiteHouse.gov to THOMAS of a conference report that is expected to pass doesn’t cut it,” says John Wonderlich at Sunlight.
President Obama signed nine new laws since we last reviewed his record on the “Sunlight Before Signing” promise. Alas, it’s been a case study in pulling defeat from the jaws of victory.
Five of the bills were held by the White House more than five days before the president signed them, but they weren’t posted! Simply posting them on Whitehouse.gov in final form would have satisfied “Sunlight Before Signing.”
President Obama’s average drops to .043, and that’s crediting him one win for the DTV Delay Act, which was posted at Whitehouse.gov in its final form for five days after Congress passed it, but before presentment, which is the logical time to start the five-day clock.
Here is the latest tally of bills passed by Congress, including the date presented, date signed, whether they’ve been posted or linked to at Whitehouse.gov, and whether they’ve been posted for the full five days after presentment. (Corrections welcome – there is no uniform way that the White House is posting bills or links, so I may have missed something.)


