QUESTION
What is the process for identifying and releasing datasets on the open data portal?
0:39:05
·
3 min
Martha Norrick details the process of identifying and releasing datasets on the open data portal, including compliance workbooks, target release dates, and public requests.
- Yearly compliance process for agencies to identify datasets for release
- Datasets have specific release dates; no dataset is marked for a "nebulous someday" release
- Agencies periodically review their websites to check for datasets released there but not on the portal
- Public can request datasets through a help desk; agencies must respond with release plans or reasons for withholding
- Efforts are made to release sensitive data by aggregating it to protect personal information
Robert Holden
0:39:05
And how many I have a question on, you know, how many datasets that should be available or not currently available on the open data portal.
0:39:20
Do you have a
Martha Norrick
0:39:23
We have so I can talk a little bit about the process that we use to identify datasets that should be on the portal, and then I'll where you can look to see datasets that have been identified for release but have not yet been released.
Robert Holden
0:39:34
What was that coming soon?
0:39:35
Does
Jennifer Gutiérrez
0:39:35
it Yeah.
Martha Norrick
0:39:36
Exactly.
0:39:36
It's a teaser trailer for OpenData in a world where this dataset is released.
0:39:40
Yes.
0:39:40
Coming soon to an open data portal near you.
Robert Holden
0:39:42
Yeah.
0:39:43
It would it doesn't give you actual target date.
0:39:45
So it
Martha Norrick
0:39:46
does have the target dates on there.
Robert Holden
0:39:47
Oh, don't?
Martha Norrick
0:39:48
Yes.
0:39:48
Yes.
0:39:48
We every dataset has a dataset release date for if it's gonna be released in the future, but it hasn't yet been released.
0:39:56
We don't allow for just sort of, like, nebulous someday data set release.
0:40:01
It has to have a date.
0:40:03
So to identify and every year in the yearly compliance process for agencies.
0:40:09
Agencies work fill out a workbook that has that where they identify any dataset that has that should be released on the open data portal, Those datasets include datasets that have been released on the agency's website, and we do we, you know, we review agencies websites periodically check for datasets that they've released on their websites, but that are not available in open data.
0:40:33
We also agencies that release DataVue foil, that data, as Zachary mentioned, will go should go on the open data portal or has to go on the open data portal.
0:40:44
It also agencies because then if that data is being full repeatedly, they can just point people towards the open data portal and people can self serve.
0:40:53
The agency those compliance workbooks, so the all the agencies sort of review of the datasets that they have and that they and that they or maybe new datasets, that's all released that's all available publicly.
0:41:08
And that as I mentioned, those those workbooks include sort of every data set that an agency has identified that has not yet been released, but will be released, and a publication schedule a associated with that dataset.
0:41:20
If there are datasets that that are not on the that are not included in the in that sort of, you know, plan for release or not on the open data portal, but that people think should be.
0:41:32
We also have a way to ask for an open data data set on through the through that help desk, and agencies have to respond to that inquiry with either by either releasing the data or or publicly saying why they can't release that data.
0:41:49
And the reasons that agencies sometimes can't release a data set is if it provide if contains personally identifying information or sort of otherwise sensitive information.
0:42:00
And we work with agencies to to try to think about aggregation methods or other ways to sort of be responsive to that to that request without sort of compromising individual level information if there's an ability to sort of aggregate data up, you know, by a geography or something like that.