Q&A
Discussion on the role of the office of algorithmic data integrity
1:55:01
·
3 min
Council Member Gutiérrez engages with the STOP representative, Darío Maestro, about the proposed office of algorithmic data integrity and its potential role in AI oversight.
- Gutiérrez agrees with STOP's recommendation for the office to have more than just an advisory role
- She asks about STOP's perspective on OTI's role versus what was stated in Executive Order 3
- Maestro expresses concerns about relying too much on OTI and supports creating the office of algorithmic data integrity
- They discuss the need for enforcement capabilities, including the ability to examine code and take corrective action against problematic AI tools
Jennifer Gutiérrez
1:55:01
Thank you so much for your testimony, and I know you didn't get to read it.
Darío Maestro
1:55:04
Thank
Jennifer Gutiérrez
1:55:04
you.
1:55:04
Word for word, but I have it here.
1:55:07
And we'll certainly be engaging with you, with stop on some of these recommendations.
1:55:14
I agree with you on the recommendation for the office of algorithmic data serving more than just an advisory role.
1:55:26
I don't know if you were here the whole time.
1:55:27
I don't know what you what you gather from testimony from OTI of kind of, like, where they feel their role is versus what was what was said today versus, like, what I read in executive order 3.
1:55:45
So just curious kind of where you think or how you what that pathway looks like, because it we do need something with way more teeth, the office of of data in other cities and other states have more of a role.
1:56:00
And so I'm just curious kinda what you think.
1:56:03
With this versus their action plan.
Darío Maestro
1:56:05
Thank you for that question.
1:56:07
And I was very present to the testimony that we heard earlier from OTI.
1:56:13
In fact, one of our concerns about 926 was that the build realized too much on OTI given the somewhat erratic record that the office has implementing local laws and regulations specifically on AI systems, those we have heard today.
1:56:34
So we generally support the creation of the office of algorithmic data integrity.
1:56:41
We recognize that there might be an overlap of functions that they might need to be sorted out between the offices and that establishing a new office within the New York City government might take time.
1:56:56
However, we think it's a it's a great opportunity to rethink what enforcement looks in regulating these new technologies.
1:57:05
And that's why the introduction of this bill and perhaps a targeted amendment that would give it the enforcement team that we were talking about earlier with the ability to examine the code and and take corrective action against tools that have been developed by vendors and are not driving the desired results in the use by city agencies or or, like, we heard earlier.
1:57:33
There was a tool that was implemented and was giving false information completely invented, yeah, information to to the residents of New York.
1:57:46
What we want to avoid is that, and this office would be the perfect opportunity to start giving the New York City government the tools they need to check with the vendors and make sure that we're delivering the results that we need.