Your guide to NYC's public proceedings.
PUBLIC TESTIMONY
Testimony by Kate Brennan, Associate Director of AI Now Institute
2:55:39
ยท
168 sec
Kate Brennan from the AI Now Institute presented testimony highlighting three main concerns about the MyCity portal, particularly its future as a centralized predictive data platform. She emphasized the risks of entrenching Big Tech interests in public infrastructure, the lack of accountability when AI projects fail, and the prioritization of outsourced contracts over in-house public tech jobs.
- Warned against using MyCity to justify and entrench Big Tech corporate interests in public infrastructure
- Highlighted concerns about private firms evading accountability when public AI projects fail, citing the example of the MyCity chatbot providing incorrect information
- Urged pushing back against the city's prioritization of outsourced contracts over in-house public tech jobs
Kate Brennan
2:55:39
Good afternoon, Sherry.
2:55:40
Good Tiaras and members of the committee on technology.
2:55:43
My name is Kate Brennan, and I'm the associate director at the ANAL Institute, a New York City based policy organization shaping artificial intelligence in the public interest.
2:55:54
My brief testimony today highlights 3 principal concerns we have with the MyCity portal's current trajectory, and in particular, the future vision of MyCity as a centralized predictive data platform.
2:56:07
First, MyCiti must not be used to justify and entrench Big Tex corporate interests in public infrastructure.
2:56:16
Public AI projects like MyCiti are currently designed to require partnering with large tech companies.
2:56:22
For example, the city has already contracted with Microsoft AI to launch the MyCiti chatbot.
2:56:28
These companies have everything to gain from public investment.
2:56:31
For 1, they're enriched with more data to train and improve their models.
2:56:36
And even where agencies don't contracted Big Tech Firms directly, these firms benefit because they control all essential inputs in the AI supply chain, such as cloud computing, data centers, and foundation models.
2:56:49
And what does this mean for the public?
2:56:51
More opaque infrastructures for citizen surveillance.
2:56:55
This concern is especially stark with the proposed MiCITY digital wallets that allow government agencies and without proper safeguards, private companies.
2:57:05
To track how New Yorkers are spending their own money.
2:57:08
These kinds of large government contracts only further worsen concentration of power in the tech industry.
2:57:15
Today widely understood to be bad for innovation, bad for security, and dangerous for democracy.
2:57:22
2nd, we cannot allow private firms to hide behind corporate secrecy laws and evade accountability when public AI projects fail.
2:57:32
We've already seen this play out, the MyCiti chatbot partnered with Microsoft and provided wrong and illegal information to New Yorkers.
2:57:39
And, crucially, when the city attempted to understand the chatbot's training data, Microsoft claimed that the data was proprietary to the vendor and evaded accountability, leaving government oversight committees in the dark.
2:57:52
3rd, and finally, we must push back against the city's prioritization of outsourced contracts over in house public tech jobs.
2:58:01
We expand upon each of these concerns in our submitted written testimony, which we'll submit shortly after this.
2:58:07
In conclusion, we must reject public investment in AI projects that line the pockets of large corporations at the expense of New Yorkers privacy, autonomy, and jobs.
2:58:19
This committee has the opportunity and responsibility to ensure that New York City invest in technology built by and for its people.
2:58:26
Thank you so much.