New York City Council
Committee on Technology
Oct 28, 2024
·
01:00 PM
2 hr 15 min
Summary
A hearing on artificial intelligence (AI) and automated decision systems in NYC government agencies, discussing four proposed bills:
- Establishing an Office of Algorithmic Data Integrity
- Requiring responsible use practices for AI tools
- Creating a centralized list of approved AI tools
- Reporting on AI impacts on city employees
Discussions focused on:
- Transparency, accountability, and oversight in AI implementation across city agencies
- Balancing innovation with responsible use
- Addressing concerns about bias and discrimination in AI systems
Features testimony from the Office of Technology and Innovation (OTI), tech industry representatives, civil liberties groups, and the public.
Meeting chapters
Read summaries and watch videos for short segments that matter to you.
Council Member Jennifer Gutiérrez opens hearing on AI and automated decision systems in NYC
Council Member Jennifer Gutiérrez opens a hearing on artificial intelligence (AI) and automated decision systems in New York City. She emphasizes the need for transparency, fairness, and oversight in the …
0:00:25
·
3 min
Council Member Julie Menin discusses AI governance and introduces Intro 926
Council Member Julie Menin addresses the critical need for AI governance in New York City, highlighting the lack of an effective framework and introducing Intro 926. This legislation aims to …
0:04:11
·
156 sec
Introduction and NYC's leadership in AI governance
Alex Foard, Executive Director of Research and Collaboration for the NYC Office of Technology and Innovation (OTI), introduces himself and positions New York City as a national and global leader …
0:07:19
·
26 sec
Overview and development of the AI Action Plan
The NYC AI Action Plan, published in October 2023, addresses the need for a comprehensive strategy for responsible AI use in city agencies. It outlines a framework for evaluating AI …
0:07:46
·
70 sec
Key accomplishments of the AI Action Plan
The testimony highlights that OTI has exceeded its initial goals, initiating or completing 31 of the 37 proposed actions in the AI Action Plan. Key accomplishments include: - Publication of …
0:08:57
·
63 sec
Future plans for AI governance in NYC
OTI outlines its plans for the next year in AI governance and policy development. The focus is on continuing to refine and expand upon the work initiated by the AI …
0:10:01
·
25 sec
Local Law 35 reporting on algorithmic tools
OTI discusses the annual reporting process for algorithmic tools used by city agencies, as required by Local Law 35 of 2022. This reporting provides transparency on AI and related tools …
0:10:27
·
50 sec
Feedback on Introduction 199: Office of Algorithmic Data Integrity
OTI provides feedback on Introduction 199, which proposes to establish a new Office of Algorithmic Data Integrity. The testimony expresses concerns about potential unintended consequences of the bill. - Notes …
0:11:21
·
35 sec
Feedback on Introduction 926: Rules for responsible AI use practices
OTI provides feedback on Introduction 926, which proposes to require OTI to promulgate rules for appropriate and responsible use practices for AI tools used by city agencies. The testimony expresses …
0:11:57
·
33 sec
Feedback on Introduction 1024: Centralized list of approved AI tools
OTI provides feedback on Introduction 1024, which proposes to require publication of a centralized list of AI tools approved for use by city agencies. The testimony expresses general alignment with …
0:12:32
·
45 sec
Feedback on Introduction 1099: Reporting AI impacts on city employees
OTI provides feedback on Introduction 1099, which proposes to amend annual algorithmic tools compliance reporting to include the impacts of these tools on city employees and employment responsibilities. The testimony …
0:13:19
·
40 sec
Council Member Julie Menin questions OTI on AI governance and responsible use
Council Member Julie Menin engages in a heated discussion with Alex Foard from the Office of Technology and Innovation (OTI) regarding the lack of rules for fair and responsible use …
0:14:31
·
3 min
Council member criticizes OTI's opposition to proposed AI legislation
Council Member Jennifer Gutiérrez expresses disappointment with OTI's opposition to the proposed legislation on AI governance. She criticizes the lack of significant action from the AI Action Plan and questions …
0:17:43
·
65 sec
OTI explains their approach to AI governance and existing efforts
Alex Foard from OTI responds to the council member's criticism by explaining their approach to AI governance and existing efforts. He emphasizes that OTI shares common goals with the proposed …
0:18:48
·
79 sec
Discussion of Intro 199 and the proposed Office of Algorithmic Data and Integrity
Council Member Gutiérrez questions OTI about their position on Intro 199, which proposes creating an Office of Algorithmic Data and Integrity. She seeks clarification on OTI's concerns about the bill …
0:20:07
·
112 sec
Council member criticizes OTI's response to proposed legislation
Council Member Gutiérrez expresses strong disappointment with OTI's responses to the proposed legislation. She criticizes OTI's interpretation of the bills and their confidence in the AI Action Plan. - Gutiérrez …
0:21:59
·
59 sec
OTI's role in developing and implementing city's information technology policies
Council Member Gutiérrez inquires about OTI's role in developing, coordinating, and implementing the city's information technology policies, with a focus on AI principles. Alex Foard explains OTI's foundation and structure. …
0:22:59
·
52 sec
Non-mandatory nature of OTI's AI principles
Council Member Gutiérrez questions the mandatory nature of OTI's AI principles, pointing out that the wording suggests they are not obligatory. Alex Foard clarifies the intended use of these principles. …
0:23:54
·
44 sec
Lack of enforcement mechanisms for AI principles
Council Member Gutiérrez probes into the consequences for agencies not following OTI's AI principles. Alex Foard's response reveals a lack of specific enforcement mechanisms. - Gutiérrez asks directly what happens …
0:24:39
·
45 sec
OTI's explanation of the purpose and development of AI principles
Alex Foard from OTI explains the purpose and development of the AI principles, emphasizing their role in guiding future policy development and risk assessment processes. - Foard describes the principles …
0:25:24
·
45 sec
Council member's concerns about the effectiveness and implementation of the AI Action Plan
Council Member Gutiérrez expresses significant concerns about the effectiveness and implementation of the AI Action Plan, questioning its practical impact and enforcement mechanisms. - Gutiérrez questions the enthusiasm behind the …
0:26:11
·
61 sec
OTI's response on the evolving nature of AI policy and their approach to development
Alex Foard from OTI responds to concerns about the AI Action Plan's effectiveness by explaining the evolving nature of AI policy and OTI's approach to policy development. - Foard emphasizes …
0:27:12
·
67 sec
Discussion of agency integration of AI principles
Council Member Gutiérrez inquires about the integration of AI principles by agencies participating in the steering committee. Alex Foard explains how principles are being incorporated into various contexts. - Gutiérrez …
0:28:18
·
99 sec
Debate on the necessity of formal agreements with agencies for AI principles
Council Member Gutiérrez and Alex Foard engage in a debate about the necessity of formal agreements with agencies for implementing AI principles. The discussion reveals differing views on enforcement and …
0:29:58
·
111 sec
Local Law 35 compliance and OTI's role in overseeing reporting
Alex Foard explains OTI's role in overseeing Local Law 35 compliance and reporting, addressing Council Member Gutiérrez's concerns about enforcement and implementation of AI principles. - Foard uses Local Law …
0:31:48
·
60 sec
Lack of enforcement mechanisms for AI principles in city agencies
Council Member Jennifer Gutiérrez questions the lack of enforcement mechanisms for AI principles in city agencies. She expresses concern that while there are reports and principles, there's no clear pathway …
0:32:51
·
33 sec
OTI's explanation of the diverse nature of the AI Action Plan activities
Alex Foard from OTI explains the diverse nature of the AI Action Plan activities, emphasizing that there isn't a singular enforcement mechanism because the plan covers a wide range of …
0:33:24
·
119 sec
Overview of OTI's completed activities and future plans
Alex Foard provides an overview of OTI's completed activities and future plans related to the AI Action Plan. He highlights the progress made and acknowledges that some major initiatives are …
0:35:23
·
49 sec
Discussion of the 'validity and reliability' principle in AI governance
Council Member Jennifer Gutiérrez and Alex Foard discuss the 'validity and reliability' principle in AI governance, focusing on who is responsible for assessing AI solutions' validity for their intended tasks. …
0:36:13
·
77 sec
OTI's authority and role in assessing AI solutions
The discussion focuses on OTI's authority and role in assessing AI solutions, as outlined in Executive Order 3. Alex Foard explains OTI's varied responsibilities in overseeing agency technology. - OTI's …
0:37:30
·
55 sec
Responsibility for monitoring AI tools from ideation to deployment
The discussion centers on who is responsible for monitoring AI tools from ideation to deployment. Alex Foard explains OTI's plans for developing an ongoing monitoring process. - The principles expect …
0:38:25
·
95 sec
OTI's current and future role in monitoring AI tools used by agencies
The discussion focuses on OTI's current and future role in monitoring AI tools used by city agencies. Alex Foard explains that the monitoring process is still being developed as part …
0:40:03
·
63 sec
Discussion on the potential for enforcement in future AI monitoring
The discussion explores the potential for enforcement mechanisms in future AI monitoring processes. Alex Foard explains that it's too early to specify details about future policies that haven't been drafted …
0:41:06
·
57 sec
OTI's capacity to recommend ceasing use of AI tools or assessing their efficacy
The discussion explores OTI's potential capacity to recommend ceasing use of AI tools or assessing their efficacy. Alex Foard explains that it's too early to know exactly what the process …
0:42:03
·
57 sec
Council member's concerns about OTI's role in IT coordination and implementation
Council Member Jennifer Gutiérrez expresses concerns about the apparent disconnect between OTI's role as described in Executive Order 3 and the agency's current approach to AI governance. She seeks clarification …
0:43:04
·
61 sec
OTI's approach to supporting agencies in AI implementation
Alex Foard explains OTI's approach to supporting agencies in AI implementation, emphasizing their advisory and enabling role. He outlines various ways OTI assists agencies in deploying technology and developing AI-related …
0:44:05
·
94 sec
Council Member Paladino expresses concerns about AI, privacy, and public engagement
Council Member Vickie Paladino expresses her concerns and questions about AI, focusing on privacy protection and public engagement. She highlights the need for social responsibility in AI adoption and questions …
0:45:44
·
3 min
OTI addresses concerns about privacy protection and public engagement in AI implementation
Alex Foard from OTI responds to Council Member Paladino's questions about privacy protection and public engagement in AI implementation. He explains the office's approach to privacy concerns and details their …
0:48:48
·
144 sec
Addressing AI challenges for older generations
Council Member Paladino raises concerns about the challenges AI poses for older generations, emphasizing the need for targeted communication and engagement. OTI acknowledges the importance of adapting their approach for …
0:51:12
·
110 sec
Concerns about AI in automated customer service
Council Member Paladino expresses concerns about the impact of AI and automation on customer service, particularly for older generations. OTI acknowledges the complexity of the issue and emphasizes the importance …
0:53:03
·
91 sec
Council member Bottcher questions OTI about city's small business chatbot accuracy and effectiveness
Council Member Erik D. Bottcher questions Alex Foard from the Office of Technology and Innovation (OTI) about the city's chatbot for small businesses, focusing on its accuracy, testing, and effectiveness …
0:54:42
·
4 min
Council Member Holden questions OTI on AI complaint mechanisms and public transparency
Council Member Robert Holden engages in a Q&A session with Alex Foard from the Office of Technology and Innovation (OTI) regarding the use of AI and automated decision systems in …
0:59:13
·
3 min
Discussion of AI Action Plan components and risk assessment process
Council Member Jennifer Gutiérrez inquires about the specifics of the AI Action Plan, focusing on the AI risk assessment process that is currently in progress. Alex Foard from the Office …
1:02:25
·
3 min
Responsibility for AI risk assessment and potential public disclosure
Council Member Gutiérrez inquires about the responsibility for AI risk assessments and the possibility of making the results public. Alex Foard from OTI explains the current state of the process …
1:05:58
·
173 sec
OTI's role in standardizing Local Law 35 responses
Council Member Gutiérrez and Alex Foard discuss OTI's role in ensuring consistent and standardized agency responses to Local Law 35, which requires reporting on algorithmic tools used by city agencies. …
1:08:50
·
135 sec
Progress on building external relationships for AI governance
Council Member Gutiérrez inquires about the progress of building external relationships for AI governance, as outlined in the AI Action Plan. Alex Foard from OTI explains the current state and …
1:11:07
·
126 sec
Creation and function of the AI advisory network
Council Member Gutiérrez and Alex Foard discuss the creation, composition, and function of the AI advisory network established by OTI. - The AI advisory network is OTI's biggest achievement in …
1:13:13
·
147 sec
Privacy concerns and information sharing in AI governance groups
Council Member Gutiérrez raises questions about potential privacy concerns and information sharing within the AI advisory network and steering committee. Alex Foard from OTI addresses these concerns and explains the …
1:15:39
·
87 sec
Public engagement efforts for AI governance
Council Member Gutiérrez inquires about OTI's public engagement efforts for AI governance, including listening sessions and outreach methods. Alex Foard provides details on these initiatives. - OTI conducted three virtual …
1:17:10
·
146 sec
Discussion on public engagement efforts for AI governance
Council Member Jennifer Gutiérrez inquires about OTI's public engagement efforts for AI governance. Alex Foard from OTI responds, discussing their plans for outreach and engagement with various groups. - OTI …
1:19:36
·
78 sec
Q&A on Local Law 35 reporting timeline and requirements
Council Member Jennifer Gutiérrez questions Alex Foard from OTI about Local Law 35 reporting timeline and requirements. They discuss the specifics of what needs to be reported and when. - …
1:20:55
·
148 sec
Q&A on agency compliance and changes in reporting methodology for Local Law 35
Council Member Jennifer Gutiérrez questions Alex Foard from OTI about agency compliance with Local Law 35 and changes in reporting methodology. They discuss the shift from executive order 50 to …
1:23:23
·
59 sec
Q&A on discrepancies between state comptroller's audit and agency reports
Council Member Jennifer Gutiérrez questions Alex Foard from OTI about discrepancies between the state comptroller's audit and agency reports for Local Law 35. They discuss specific tools used by DOE …
1:24:24
·
103 sec
Q&A on OTI's role in ensuring agency compliance and accuracy of reports
Council Member Jennifer Gutiérrez questions Alex Foard from OTI about their role in ensuring agency compliance and accuracy of reports for Local Law 35. They discuss OTI's process for reviewing …
1:26:07
·
5 min
Q&A on interpretation of 'NA' responses in Local Law 35 reports
Council Member Jennifer Gutiérrez questions Alex Foard from OTI about the interpretation of 'NA' responses in Local Law 35 reports. They discuss the ambiguity of these responses and OTI's plans …
1:31:46
·
92 sec
Q&A on NYPD's reporting of facial recognition tools
Council Member Jennifer Gutiérrez questions Alex Foard from OTI about NYPD's reporting of facial recognition tools in the Local Law 35 report. They discuss discrepancies between reported and publicly known …
1:33:18
·
68 sec
Q&A on ShotSpotter tool used by NYPD
Council Member Jennifer Gutiérrez questions Alex Foard from OTI about the ShotSpotter tool used by NYPD and OTI's role in evaluating such tools. They discuss concerns about the tool's efficacy …
1:34:26
·
132 sec
Q&A on OTI staffing for Local Law 35 and AI initiatives
Council Member Jennifer Gutiérrez questions Alex Foard from OTI about the staffing dedicated to Local Law 35 reporting and AI initiatives. They discuss the specific roles and responsibilities within OTI. …
1:36:40
·
73 sec
Council member inquires about public notification of AI/ADS use in decision-making
Council Member Jennifer Gutiérrez asks about mechanisms to inform the public when decisions are made using AI or Automated Decision Systems (ADS). She notes that some uses are more explicit …
1:37:54
·
31 sec
Discussion on mechanisms for informing the public about AI/ADS decisions
Alex Foard explains the two levels of informing the public about AI/ADS decisions: the aggregate level through Local Law 35 reporting, and the individual level tied to existing agency policies …
1:38:25
·
49 sec
Transparency measures in the AI Action Plan and principles document
Council Member Gutiérrez inquires about guidance in the AI Action Plan for agencies to notify New Yorkers about AI/ADS use in decision-making. Alex Foard explains the approach taken in the …
1:39:14
·
80 sec
Council member discusses agency-specific AI/ADS notification practices
Council Member Gutiérrez discusses examples of AI/ADS use by different agencies, highlighting the varying levels of transparency and public awareness. She emphasizes the need for informed consent and notification in …
1:40:34
·
112 sec
Balancing transparency with agency limitations in AI/ADS notifications
Alex Foard addresses the challenges of implementing transparency measures across different agencies and AI/ADS applications. He emphasizes the need for a dynamic approach that considers individual technologies and agency limitations. …
1:42:26
·
57 sec
Testimony by Bryan Lozano, Director of Tech:NYC Foundation, on AI Technologies and Regulation
Bryan Lozano, Director of Tech:NYC Foundation, testified about the importance of AI technologies in New York City and the need for balanced regulation. He discussed the foundation's Decoded Futures project, …
1:45:24
·
108 sec
Testimony by Darío Maestro, Senior Legal Fellow at Surveillance of Technology Oversight Project (STOP), on AI Legislation
Darío Maestro from the Surveillance of Technology Oversight Project (STOP) testified on a package of bills aimed at regulating AI and automated decision systems in NYC. He offered recommendations for …
1:47:20
·
4 min
Council member inquires about tech company reporting thresholds
Council Member Jennifer Gutiérrez asks Bryan Lozano from Tech:NYC about the reporting requirements and thresholds that tech companies are comfortable with regarding AI tools used by the city. She emphasizes …
1:51:36
·
99 sec
Discussion on Local Law 35 and over-regulation concerns
Council Member Gutiérrez follows up with Bryan Lozano about Local Law 35 and concerns regarding over-regulation of AI tools used by the city. - Gutiérrez asks if there's a sentiment …
1:53:15
·
31 sec
Council member emphasizes need for more information and enforcement
Council Member Gutiérrez emphasizes the need for more comprehensive information and enforcement mechanisms regarding AI tools used by city agencies. - Gutiérrez stresses the importance of requiring more information from …
1:53:46
·
74 sec
Discussion on the role of the office of algorithmic data integrity
Council Member Gutiérrez engages with the STOP representative, Darío Maestro, about the proposed office of algorithmic data integrity and its potential role in AI oversight. - Gutiérrez agrees with STOP's …
1:55:01
·
3 min
Testimony by Christopher Leon Johnson on Artificial Intelligence in City Agencies
Christopher Leon Johnson testified about the need for more testing and public input on artificial intelligence (AI) before implementing it in city agencies. He expressed concerns about the potential flaws …
1:58:54
·
154 sec
Council member explains purpose of bills and notes OTI opposition
Council Member Jennifer Gutiérrez explains that some of the proposed bills aim to create more transparency and reporting. She also notes that the Office of Technology and Innovation (OTI) was …
2:01:29
·
12 sec
Testimony by Member of the Public on High-Level Technology Victims
A member of a group representing victims of high-level technology in New York City, New York State, and New Jersey testified about the alleged harmful effects of these technologies, including …
2:01:57
·
3 min
Council member asks testifier about position on legislation
Council Member Jennifer Gutiérrez interrupts the testifier to ask about their position on the legislation discussed during the hearing. The testifier expresses support for statements made by Council Member Paladino …
2:05:36
·
73 sec
Testimony by Daniel Schwarz, Privacy and Technology Strategist at New York Civil Liberties Union (NYCLU)
Daniel Schwarz from the New York Civil Liberties Union (NYCLU) testified on proposed legislation related to AI and automated decision systems (ADS) in NYC government. He expressed concerns about the …
2:07:31
·
124 sec
Testimony by Theo Chino, First Secretary of Social Democrats of America, on AI and Automated Decision Systems
Theo Chino, representing the Social Democrats of America, testified on the need for human oversight in AI and automated decision systems, emphasizing the importance of community input and public engagement. …
2:09:42
·
157 sec
Council member inquires about online testimony submissions
Council Member Jennifer Gutiérrez asks Theo Chino and Daniel Schwarz if they have submitted their testimonies online. She emphasizes the importance of capturing their recommendations. - Theo Chino confirms he …
2:12:19
·
42 sec
