Developer docs
API playgroundTry for free, no card

Search company profiles

AI Now Institute

Full company profile

uuid00068pj

Namestring
AI Now Institute
Legal namestring
AI Now Institute
Company typeenum
Private
Founded yearint
2016
Descriptiontext

AI Now Institute is an independent, nonprofit research institute hosted at New York University that studies the social, political, and economic implications of artificial intelligence. Founded in 2016 by Kate Crawford and Meredith Whittaker and officially launched in 2017, the organization produces annual landscape reports (most recently 'Artificial Power: 2025 Landscape Report'), thematic research publications such as 'Uber for Nursing Part II' and 'Reframing Impact: AI Summit 2026,' and policy toolkits including the North Star Data Center Policy Toolkit. Its work spans four core research domains — labor and automation, bias and inclusion, rights and liberties, and safety and critical infrastructure — and is distributed free of charge on ainowinstitute.org.

The institute's business model is grant-funded philanthropy rather than commercial sales; revenue is not publicly disclosed, and all research is offered as a public good. Funding has come from major foundations including the Hewlett Foundation, Ford Foundation, MacArthur Foundation, and Alfred P. Sloan Foundation. The go-to-market motion is influence-led rather than sales-led: AI Now secures policy impact through government testimony, expert briefings, academic publishing, media coverage, and convening events such as its annual symposiums. Customer segments are policymakers and government bodies, civil society organizations, researchers and academics, and the general public — none of whom pay for the institute's outputs.

AI Now has no proprietary technology products. Its offering is a portfolio of research publications, policy briefs, symposiums, and policy toolkits. Leadership includes Co-Executive Directors Sarah Myers West and Amba Kak, Chief AI Scientist Dr. Heidy Khlaaf, and a small senior team. Recent activity indicates a deliberate expansion of scope into healthcare AI, data center governance, and global AI governance, accompanied by new partnerships with Aapti Institute, The Maybe, and continued engagement with the Electronic Frontier Foundation and NYU Law's Center on Race, Inequality, and the Law.

Short descriptiontext

AI Now Institute is an independent nonprofit research institute at New York University that produces policy research on AI's social implications. It serves policymakers, civil society, researchers, and the public via annual reports, policy briefs, symposia, and government testimony.

Operating statusenum
Operating
Ownership categoryenum
Headcount rangeband
1–10
akta.pro rankint
HeadquartersNew York, United States
HQ citystring
New York
HQ countrystring
United States
HQ regionstring
North America
Markets served

Serves global market

Offices1 record

Each record includes

City, Country, Type, Description, Source

Keyword5 values
AI policy research, AI governance briefs, AI ethics reports, algorithmic accountability, public interest AI
Industry3 codes
1AI Governance, Risk & Compliance (GRC) Platforms
CodeHDAAAMAAPrimaryYes
2Regulatory Readiness & Audit Automation (e.g., EU AI Act, NIST AI RMF, ISO/IEC 42001)
CodeHDAAAMAEPrimaryNo
3Responsible AI, AI Governance & Compliance Services
CodeBPAEAHAJPrimaryNo
NAICS code1 code
  • Research and Development in the Social Sciences and Humanities54172
Product category
AI Policy Research
Social media profiles2 records
Revenue model1 record
1Foundation Grants
TypeManaged Services
Description

AI Now Institute receives grants from foundations to support its research on AI safety, ethics, and governance. Recent grants include $10 million from the Hewlett Foundation as exploratory grants to support security of emerging technologies including AI.

prnewswire.com
Marketing channels7 records

Each record includes

Title, Type, Stage, Description, Source

Distribution channels3 records

Each record includes

Title, Type, Scope, Target buyer, Description, Source

Cost components4 values
Personnel, Operations, Marketing or Sales, Others
GTM typeB2B
B2B
Offering typeServices
Services
Core offering1 text field

AI Now Institute is an independent nonprofit research institute at New York University that produces and freely publishes interdisciplinary research on the social implications of artificial intelligence. Its core offerings are research publications (annual landscape reports such as 'Artificial Power' and thematic reports like 'Uber for Nursing Part II'), policy toolkits (such as the North Star Data Center Policy Toolkit), and convening events (annual Symposiums and AI Summit series), targeted at policymakers, civil society, and the general public.

Differentiator
Functional benefit
Problem solved
Quantifiable outcome1 of 5 values shown
  • Co-Executive Director Sarah Myers West testified before the U.S. Senate Banking Committee on AI risks to the economy
+4 more records
Product overview1 text field

AI Now Institute is an independent research institute at New York University dedicated to understanding the social implications of artificial intelligence. Rather than a unified software product, its offering is a portfolio of research publications, policy reports, annual landscape reports, and convening events (symposiums). The core products include the annual 'Artificial Power' landscape reports, thematic research series such as 'Reframing Impact: AI Summit 2026' and 'Uber for Nursing Part II,' policy tools like the Data Center Policy Toolkit, and annual symposium events. These publications address AI ethics, labor, bias, accountability, geopolitics, and governance across four core domains: labor and automation, bias and inclusion, rights and liberties, and safety and critical infrastructure.

Product and service6 records
1Research Publications and Policy Reports
CategoryResearch Publications
Description

Portfolio of annual landscape reports, research papers, policy briefs, and essays analyzing the social, political, and economic implications of AI. Freely available to policymakers, civil society, and the general public.

2Annual Symposium Events
CategoryConvening Events
Description

Annual convenings bringing together experts from industry, academia, civil society, and government to discuss AI ethics, accountability, and social implications of AI technologies.

3Uber for Nursing Part II
CategoryResearch Publication
Description

Research publication examining gig nursing platforms that use algorithmic management systems to enable nurses to bid against each other for wages, with deregulation efforts documented in nearly half of all US states since 2022.

4Artificial Power: 2025 Landscape Report
CategoryResearch Publication
Description

Annual report mapping the current state of the AI market, interrogating the industry's key sources of power, and providing an actionable strategy to reclaim public agency over the future of AI.

5Reframing Impact: AI Summit 2026 Series
CategoryResearch Publication
Description

Collaborative essay and interview series with Aapti Institute and The Maybe addressing themes in AI and governance ahead of the 2026 India AI Impact Summit, including sovereignty, multilateralism, linguistic diversity, open source, accountability, democratization, AI for Good, Frugal AI, climate, and human capital.

6North Star Data Center Policy Toolkit
CategoryPolicy Toolkit
Description

Policy toolkit providing state and local policy interventions to address AI data center expansion, including guidance on regulatory oversight.

Partnership4 partners
Strategic tierCoreTypeStrategic or Co-development PartnerAnnounced on2026-01-15
Description

AI Now Institute partnered with Aapti Institute to produce the 'Reframing Impact: AI Summit 2026' series, bringing together advocates, builders, and thinkers from around the world to discuss AI governance and impact.

Strategic tierCoreTypeStrategic or Co-development PartnerAnnounced on2026-01-15
Description

AI Now Institute partnered with The Maybe to produce the 'Reframing Impact: AI Summit 2026' series, a collaboration focused on alternative framings of AI impact.

3NYU Law's Center on Race, Inequality, and the Law
Strategic tierMajorTypeStrategic or Co-development PartnerAnnounced on2018-06-13
Description

AI Now partnered with NYU Law's Center on Race, Inequality, and the Law to host the Litigating Algorithms Workshop, examining litigation strategies for challenging government use of algorithmic decision systems.

ainowinstitute.org
Strategic tierMajorTypeStrategic or Co-development PartnerAnnounced on2018-06-13
Description

AI Now partnered with the Electronic Frontier Foundation (EFF) to host the Litigating Algorithms Workshop examining current courtroom litigation where the use of algorithms by government was central to rights and liberties.

Recent move7 records

Each record includes

Date, Type, Title, Description, Source

Expansion highlight6 records

Each record includes

Type, Description

Peers10 records
TypeDirect peer
Description

Stanford HAI is a university-hosted AI policy and research institute that publishes major reports and influences US AI policy. It shares AI Now's orientation toward AI governance and social implications, though with a more industry-engaged posture.

TypeDirect peer
Description

FLI is a nonprofit focused on AI safety, governance, and existential-risk policy with high-profile outreach to governments and international bodies. It overlaps directly with AI Now's policy advocacy and grants-driven nonprofit model.

TypeDirect peer
Description

Data & Society is an independent research institute studying the social implications of data-centric technologies. It is one of the closest direct comparables to AI Now in terms of research output, funding model, and policy orientation.

TypeDirect peer
Description

Partnership on AI is a multistakeholder nonprofit producing research and guidance on responsible AI. It overlaps with AI Now in governance research but operates with a more industry-collaborative stance.

TypeDirect peer
Description

CAIS is a research-focused nonprofit prioritizing AI safety and existential risk. It is comparable to AI Now as a grant-funded AI policy/safety research organization producing influential publications.

6Ada Lovelace Institute
TypeRegional player
Description

Ada Lovelace Institute is a UK-based independent research body examining AI and data-driven technologies through a public-interest lens. It is highly comparable in mission and methodology but operates primarily outside the US.

TypeDirect peer
Description

OTI is a Washington-based think tank focused on technology policy, accountability, and civil liberties. It shares AI Now's policy-advocacy posture and produces reports and testimony on AI governance.

TypeBroad incumbent
Description

Brookings is a large, established policy think tank with substantial AI governance research output. It overlaps with AI Now's policy influence goals but operates at significantly greater scale and across a much broader research agenda.

TypeBroad incumbent
Description

RAND is a major policy research institution that produces research on AI safety, security, and governance. It was a co-recipient of the $10M Hewlett exploratory grant alongside AI Now, signaling direct institutional competition for similar funding and policy influence.

TypeBroad incumbent
Description

Carnegie is an established international affairs think tank with technology-policy programming. It overlaps with AI Now on AI governance, geopolitics, and multilateral engagement, and is also a co-recipient of the Hewlett $10M grant.

Market position
Strengths4 records

Each record includes

Headline, Details, Source

Weaknesses4 records

Each record includes

Headline, Details, Source

Competitive moat5 records

Each record includes

Type, Details

Key risks6 records

Each record includes

Headline, Details, Source

Key highlights7 records

Each record includes

Headline, Details, Source

Customer concentration

Classification, Details

Segment4 records

Each record includes

Title, Type, Primary, Description, Pain point addressed, Use case, Source

Ideal customer profile2 records

Each record includes

Profile, Firmographic size, Sales motion, Sales cycle length, Buying structure, Purchase trigger, Buyer persona, Geography, Industry vertical, Primary use case, Description, Pain points, Evidence proof points, Target buyer

Technology focused
No
API detail
Has APIbool
No

Docs URL, Description

AI maturity
App detail

Has app

Core technology
Revenue estimate
Valuation estimate
Number of profiles
Profiles8 records

Each record includes

Name, Designation, Designation category, Overview, Profile commentary, Source

No data
No data
Funding overview

Funding stage, Last funding date, Total funding USD

Funding rounds

Each record includes

Round, Amount USD, Date, Pre money valuation, Total investors, Investors, News

Investors

Each record includes

Name, Type, Date of entry, Rounds participated, Website

Funding detail is available on the Subscription and Enterprise plan.Contact sales →

M&A

Each record includes

Name, Acquisition type, Announced date, Completed date, Status, Website, News

Investment

Each record includes

Name, Round, Announced date, Lead investor, Website, News

M&A and investment is available on the Subscription and Enterprise plan.Contact sales →

AI Now Institute

AI Policy Researchainowinstitute.org

AI Now Institute is an independent nonprofit research institute at New York University that produces policy research on AI's social implications. It serves policymakers, civil society, researchers, and the public via annual reports, policy briefs, symposia, and government testimony.

What AI Now Institute does

AI Now Institute is an independent, nonprofit research institute hosted at New York University that studies the social, political, and economic implications of artificial intelligence. Founded in 2016 by Kate Crawford and Meredith Whittaker and officially launched in 2017, the organization produces annual landscape reports (most recently 'Artificial Power: 2025 Landscape Report'), thematic research publications such as 'Uber for Nursing Part II' and 'Reframing Impact: AI Summit 2026,' and policy toolkits including the North Star Data Center Policy Toolkit. Its work spans four core research domains — labor and automation, bias and inclusion, rights and liberties, and safety and critical infrastructure — and is distributed free of charge on ainowinstitute.org.

The institute's business model is grant-funded philanthropy rather than commercial sales; revenue is not publicly disclosed, and all research is offered as a public good. Funding has come from major foundations including the Hewlett Foundation, Ford Foundation, MacArthur Foundation, and Alfred P. Sloan Foundation. The go-to-market motion is influence-led rather than sales-led: AI Now secures policy impact through government testimony, expert briefings, academic publishing, media coverage, and convening events such as its annual symposiums. Customer segments are policymakers and government bodies, civil society organizations, researchers and academics, and the general public — none of whom pay for the institute's outputs.

AI Now has no proprietary technology products. Its offering is a portfolio of research publications, policy briefs, symposiums, and policy toolkits. Leadership includes Co-Executive Directors Sarah Myers West and Amba Kak, Chief AI Scientist Dr. Heidy Khlaaf, and a small senior team. Recent activity indicates a deliberate expansion of scope into healthcare AI, data center governance, and global AI governance, accompanied by new partnerships with Aapti Institute, The Maybe, and continued engagement with the Electronic Frontier Foundation and NYU Law's Center on Race, Inequality, and the Law.

AI Now Institute firmographics

Firmographics
Name
AI Now Institute
Legal name
AI Now Institute
Website
https://ainowinstitute.org
Company type
Private
Founded year
2016
Operating status
Operating
Headcount range
1–10 employees
Short description
AI Now Institute is an independent nonprofit research institute at New York University that produces policy research on AI's social implications. It serves policymakers, civil society, researchers, and the public via annual reports, policy briefs, symposia, and government testimony.
Ownership category
akta.pro rank

AI Now Institute industry classification

Industry
Product category
AI Policy Research
NAICS
Research and Development in the Social Sciences and Humanities (54172)
akta.pro primary industry
AI Governance, Risk & Compliance (GRC) Platforms (HDAAAMAA)
akta.pro secondary industries
Regulatory Readiness & Audit Automation (e.g., EU AI Act, NIST AI RMF, ISO/IEC 42001) (HDAAAMAE), Responsible AI, AI Governance & Compliance Services (BPAEAHAJ)

Keywords

  • AI policy research
  • AI governance briefs
  • AI ethics reports
  • Algorithmic accountability
  • Public interest AI

Where AI Now Institute is headquartered

Location

Headquarters

HQ city
New York
HQ country
United States
HQ region
North America

Offices1 record

Markets served

AI Now Institute business model

Business model
GTM type
B2B
Offering type
Services
Cost components
Personnel, Operations, Marketing or Sales, Others

Revenue model

  1. Foundation Grants: AI Now Institute receives grants from foundations to support its research on AI safety, ethics, and governance. Recent grants include $10 million from the Hewlett Foundation as exploratory grants to support security of emerging technologies including AI.

Distribution channels3 records

Marketing channels7 records

AI Now Institute product offering

Product offering

Core offering

AI Now Institute is an independent nonprofit research institute at New York University that produces and freely publishes interdisciplinary research on the social implications of artificial intelligence. Its core offerings are research publications (annual landscape reports such as 'Artificial Power' and thematic reports like 'Uber for Nursing Part II'), policy toolkits (such as the North Star Data Center Policy Toolkit), and convening events (annual Symposiums and AI Summit series), targeted at policymakers, civil society, and the general public.

Product overview

AI Now Institute is an independent research institute at New York University dedicated to understanding the social implications of artificial intelligence. Rather than a unified software product, its offering is a portfolio of research publications, policy reports, annual landscape reports, and convening events (symposiums). The core products include the annual 'Artificial Power' landscape reports, thematic research series such as 'Reframing Impact: AI Summit 2026' and 'Uber for Nursing Part II,' policy tools like the Data Center Policy Toolkit, and annual symposium events. These publications address AI ethics, labor, bias, accountability, geopolitics, and governance across four core domains: labor and automation, bias and inclusion, rights and liberties, and safety and critical infrastructure.

Differentiator

Problem solved

Functional benefit

Products and services

  • Research Publications and Policy Reports Portfolio of annual landscape reports, research papers, policy briefs, and essays analyzing the social, political, and economic implications of AI. Freely available to policymakers, civil society, and the general public.
  • Annual Symposium Events Annual convenings bringing together experts from industry, academia, civil society, and government to discuss AI ethics, accountability, and social implications of AI technologies.
  • Uber for Nursing Part II Research publication examining gig nursing platforms that use algorithmic management systems to enable nurses to bid against each other for wages, with deregulation efforts documented in nearly half of all US states since 2022.
  • Artificial Power: 2025 Landscape Report Annual report mapping the current state of the AI market, interrogating the industry's key sources of power, and providing an actionable strategy to reclaim public agency over the future of AI.
  • Reframing Impact: AI Summit 2026 Series Collaborative essay and interview series with Aapti Institute and The Maybe addressing themes in AI and governance ahead of the 2026 India AI Impact Summit, including sovereignty, multilateralism, linguistic diversity, open source, accountability, democratization, AI for Good, Frugal AI, climate, and human capital.
  • North Star Data Center Policy Toolkit Policy toolkit providing state and local policy interventions to address AI data center expansion, including guidance on regulatory oversight.

Quantifiable outcome

  • Co-Executive Director Sarah Myers West testified before the U.S. Senate Banking Committee on AI risks to the economy
  • +4 more outcomes

Companies that use AI Now Institute

Customer profile

Segments4 records

Ideal customer profiles2 records

AI Now Institute technology and API

Technology

Technology focussed No

API detail

Has API
No
API docs
API detail

Core technology

AI maturity

App detail

AI Now Institute partnerships and signals

Strategic signal

Partnerships

Four partnerships are on record, tiered core and major.

  • Aapti InstitutecoreStrategic or Co-development Partner · 15 January 2026AI Now Institute partnered with Aapti Institute to produce the 'Reframing Impact: AI Summit 2026' series, bringing together advocates, builders, and thinkers from around the world to discuss AI governance and impact.
  • The MaybecoreStrategic or Co-development Partner · 15 January 2026AI Now Institute partnered with The Maybe to produce the 'Reframing Impact: AI Summit 2026' series, a collaboration focused on alternative framings of AI impact.
  • NYU Law's Center on Race, Inequality, and the LawmajorStrategic or Co-development Partner · 13 June 2018AI Now partnered with NYU Law's Center on Race, Inequality, and the Law to host the Litigating Algorithms Workshop, examining litigation strategies for challenging government use of algorithmic decision systems.
  • Electronic Frontier FoundationmajorStrategic or Co-development Partner · 13 June 2018AI Now partnered with the Electronic Frontier Foundation (EFF) to host the Litigating Algorithms Workshop examining current courtroom litigation where the use of algorithms by government was central to rights and liberties.

Recent moves7 records

Expansion highlights6 records

AI Now Institute competitors and assessment

Company assessment

Direct peers

  • Stanford Institute for Human-Centered Artificial Intelligence (HAI): Stanford HAI is a university-hosted AI policy and research institute that publishes major reports and influences US AI policy. It shares AI Now's orientation toward AI governance and social implications, though with a more industry-engaged posture.
  • Future of Life Institute: FLI is a nonprofit focused on AI safety, governance, and existential-risk policy with high-profile outreach to governments and international bodies. It overlaps directly with AI Now's policy advocacy and grants-driven nonprofit model.
  • Data & Society: Data & Society is an independent research institute studying the social implications of data-centric technologies. It is one of the closest direct comparables to AI Now in terms of research output, funding model, and policy orientation.
  • Partnership on AI: Partnership on AI is a multistakeholder nonprofit producing research and guidance on responsible AI. It overlaps with AI Now in governance research but operates with a more industry-collaborative stance.
  • Center for AI Safety (CAIS): CAIS is a research-focused nonprofit prioritizing AI safety and existential risk. It is comparable to AI Now as a grant-funded AI policy/safety research organization producing influential publications.
  • New America Open Technology Institute: OTI is a Washington-based think tank focused on technology policy, accountability, and civil liberties. It shares AI Now's policy-advocacy posture and produces reports and testimony on AI governance.

Regional players

  • Ada Lovelace Institute: Ada Lovelace Institute is a UK-based independent research body examining AI and data-driven technologies through a public-interest lens. It is highly comparable in mission and methodology but operates primarily outside the US.

Broad incumbents

  • Brookings Institution: Brookings is a large, established policy think tank with substantial AI governance research output. It overlaps with AI Now's policy influence goals but operates at significantly greater scale and across a much broader research agenda.
  • RAND Corporation: RAND is a major policy research institution that produces research on AI safety, security, and governance. It was a co-recipient of the $10M Hewlett exploratory grant alongside AI Now, signaling direct institutional competition for similar funding and policy influence.
  • Carnegie Endowment for International Peace: Carnegie is an established international affairs think tank with technology-policy programming. It overlaps with AI Now on AI governance, geopolitics, and multilateral engagement, and is also a co-recipient of the Hewlett $10M grant.

Market position

Strengths4 records

Weaknesses4 records

Competitive moat5 records

Key risks6 records

Key highlights7 records

Customer concentration

AI Now Institute social profiles

Digital presence

AI Now Institute financial estimates

Financial estimate

Revenue estimate

Valuation estimate

AI Now Institute leadership team

Management profile

Number of profiles

Profiles8 records

AI Now Institute funding detail

Funding detail

Funding overview

Funding rounds

Investors

Funding detail is available on the Subscription and Enterprise plan.Contact sales →

AI Now Institute M&A and investment

M&A and investment

M&A

Investments

M&A and investment is available on the Subscription and Enterprise plan.Contact sales →

Frequently asked questions about AI Now Institute

What does AI Now Institute do?

AI Now Institute is an independent nonprofit research institute at New York University that produces and freely publishes interdisciplinary research on the social implications of artificial intelligence. Its core offerings are research publications (annual landscape reports such as 'Artificial Power' and thematic reports like 'Uber for Nursing Part II'), policy toolkits (such as the North Star Data Center Policy Toolkit), and convening events (annual Symposiums and AI Summit series), targeted at policymakers, civil society, and the general public.

Is AI Now Institute a public or private company?

AI Now Institute is a private company. It is classified as nonprofit foundation owned and is currently operating.

When was AI Now Institute founded?

AI Now Institute was founded in 2016. It employs 1 to 10 people.

Where is AI Now Institute based?

AI Now Institute is headquartered in New York, United States, in the North America region.

How does AI Now Institute make money?

One revenue line is on record: foundation Grants.

Who are AI Now Institute's main competitors?

Direct peers on record are Stanford Institute for Human-Centered Artificial Intelligence (HAI), Future of Life Institute, Data & Society, Partnership on AI, Center for AI Safety (CAIS) and New America Open Technology Institute. Ada Lovelace Institute is listed as a regional player. Broad incumbents are Brookings Institution, RAND Corporation and Carnegie Endowment for International Peace.

Does AI Now Institute have an API?

No public API is recorded for AI Now Institute.

What industry is AI Now Institute in?

AI Now Institute's product category is AI Policy Research. Its primary akta.pro industry code is HDAAAMAA, AI Governance, Risk & Compliance (GRC) Platforms, with a secondary code of HDAAAMAE, Regulatory Readiness & Audit Automation (e.g., EU AI Act, NIST AI RMF, ISO/IEC 42001). Its NAICS code is 54172.

Unlock the full company data

50 free credits on sign-up, no credit card required.

Contact sales
Live signals
Pv-magazine-usaData center planning for local and state policymakersAlli Finn of AI Now Institute discussed data center expansion in a Clean Energy Group webinar, noting the U.S. holds 54% of global hyperscale capacity. She cited AI-driven growth, fossil-fuel reliance, and state subsidies, and recommended zoning restrictions and higher rates for large industrial users.Digital JournalAI security tools can be manipulated into running malware, researchers warnResearchers at the AI Now Institute developed a proof-of-concept attack called "Friendly Fire" that manipulates AI security tools into executing malicious code by embedding hidden instructions in software repository documentation. The attack successfully targeted Anthropic's Claude Code and OpenAI's Codex in their autonomous modes, exploiting the fact that AI agents treat all text in their context window as equally authoritative regardless of source. The research challenges the industry assumption that more capable AI systems are inherently safer, as the researchers found that advanced models proceeded with executing malicious code even after detecting inconsistencies.Cyber Security NewsCyber AI Agents Like Claude Code, GPT-5.5 Can Be Hijacked to Run Malicious Code RemotelySecurity researchers at the AI Now Institute have disclosed a new exploit called "Friendly Fire" that hijacks AI coding agents — specifically Anthropic's Claude Code CLI and OpenAI's Codex CLI — to execute attacker-controlled binaries during routine security reviews of third-party code. The attack exploits the default "auto-mode" and "auto-review" configurations by hiding malicious payloads inside documentation and decoy source files of open-source libraries, allowing the AI's safety classifier to consistently misjudge the malicious code as benign. The technique proved directly transferable between different AI systems without modification, suggesting the weakness is inherent to how frontier models distinguish trusted instructions from untrusted data, with real-world implications for supply-chain compromises like the Megalodon GitHub campaign and PyTorch Lightning breach.The Hacker NewsTop AI Agents Built to Catch Malicious Code Can Be Tricked Into Running ItThe AI Now Institute published a proof-of-concept attack called "Friendly Fire" demonstrating that Anthropic's Claude Code and OpenAI's Codex can be tricked into executing malicious code when running in autonomous mode, exploiting the very security-scanning task these tools are designed for. The attack plants a hidden binary inside a widely used open-source library and disguises it within a README.md file, bypassing config-file protections by relying on documentation rather than configuration files to trigger execution. Researchers argue the vulnerability is architectural rather than patchable, and warn it undermines the growing push — including a June US executive order — to deploy AI agents in defensive security roles before this gap is closed.PR NewswireHewlett Foundation President: Philanthropy Must Bridge AI Governance Gap Between Washington and Silicon ValleyHewlett Foundation President Amber D. Miller published an op-ed calling on philanthropy to bridge the AI governance gap between Washington and Silicon Valley, arguing that governments and industry cannot close this divide alone. The foundation recently announced $10 million in exploratory grants to support the security of emerging technologies including AI, biotechnology, and quantum computing, with major recipients including Stanford University's Hoover Institution and Vanderbilt University's Institute for National Security. The grants also went to organizations including AI Now Institute, Aspen Institute, Atlantic Council, Carnegie Endowment for International Peace, Council on Foreign Relations, Georgetown University, Global Network Initiative, Institute for Security and Technology, Observer Research Foundation America, RAND, and Sentinel Bio.AinowinstituteWhat’s the real cost of chasing AGI? Power consolidation is just the start, says the AI Now Institute.The AI Now Institute released the report 'Artificial Power' criticizing the social and political implications of AI industry growth, emphasizing power consolidation among AI companies. The report highlights the significant investments in AI infrastructure with limited accountability.TechCrunchWomen in AI: Amba Kak creates policy recommendations to address AI concernsAmba Kak, executive director of the AI Now Institute, discusses her work creating policy recommendations to address concerns surrounding artificial intelligence and its societal impacts. She highlights the institute's 2023 AI Landscape report and her previous role as a senior AI advisor at the Federal Trade Commission in shaping regulatory frameworks. The article emphasizes the need for civil society to challenge the concentration of power within the tech industry and advocate for public interest over corporate bottom lines.Business InsiderThe rise of AI will only make Big Tech more powerful, researchers warnAI Now Institute researchers warn that AI development is foundationally reliant on Big Tech's cloud resources, strengthening their power. The report highlights Big Tech's gatekeeper control and suggests data minimization and stronger antitrust enforcement to limit their dominance.Insider IntelligenceStartup Keen Technologies raises $20M to advance controversial AGIKeen Technologies, a startup founded by John Carmack, has raised $20 million in funding from investors including Stripe CEO Patrick Collison and Shopify CEO Tobi Lütke to advance its goal of developing artificial general intelligence. The project is described as controversial amidst a broader industry debate between rapid AI innovation and ethical safety concerns highlighted by groups like the NYU AI Now Institute. This development places Keen among approximately 72 global projects focused on creating human-like AI systems.BBCEmotion-detecting tech should be restricted by law - AI NowThe AI Now Institute called for new laws to restrict emotion-detecting technology, citing shaky foundations and lack of evidence. The sector could be worth $20bn, with systems used for hiring, law enforcement, and insurance. The institute urged bans on such software in important decisions affecting people's lives.