Developer docs
API playgroundTry for free, no card

Search company profiles

MIT-IBM Watson AI Lab

Full company profile

uuid00023z9

Namestring
MIT-IBM Watson AI Lab
Legal namestring
MIT-IBM Computing Research Lab
Company typeenum
Private
Founded yearint
2017
Descriptiontext

The MIT-IBM Watson AI Lab, rebranded on April 29, 2026 as the MIT-IBM Computing Research Lab, is a joint research collaboration between the Massachusetts Institute of Technology and IBM Research, established in 2017 with $240 million in IBM funding. The lab is physically located at 314 Main St., Cambridge, MA, within MIT's Schwarzman College of Computing, and operates with 101-250 researchers drawn from both institutions. Its research spans AI, algorithms, and quantum computing, targeting fundamental advances that can translate into practical applications at scale.

The lab's technical portfolio is anchored in multiple proprietary methodologies rather than commercial products. Notable outputs include EnergAIzer (a GPU power-consumption estimator achieving approximately 8% error in seconds), a Neighborhood Consistency technique for pre-deployment foundation model reliability assessment, an expressive LLM architecture that outperforms RoPE on long-text state tracking, an LLMFP planning framework achieving 85% task success, and a vision-language training method for personalized object localization using curated video-tracking data. Capabilities span natural language processing, computer vision, multimodal AI, predictive analytics, anomaly detection, and synthetic data generation for ML training.

The lab is not a commercial enterprise and has no revenue model, pricing structure, or paying customers. It is jointly funded and governed by MIT and IBM Research, with outputs disseminated through academic publications, conference presentations, open-source releases, and technology transfers to IBM's commercial operations (including Watson). Its sole "customer segments" are the academic and industrial research communities at MIT and IBM, with no enterprise or consumer-facing distribution.

Short descriptiontext

The MIT-IBM Watson AI Lab (rebranded MIT-IBM Computing Research Lab in April 2026) is a joint MIT-IBM Research collaboration in Cambridge, MA, conducting fundamental AI, algorithms, and quantum computing research and disseminating outputs through academic publications and technology transfer to IBM.

Operating statusenum
Operating
Ownership categoryenum
Headcount rangeband
101–250
akta.pro rankint
HeadquartersCambridge, United States
HQ citystring
Cambridge
HQ countrystring
United States
HQ regionstring
North America
Markets served

Serves global market

Offices1 record

Each record includes

City, Country, Type, Description, Source

Keyword5 values
artificial intelligence research, machine learning research, quantum computing research, foundation model development, computer vision research
Industry5 codes
PRIMARYBPAEAHAF
AI/ML Engineering & Model Development Services
SECONDARYHDAEANAF
AI Observability, Monitoring & Evaluation Platforms (Drift, Quality, Safety)
Hardware, Technology & Telecom/Enterprise Platforms & Databases/Artificial Intelligence Platforms for Enterprise
SECONDARYHDAAAAAI
AI Compiler, Runtime & Kernel Optimization Software (CUDA/ROCm/XLA, graph compilers)
Hardware, Technology & Telecom/Artificial Intelligence & Machine Learning/AI Infrastructure & Compute (GPUs/ASICs, accelerators)
SECONDARYEDAHAEAK
Technical Universities with Computing, Data & AI Focus
Education/Higher Education (Colleges & Universities)/Technical & Polytechnic Universities
SECONDARYEDAIABAC
Research Collaboration & Joint Labs (International Partnerships)
Education/International Education & Study Abroad/University/College Exchange Programs & Partnerships
NAICS code3 codes
  • Research and Development in the Physical, Engineering, and Life Sciences (except Nanotechnology and Biotechnology)541715
  • Other Scientific and Technical Consulting Services541690
  • Computer Systems Design and Related Services54151
SIC code2 codes
  • Services-Commercial Physical & Biological Research8731
  • Services-Computer Programming Services7371
Product category
AI Research Collaboration
Social media profiles2 records
Marketing channels4 records

Each record includes

Title, Type, Stage, Description, Source

Distribution channels1 record

Each record includes

Title, Type, Scope, Target buyer, Description, Source

Cost components4 values
Personnel, Technology or R&D, Infrastructure, Operations
GTM typeB2B
B2B
Offering typeServices
Services
Core offering1 text field

The MIT-IBM Watson AI Lab (now MIT-IBM Computing Research Lab) is a joint research collaboration between MIT and IBM Research that conducts fundamental research in AI, algorithms, and quantum computing. It does not sell commercial products or services; instead it produces research publications, open-source tools, and proprietary techniques (such as EnergAIzer, Neighborhood Consistency, and novel LLM architectures) that are transferred to IBM's commercial operations and the broader research community.

Differentiator
Functional benefit
Problem solved
Quantifiable outcome1 of 2 values shown
  • The EnergAIzer tool achieved approximately 8% error rate in power consumption estimation, comparable to slower conventional approaches
+1 more record
Product overview1 text field

MIT-IBM Watson AI Lab (now officially renamed MIT-IBM Computing Research Lab) is a research collaboration between MIT and IBM that advances the frontiers of computation through research spanning AI, algorithms, and quantum computing. The lab focuses on developing new paradigms and methods that drive scientific discovery and create impact at scale. As a research institution, it does not offer commercial products or services; instead, it produces research publications, tools, and methodologies that contribute to the broader AI and computing research community. The lab supports early-career faculty at MIT by providing resources and collaborative opportunities to boost AI research.

Partnership2 partners
Strategic tierCoreTypeStrategic or Co-development PartnerAnnounced on2017-01-01
Description

MIT and IBM established the MIT-IBM Watson AI Lab (now MIT-IBM Computing Research Lab) as a major collaborative research initiative. The partnership combines MIT's academic research excellence with IBM's industrial research capabilities to advance AI, algorithms, and quantum computing. The lab is located at MIT in Cambridge, MA and is part of the MIT Schwarzman College of Computing. The collaboration provides MIT researchers and IBM scientists with shared resources, facilities, and collaborative opportunities for cutting-edge AI research.

Strategic tierCoreTypeStrategic or Co-development Partner
Description

IBM Research is the industrial research division of IBM and co-founder of the MIT-IBM Computing Research Lab. IBM provides computational resources, data assets, and industry expertise to support collaborative research projects with MIT faculty and students. Research outcomes are translated into IBM's commercial products and services, including Watson AI technologies.

Recent move6 records

Each record includes

Date, Type, Title, Description, Source

Expansion highlight4 records

Each record includes

Type, Description

Peers10 records
TypeEmerging player
Description

AI safety and frontier-model research company producing foundational AI research. Comparable in research culture and output orientation, though with a commercial product focus.

TypeDirect peer
Description

MIT's flagship computer science and AI research lab, sharing overlapping faculty and research domains with the MIT-IBM Watson AI Lab. Both operate within MIT and publish in the same core AI venues.

TypeDirect peer
Description

Co-parent of the lab and the broader industrial research arm of IBM. Shares researchers, infrastructure, and research themes including AI, algorithms, and quantum computing.

TypeBroad incumbent
Description

Industrial research arm of NVIDIA with deep focus on GPU-accelerated AI and energy-efficient compute, directly overlapping with EnergAIzer-class research from the MIT-IBM Watson AI Lab.

TypeEmerging player
Description

Non-profit AI research institute focused on foundational AI research including NLP, computer vision, and reasoning. Comparable as a research-output-oriented lab rather than a commercial entity.

6BAIR (Berkeley AI Research)
TypeRegional player
Description

UC Berkeley's AI research lab conducting fundamental AI research across deep learning, robotics, and NLP. Comparable as a top-tier academic AI research counterpart.

TypeDirect peer
Description

Premier industry AI research lab conducting fundamental research on foundation models, reasoning, and AI safety. Directly competes for talent, publications, and influence in core AI research.

TypeBroad incumbent
Description

Large industrial research organization with broad AI, systems, and quantum computing programs. Operates at much larger scale than the MIT-IBM Watson AI Lab across overlapping topics.

TypeRegional player
Description

Stanford's flagship AI research group, comparable in academic stature to MIT but geographically distinct. Operates with similar academia-industry collaboration models.

TypeDirect peer
Description

Meta's Fundamental AI Research lab publishes open research in LLMs, computer vision, and multimodal AI. A leading industrial AI research peer with comparable publication output.

Market position
Strengths4 records

Each record includes

Headline, Details, Source

Weaknesses4 records

Each record includes

Headline, Details, Source

Competitive moat4 records

Each record includes

Type, Details

Key risks5 records

Each record includes

Headline, Details, Source

Key highlights6 records

Each record includes

Headline, Details, Source

Customer concentration

Classification, Details

Segment1 record

Each record includes

Title, Type, Primary, Description, Pain point addressed, Use case, Source

Ideal customer profile1 record

Each record includes

Profile, Firmographic size, Sales motion, Sales cycle length, Buying structure, Purchase trigger, Buyer persona, Geography, Industry vertical, Primary use case, Description, Pain points, Evidence proof points, Target buyer

API detail
Has APIbool
No

Docs URL, Description

AI capability9 records

Each record includes

Type, Description, Source

AI maturity
App detail

Has app

Feature6 records

Each record includes

Title, Differentiator, Description, Source

Core technology
Revenue estimate
Valuation estimate
Number of profiles
No data
No data
Funding overview

Funding stage, Last funding date, Total funding USD

Funding rounds1 record

Each record includes

Round, Amount USD, Date, Pre money valuation, Total investors, Investors, News

Investors1 record

Each record includes

Name, Type, Date of entry, Rounds participated, Website

Funding detail is available on the Subscription and Enterprise plan.Contact sales →

M&A

Each record includes

Name, Acquisition type, Announced date, Completed date, Status, Website, News

Investment

Each record includes

Name, Round, Announced date, Lead investor, Website, News

M&A and investment is available on the Subscription and Enterprise plan.Contact sales →

MIT-IBM Watson AI Lab

AI Research Collaborationmitibmwatsonailab.mit.edu

The MIT-IBM Watson AI Lab (rebranded MIT-IBM Computing Research Lab in April 2026) is a joint MIT-IBM Research collaboration in Cambridge, MA, conducting fundamental AI, algorithms, and quantum computing research and disseminating outputs through academic publications and technology transfer to IBM.

What MIT-IBM Watson AI Lab does

The MIT-IBM Watson AI Lab, rebranded on April 29, 2026 as the MIT-IBM Computing Research Lab, is a joint research collaboration between the Massachusetts Institute of Technology and IBM Research, established in 2017 with $240 million in IBM funding. The lab is physically located at 314 Main St., Cambridge, MA, within MIT's Schwarzman College of Computing, and operates with 101-250 researchers drawn from both institutions. Its research spans AI, algorithms, and quantum computing, targeting fundamental advances that can translate into practical applications at scale.

The lab's technical portfolio is anchored in multiple proprietary methodologies rather than commercial products. Notable outputs include EnergAIzer (a GPU power-consumption estimator achieving approximately 8% error in seconds), a Neighborhood Consistency technique for pre-deployment foundation model reliability assessment, an expressive LLM architecture that outperforms RoPE on long-text state tracking, an LLMFP planning framework achieving 85% task success, and a vision-language training method for personalized object localization using curated video-tracking data. Capabilities span natural language processing, computer vision, multimodal AI, predictive analytics, anomaly detection, and synthetic data generation for ML training.

The lab is not a commercial enterprise and has no revenue model, pricing structure, or paying customers. It is jointly funded and governed by MIT and IBM Research, with outputs disseminated through academic publications, conference presentations, open-source releases, and technology transfers to IBM's commercial operations (including Watson). Its sole "customer segments" are the academic and industrial research communities at MIT and IBM, with no enterprise or consumer-facing distribution.

MIT-IBM Watson AI Lab firmographics

Firmographics
Name
MIT-IBM Watson AI Lab
Legal name
MIT-IBM Computing Research Lab
Website
https://mitibmwatsonailab.mit.edu
Company type
Private
Founded year
2017
Operating status
Operating
Headcount range
101–250 employees
Short description
The MIT-IBM Watson AI Lab (rebranded MIT-IBM Computing Research Lab in April 2026) is a joint MIT-IBM Research collaboration in Cambridge, MA, conducting fundamental AI, algorithms, and quantum computing research and disseminating outputs through academic publications and technology transfer to IBM.
Ownership category
akta.pro rank

MIT-IBM Watson AI Lab industry classification

Industry
Product category
AI Research Collaboration
NAICS
Research and Development in the Physical, Engineering, and Life Sciences (except Nanotechnology and Biotechnology) (541715), Other Scientific and Technical Consulting Services (541690), Computer Systems Design and Related Services (54151)
SIC
Services-Commercial Physical & Biological Research (8731), Services-Computer Programming Services (7371)
akta.pro industry
PRIMARYBPAEAHAF
AI/ML Engineering & Model Development Services
SECONDARYHDAEANAF
AI Observability, Monitoring & Evaluation Platforms (Drift, Quality, Safety)
Hardware, Technology & Telecom/Enterprise Platforms & Databases/Artificial Intelligence Platforms for Enterprise
SECONDARYHDAAAAAI
AI Compiler, Runtime & Kernel Optimization Software (CUDA/ROCm/XLA, graph compilers)
Hardware, Technology & Telecom/Artificial Intelligence & Machine Learning/AI Infrastructure & Compute (GPUs/ASICs, accelerators)
SECONDARYEDAHAEAK
Technical Universities with Computing, Data & AI Focus
Education/Higher Education (Colleges & Universities)/Technical & Polytechnic Universities
SECONDARYEDAIABAC
Research Collaboration & Joint Labs (International Partnerships)
Education/International Education & Study Abroad/University/College Exchange Programs & Partnerships

Keywords

  • Artificial intelligence research
  • Machine learning research
  • Quantum computing research
  • Foundation model development
  • Computer vision research

Where MIT-IBM Watson AI Lab is headquartered

Location

Headquarters

HQ city
Cambridge
HQ country
United States
HQ region
North America

Offices1 record

Markets served

MIT-IBM Watson AI Lab business model

Business model
GTM type
B2B
Offering type
Services
Cost components
Personnel, Technology or R&D, Infrastructure, Operations

Distribution channels1 record

Marketing channels4 records

MIT-IBM Watson AI Lab product offering

Product offering

Core offering

The MIT-IBM Watson AI Lab (now MIT-IBM Computing Research Lab) is a joint research collaboration between MIT and IBM Research that conducts fundamental research in AI, algorithms, and quantum computing. It does not sell commercial products or services; instead it produces research publications, open-source tools, and proprietary techniques (such as EnergAIzer, Neighborhood Consistency, and novel LLM architectures) that are transferred to IBM's commercial operations and the broader research community.

Product overview

MIT-IBM Watson AI Lab (now officially renamed MIT-IBM Computing Research Lab) is a research collaboration between MIT and IBM that advances the frontiers of computation through research spanning AI, algorithms, and quantum computing. The lab focuses on developing new paradigms and methods that drive scientific discovery and create impact at scale. As a research institution, it does not offer commercial products or services; instead, it produces research publications, tools, and methodologies that contribute to the broader AI and computing research community. The lab supports early-career faculty at MIT by providing resources and collaborative opportunities to boost AI research.

Differentiator

Problem solved

Functional benefit

Quantifiable outcome

  • The EnergAIzer tool achieved approximately 8% error rate in power consumption estimation, comparable to slower conventional approaches
  • +1 more outcomes

Companies that use MIT-IBM Watson AI Lab

Customer profile

Segments1 record

Ideal customer profiles1 record

MIT-IBM Watson AI Lab technology and API

Technology

API detail

Has API
No
API docs
API detail

Core technology

AI maturity

App detail

AI capability9 records

Feature6 records

MIT-IBM Watson AI Lab partnerships and signals

Strategic signal

Partnerships

Two partnerships are on record, tiered core.

  • Massachusetts Institute of Technology (MIT)coreStrategic or Co-development Partner · 1 January 2017MIT and IBM established the MIT-IBM Watson AI Lab (now MIT-IBM Computing Research Lab) as a major collaborative research initiative. The partnership combines MIT's academic research excellence with IBM's industrial research capabilities to advance AI, algorithms, and quantum computing. The lab is located at MIT in Cambridge, MA and is part of the MIT Schwarzman College of Computing. The collaboration provides MIT researchers and IBM scientists with shared resources, facilities, and collaborative opportunities for cutting-edge AI research.
  • IBM ResearchcoreStrategic or Co-development PartnerIBM Research is the industrial research division of IBM and co-founder of the MIT-IBM Computing Research Lab. IBM provides computational resources, data assets, and industry expertise to support collaborative research projects with MIT faculty and students. Research outcomes are translated into IBM's commercial products and services, including Watson AI technologies.

Recent moves6 records

Expansion highlights4 records

MIT-IBM Watson AI Lab competitors and assessment

Company assessment

Emerging players

  • Anthropic: AI safety and frontier-model research company producing foundational AI research. Comparable in research culture and output orientation, though with a commercial product focus.
  • Allen Institute for AI (AI2): Non-profit AI research institute focused on foundational AI research including NLP, computer vision, and reasoning. Comparable as a research-output-oriented lab rather than a commercial entity.

Direct peers

  • MIT CSAIL: MIT's flagship computer science and AI research lab, sharing overlapping faculty and research domains with the MIT-IBM Watson AI Lab. Both operate within MIT and publish in the same core AI venues.
  • IBM Research: Co-parent of the lab and the broader industrial research arm of IBM. Shares researchers, infrastructure, and research themes including AI, algorithms, and quantum computing.
  • Google DeepMind: Premier industry AI research lab conducting fundamental research on foundation models, reasoning, and AI safety. Directly competes for talent, publications, and influence in core AI research.
  • Meta AI (FAIR): Meta's Fundamental AI Research lab publishes open research in LLMs, computer vision, and multimodal AI. A leading industrial AI research peer with comparable publication output.

Broad incumbents

  • NVIDIA Research: Industrial research arm of NVIDIA with deep focus on GPU-accelerated AI and energy-efficient compute, directly overlapping with EnergAIzer-class research from the MIT-IBM Watson AI Lab.
  • Microsoft Research: Large industrial research organization with broad AI, systems, and quantum computing programs. Operates at much larger scale than the MIT-IBM Watson AI Lab across overlapping topics.

Regional players

  • BAIR (Berkeley AI Research): UC Berkeley's AI research lab conducting fundamental AI research across deep learning, robotics, and NLP. Comparable as a top-tier academic AI research counterpart.
  • Stanford AI Lab (SAIL): Stanford's flagship AI research group, comparable in academic stature to MIT but geographically distinct. Operates with similar academia-industry collaboration models.

Market position

Strengths4 records

Weaknesses4 records

Competitive moat4 records

Key risks5 records

Key highlights6 records

Customer concentration

MIT-IBM Watson AI Lab social profiles

Digital presence

MIT-IBM Watson AI Lab financial estimates

Financial estimate

Revenue estimate

Valuation estimate

MIT-IBM Watson AI Lab leadership team

Management profile

Number of profiles

MIT-IBM Watson AI Lab funding detail

Funding detail

Funding overview

Funding rounds1 record

Investors1 record

Funding detail is available on the Subscription and Enterprise plan.Contact sales →

MIT-IBM Watson AI Lab M&A and investment

M&A and investment

M&A

Investments

M&A and investment is available on the Subscription and Enterprise plan.Contact sales →

Frequently asked questions about MIT-IBM Watson AI Lab

What does MIT-IBM Watson AI Lab do?

The MIT-IBM Watson AI Lab (now MIT-IBM Computing Research Lab) is a joint research collaboration between MIT and IBM Research that conducts fundamental research in AI, algorithms, and quantum computing. It does not sell commercial products or services; instead it produces research publications, open-source tools, and proprietary techniques (such as EnergAIzer, Neighborhood Consistency, and novel LLM architectures) that are transferred to IBM's commercial operations and the broader research community.

Is MIT-IBM Watson AI Lab a public or private company?

MIT-IBM Watson AI Lab is a private company. It is classified as corporate owned and is currently operating.

When was MIT-IBM Watson AI Lab founded?

MIT-IBM Watson AI Lab was founded in 2017. It employs 101 to 250 people.

Where is MIT-IBM Watson AI Lab based?

MIT-IBM Watson AI Lab is headquartered in Cambridge, United States, in the North America region.

Who are MIT-IBM Watson AI Lab's main competitors?

Emerging players on record are Anthropic and Allen Institute for AI (AI2). Direct peers are MIT CSAIL, IBM Research, Google DeepMind and Meta AI (FAIR). Broad incumbents are NVIDIA Research and Microsoft Research. Regional players are BAIR (Berkeley AI Research) and Stanford AI Lab (SAIL).

Does MIT-IBM Watson AI Lab have an API?

No public API is recorded for MIT-IBM Watson AI Lab.

What industry is MIT-IBM Watson AI Lab in?

MIT-IBM Watson AI Lab's product category is AI Research Collaboration. Its primary akta.pro industry code is BPAEAHAF, AI/ML Engineering & Model Development Services, with a secondary code of HDAEANAF, AI Observability, Monitoring & Evaluation Platforms (Drift, Quality, Safety). Its NAICS code is 541715 and its SIC code is 8731.

Unlock the full company data

50 free credits on sign-up, no credit card required.

Contact sales
Live signals
36krMIT and IBM Propose ChartNet: World's Largest Synthetic Chart Dataset with 1.5M Diverse Chart SamplesMIT and IBM researchers proposed ChartNet, a multimodal dataset with 1.5 million synthetic chart samples covering 24 chart types and 6 plotting libraries. Fine-tuning on ChartNet outperforms larger models and GPT-4o on chart reconstruction, data extraction, and summarization tasks. The dataset is available online and will be presented at CVPR.MITJustin Solomon appointed associate dean of engineering educationJustin Solomon, associate professor in MIT's Department of Electrical Engineering and Computer Science, has been appointed associate dean of engineering education at the MIT School of Engineering, effective July 1. In this role, he will focus on advancing innovation in engineering education, integrating AI into curricula, and building industry collaborations for experiential learning. Solomon brings extensive experience in computing education and geometry research, having previously led the Geometric Data Processing Group at CSAIL and serving as core faculty at the MIT-IBM Watson AI Lab.MITA faster way to estimate AI power consumptionResearchers from MIT and the MIT-IBM Watson AI Lab have developed a rapid prediction tool called EnergAIzer that estimates power consumption for AI workloads on GPUs in data centers, producing estimates in seconds rather than the hours or days required by traditional methods. The tool achieved approximately 8% error rate in testing—comparable to slower conventional approaches—while also being applicable to emerging hardware configurations not yet deployed. Data center operators and algorithm developers could use these estimates to improve energy efficiency and assess potential consumption before deploying new AI models.MITMIT-IBM Watson AI Lab seed to signal: Amplifying early-career faculty impactThe MIT-IBM Watson AI Lab has provided critical support to early-career MIT faculty researchers in artificial intelligence, helping them establish research groups and pursue ambitious projects. Faculty members including Jacob Andreas, Yoon Kim, Justin Solomon, Chuchu Fan, and Faez Ahmed credit the collaboration with providing computing resources, expertise, and intellectual partnerships that shaped their research trajectories in NLP, robotics, and machine learning. The collaboration enables the fusion of academic and industry expertise to advance AI research and develop methods for real-world applications.TrendHunter.comAdaptive Reasoning ModelsMIT researchers introduced an instance-adaptive scaling method for large language models that dynamically adjusts reasoning computation based on query difficulty, backed by the MIT-IBM Watson AI Lab, MIT-Amazon Science Hub, MIT-Google Program for Computing Innovation, and MathWorks. Testing reportedly showed approximately 50% reduction in compute usage while maintaining similar response quality, with performance gains also observed on smaller LLMs. The technique points toward faster, more cost-effective AI services with lower energy demands and enables more compact systems to handle complex tasks.MITA new way to increase the capabilities of large language modelsMIT-IBM Watson AI Lab researchers have developed an expressive architecture for large language models that provides improved state tracking and sequential reasoning capabilities over long texts. The new approach reportedly outperforms RoPE, the current state-of-the-art method, addressing challenges in tracking state changes such as object interactions and transformations over time. This research represents an advancement in LLM architecture designed to help models maintain coherent understanding of evolving scenarios in extended texts.KeymakrTraining Machine Learning Models with Synthetic DataResearchers at MIT, the MIT-IBM Watson AI Lab, and Boston University demonstrated the use of synthetic data to train machine-learning models, achieving better performance than models trained on real data. Synthetic data generation helps overcome challenges related to data scarcity, privacy, bias, and costs in AI development.MarkTechPostFallacy Failure Attack: A New AI Method for Exploiting Large Language Models’ Inability to Generate Deceptive ReasoningResearchers from the University of Illinois Chicago and MIT-IBM Watson AI Lab introduced the Fallacy Failure Attack, which exploits LLMs' inability to generate deceptive reasoning. The attack achieved success rates of 88% against GPT-3.5 and 73.8% against GPT-4, while LLaMA-3 resisted with only 24.4% success. Existing defenses like perplexity filtering and paraphrasing were largely ineffective.MITHow to assess a general-purpose AI model’s reliability before it’s deployedResearchers from MIT and the MIT-IBM Watson AI Lab have developed a technique to estimate the reliability of foundation models before they are deployed to specific tasks, addressing the risk of incorrect or misleading outputs in safety-critical applications. The method involves training an ensemble of slightly different models and using an algorithm to assess the consistency of their abstract representations for the same data points. The approach, called neighborhood consistency, could help users evaluate model reliability without requiring access to real-world datasets, making it potentially useful in privacy-sensitive sectors like healthcare.URL ShortenerCovering Scientific & Technical AIResearchers at MIT-IBM Watson AI Lab developed a machine learning model to detect power grid anomalies using data from hundreds of thousands of synchrophasor sensors. The model uses a normalizing flow and Bayesian network to identify low-probability events without annotated data. It can adapt to new sensor data and may be scaled for other complex data applications.