The National Institute of Standards and Technology has issued new guidance aimed at strengthening the statistical validity of ...

Large language models (LLMs), artificial intelligence (AI) systems that can process human language and generate texts in ...

Researchers debut "Humanity’s Last Exam," a benchmark of 2,500 expert-level questions that current AI models are failing.

Tabuga orchestrates Dominican participation in the first Latin American artificial intelligence model LatamGPT will ...

MLCommons today released AILuminate, a new benchmark test for evaluating the safety of large language models. Launched in 2020, MLCommons is an industry consortium backed by several dozen tech firms.

As large language models (LLMs) continue to improve at coding, the benchmarks used to evaluate their performance are steadily becoming less useful. That's because though many LLMs have similar high ...

Capable of reasoning, designed for voice, and fluent in Indian languages, the model would be ready for population-scale deployment ...

Backboard.io announced it has achieved state-of-the-art performance across both leading AI memory benchmarks, a first ...

Identifying vulnerabilities is good for public safety, industry, and the scientists making these models.

The new Mercury 2 AI model uses diffusion reasoning to generate 1,000 tokens per second; it runs about 5x faster than Haiku, speed limits are ...