Le meilleur du dev et de l'IA, scoré chaque jour par un agent. Filtré, résumé, classé. Aucune couleur, aucun bruit — juste la matière.
Hugging Face is refreshing its NLP course into The LLM Course, adding chapters on fine-tuning, inference, and retrieval while retaining core NLP topics. It emphasizes open-source collaboration, community inputs, and interactive exercises with live sessions when beneficial. Materials will align with transformers, Spaces, and the Hugging Face Hub, inviting contributors.
Serving LLMs to many users in parallel is challenging due to GPU contention. The proposed fix is fair scheduling at the LLM-Server with per-user queues and a round-robin scheduler, preserving order before reaching the backend. Extensions include KV-cache-aware routing and back-end priority ideas.
Hugging Face faced increasing secret sprawl across AWS, Azure, and GCP and replaced Vault with Infisical for centralized, developer-friendly secrets management. They integrated Infisical with Terraform and the Kubernetes Operator to auto-sync updates via an InfisicalSecret CRD, enabling automatic secret reloads in deployments and tighter RBAC with SSO. The migration also restructured projects into distinct infrastructure and application domains to standardize rotation and support IaC practices.
Text Generation Inference intègre désormais le support Gaudi d'Intel directement dans TGI, avec une architecture multi-backend et compatibilité Gaudi1/2/3. L'article présente les bénéfices (diversité matérielle, coût, production-ready features) et liste les modèles optimisés (Llama 3.x, Mistral, Mixtral) et donne un démarrage rapide (Docker + exemple curl) pour lancer TGI sur Gaudi. Il mentionne aussi le FP8 via Intel Neural Compressor et invite à tester et contribuer.
DeepSeek publie Open R1: Update #4, version améliorée de DeepSeek-V3 avec licence MIT et de meilleures capacités d’instruction et de code. Les benchmarks montrent des gains (MMLU-Pro 81.2, GPQA 68.4, AIME 59.4, LiveCodeBench 49.2) et des progrès en développement web, écriture chinoise et appel de fonctions. Utilisation via Inference Providers (Fireworks, Hyperbolic, Novita) et Text Generation Inference, avec des spéculations sur le finetuning (pré-entraînement et post-formation).
This blogpost shows how to finetune a reranker (Cross Encoder) with Sentence Transformers for domain-specific retrieval, detailing datasets, loss functions, training arguments, evaluators, and the trainer. It demonstrates that small, domain-tuned models can outperform public rerankers and scale with larger bases, in a two-stage retrieve-and-rerank setup.
Gradio released a major update to gr.Dataframe, adding multi-cell selection, row numbers, pinned columns, and new UI controls like a copy button and fullscreen view. The update also improves accessibility, styling, and supports static columns, search, and filtering for more intuitive data exploration. Gradio notes 70 issues resolved in six weeks and provides upgrade instructions and a quick example to get started.
The article introduces updates to the Inference Endpoints analytics dashboard, highlighting real-time metrics, faster data loading, and customizable time ranges with auto-refresh. It also adds a replica lifecycle view to monitor state transitions across multiple replicas, aiding monitoring and debugging. Feedback is invited as the features evolve.
The post explains how to run OlympicCoder-7B locally using LM Studio and a VS Code extension. It walks through installing LM Studio, loading OlympicCoder-7B (4-bit GGUF), and wiring LM Studio to VS Code with Continue.dev, enabling code completion, generation, explanation, and tests. OlympicCoder is open-source and optimized on the CodeForces-CoTs dataset, not a Claude-like assistant.
Hugging Face submitted its response to the White House AI Action Plan, arguing that open models and open science are foundational to AI success. They propose three recommendations: recognize open source as fundamental, prioritize efficiency and reliability to enable broad adoption, and secure AI through open, traceable, and transparent systems. They illustrate with examples like OlympicCoder beating Claude 3.7 with 7B parameters and open OLMo 2 models.
Xet migration moved roughly 6% of Hugging Face Hub download traffic to Xet storage, validating the architecture under real-world usage. Unlike LFS that deduplicates at the file level, Xet uses content-defined chunking (~64 KB) to deduplicate at the byte level, so edits affect only changed chunks and large files transfer faster. The system combines a Xet-aware client, a content-addressed store with an LFS bridge, and S3 for final storage, all geared toward production readiness.
At GTC 2025, NVIDIA unveiled three open-source releases for physical AI: Cosmos Transfer (a 7B World Foundation Model with multicontrols for controllable world scenes), the Open Physical AI Dataset, and Isaac GR00T N1, the first open humanoid-reasoning foundation model. Cosmos Transfer uses per-sensor ControlNets and adaptive spatiotemporal maps to generate photorealistic sequences with controllable layout and motion.
Gemma 3 is Google's open, multimodal LLM family released in 1B, 4B, 12B, and 27B variants with up to 128k context and support for 140+ languages. The 4B/12B/27B models are multimodal (images+text) using SigLIP, with pan-and-scan inference and memory-optimized KV cache; the 1B remains text-only. It can also be used as a text-only LLM by omitting the vision encoder.
Open R1: Update #3 reports progress on reproducing the code-reasoning aspects of DeepSeek-R1, including a new CodeForces-CoTs dataset with ~100k samples in C++ and Python. It introduces the IOI benchmark and OlympicCoder models (7B and 32B), showing that training on CodeForces-CoTs yields top-tier performance, with OlympicCoder-32B outperforming several open-weight models. The post also covers dataset construction, benchmarks, and practical tips for scaling and prompting, such as prefilling with
L2D is introduced as the world's largest multimodal self-driving dataset (90+ TB, 5000+ hours, 30 cities). It provides expert and student driving policies with natural language instructions and future waypoints, enabling end-to-end training of automotive AI and inviting community contributions.
This tutorial shows how to run LLMs on-device via a React Native app, downloading GGUF models from Hugging Face and loading them with llama.rn (llama.cpp). It covers model sizing and quantization formats (Q4_0, Q3_K, IQ2_XXS, etc.), and outlines a complete app workflow from environment setup to debugging, all aimed at offline, privacy-preserving mobile AI.
Cohere's Aya Vision unveils 8B and 32B multilingual vision-language models for 23 languages, with strong results on AyaVisionBench and mWildVision. It uses synthetic annotations, multilingual data expansion, and model merging, and handles high-res images via dynamic tiling and Pixel Shuffle downsampling before the vision-language connector and LLM. Training is in two stages: vision-language alignment with frozen encoders, then supervised fine-tuning across multilingual tasks.
Hugging Face and JFrog announce a security partnership to integrate JFrog's scanner into the Hugging Face Hub, reducing false positives by analyzing code inside model weights rather than relying on pattern matching. The collaboration targets risks from serialization formats like pickle that can enable code execution, and all public repos will be scanned automatically as you push.
Cet article présente Arize Phoenix pour tracer, évaluer et déboguer les agents IA en temps réel. Il démontre comment activer le tracing via OpenTelemetry et OpenInference, et propose des étapes concrètes pour installer smolagents, configurer un agent et lancer des tests. Des extraits de code et d’utilisation servent de guide pratique pour améliorer la traçabilité et la performance.
Hugging Face and IISc/ARTPARK partner to enable access to Vaani, India's diverse open-source, multi-modal dataset. Vaani targets 54 languages, 150k hours of speech and 15k hours of transcribed data from about 1 million people across 773 districts, with Phase 1 already open-sourced and Phase 2 expanding reach. This dataset supports ASR, TTS, language identification, and speaker verification, empowering robust Indic-language models and code-switching applications.