AI Project: Train on Your Own Data (Loading Local Files with datasets)
So far, we’ve used load_dataset to pull pre-made datasets (like “imdb“) from the Hugging Face Hub. But the real power is training an AI on…
A Deep Dive into Hugging Face Tokenizers (WordPiece & BPE)
We’ve used tokenizers to prepare data for AI models. But how do they work? If you’re interested in a deeper understanding, we’ll explore how Hugging…
AI Project: Named Entity Recognition (NER) with Hugging Face
This is a core task in Natural Language Processing (NLP). When it comes to extracting entities from text, Hugging Face NER has become a popular…
AI Project: How to Translate Text with Hugging Face
You’ve used Hugging Face to understand text, generate it, and even transcribe audio. Now, let’s use it to break the language barrier with Hugging Face…
High-Performance NLP: Pre-processing Text with Polars (2026 Guide)
When preparing text data for an AI model, you’re often working with millions of rows. For this reason, many practitioners are interested in Polars NLP…
