AI: Local AI & Model Types
Masked language models (MLM) & embeddings | Sri AI
Intermediate
3 views
Course overview
BERT-style models are small, fast and still the best tool for classification, entity extraction and semantic search.
Level: Intermediate · Mode: Evenings, online
Who this course is for
Developers building search, tagging and classification systems.
What you will learn
- Fine-tune a masked model for classification
- Extract names, places and dates from text
- Build semantic search with embeddings
- Pre-train a small masked model on local text
Syllabus
- Module 1: How masked language modelling works
- Module 2: Classification and named entities
- Module 3: Sentence embeddings
- Module 4: Semantic search
- Module 5: Training your own on Sinhala and Tamil
Final project
Every module ends in hands-on practice, and the course ends with a project you build and present. Your certificate names that project.
Before you start
Python for AI.