Fedor Pakhurov
RUGitHub ↗
Menu

Course / 01

Natural Language Processing

A structured path from text fundamentals to modern LLM systems and evaluation.

7 sections2 published notes∞ permanent URLs

Available now

Published notes

  1. 01Self-AttentionTransformersRead →
  2. 02Transformer ArchitectureTransformersRead →
  1. 01

    Foundations

    • Text preprocessingPlanned
    • TokenizationPlanned
    • CorporaPlanned
    • EvaluationPlanned
  2. 02

    Classical NLP

    • Bag of WordsPlanned
    • TF-IDFPlanned
    • N-gramsPlanned
    • Language modelsPlanned
  3. 03

    Representations

    • Word2VecPlanned
    • GloVePlanned
    • FastTextPlanned
    • Contextual embeddingsPlanned
  4. 04

    Neural NLP

    • RNNPlanned
    • LSTM / GRUPlanned
    • Seq2SeqPlanned
    • AttentionPlanned
  5. 05

    Transformers

  6. 06

    Modern LLM Systems

    • Instruction tuningPlanned
    • RAGPlanned
    • Tool usePlanned
    • AgentsPlanned
    • EvaluationPlanned
  7. 07

    Applications

    • ClassificationPlanned
    • NERPlanned
    • SearchPlanned
    • QAPlanned
    • GenerationPlanned