created, $=dv.current().file.ctime & modified, =this.modified tags:nlp

Notes via huggingface

NLP is a field of linguistics and machine learning focused on understanding everything related to human language. The aim is to not only understand single words individually, but to understand the context of the words.

Tasks

  • classify whole sentences: get the sentiment of a review, detect if an email is spam, determine grammatical correctness.
  • Classify each word in a sentence: identification grammatical components of a sentence (noun, verb, adj)
  • Generating text: completing a prompt with text, filling in blanks.
  • Extracting answers: given a question and context, extract an answer to a question
  • Generating a new sentence from input text

Are the comparisons here true? Do I actually understand this?

Computer’s do not process information the same way as humans. We read the sentence “I am hungry” and we can understand its meaning. Similarly, given two sentences such as “I am hungry” and “I am sad” we are able to easily determine how similar they are.

For ML the text needs to be processed in a way to allow a model to learn from it.

Transformers