Natural Language Processing

NLP enables computers to understand, interpret, and generate human language.

Syntax

AI

1
2
3
4
5
6

from transformers import pipeline

# Sentiment Analysis
nlp = pipeline("sentiment-analysis")
result = nlp("I love this product!")
print(result)

Simple Text Processing

PYTHON

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16

import re

def simple_tokenize(text):
    return re.findall(r'\w+', text.lower())

def bag_of_words(text, vocab):
    tokens = simple_tokenize(text)
    return [1 if word in tokens else 0 for word in vocab]

vocab = ["hello", "how", "are", "you", "today"]
text = "hello how are you"
bow = bag_of_words(text, vocab)

print(f"Vocab: {vocab}")
print(f"Text: \"{text}\"")
print(f"Bag of Words: {bow}")

Try It Yourself

Practice

1

Exercise

Practice this concept.

Answer

Write the code as shown above.

Quick Quiz

1

What did you learn?

Concept A

Concept B

Concept C

Concept D

This covers the basics.

Retry Quiz

Interview Questions

Explain this concept.

It is a fundamental AI feature.

Next Lesson

ChatGPT & Large Language Models