CertNexus AIP-210 Actual Questions

Word embedding is a task in natural language processing (NLP) where words are converted into numerical vectors that represent their meaning, usage, or context. Word embedding can help reduce the dimensionality and sparsity of text data, as well as enable various operations and comparisons among words based on their vector representations. Some of the common methods for word embedding are:

• One-hot encoding: One-hot encoding is a method that assigns a unique binary vector to each word in a vocabulary. The vector has only one element with a value of 1 (the hot bit) and the rest with a value of 0. One-hot encoding can create distinct and orthogonal vectors for each word, but it does not capture any semantic or syntactic information about words.
• Word2vec: Word2vec is a method that learns a dense and continuous vector representation for each word based on its context in a large corpus of text. Word2vec can capture the semantic and syntactic similarity and relationships among words, such as synonyms, antonyms, analogies, or associations.
• GloVe: GloVe (Global Vectors for Word Representation) is a method that combines the advantages of count-based methods (such as TF-IDF) and predictive methods (such as Word2vec) to create word vectors. GloVe can leverage both global and local information from a large corpus of text to capture the co-occurrence patterns and probabilities of words.

Normalization is the transformation of features so that they are on a similar scale, usually between 0 and 1 or -1 and 1. This can help reduce the influence of outliers and improve the performance of some machine learning algorithms that are sensitive to the scale of the features, such as gradient descent, k-means, or k-nearest neighbors. References: [Feature scaling - Wikipedia], [Normalization vs Standardization — Quantitative analysis]

NLTK (Natural Language Toolkit) is a Python library that provides a set of tools and resources for natural language processing (NLP). NLP is a branch of AI that deals with analyzing, understanding, and generating natural language texts or speech. NLTK offers modules for various NLP tasks, such as tokenization, stemming, lemmatization, parsing, tagging, chunking, sentiment analysis, named entity recognition, machine translation, text summarization, and more .

Completeness is a quality criterion that describes the degree to which all required measures are known. Completeness can help assess the coverage and availability of data for a given purpose or analysis. Completeness can be measured by comparing the actual number of measures with the expected number of measures, or by identifying and counting any missing, null, or unknown values in the data.