Notes in Computer Science::Case Study

To Subscribe, use this Key

Status	Last Update	Fields
Published	09/30/2024	Problems to be addressed with chatbot (6)
Published	09/30/2024	Latency
Published	09/30/2024	Lingustic nuances
Published	09/30/2024	Architecture
Published	09/30/2024	Dataset
Published	09/30/2024	Processing power
Published	09/30/2024	Ethical challenges
Published	09/30/2024	Machine learning
Published	09/30/2024	Examples of machine learning (3)
Published	09/30/2024	Five steps of machine learning process
Published	09/30/2024	Function of neural networks (3)
Published	09/30/2024	Three layers of a neural network
Published	09/30/2024	Weights
Published	09/30/2024	Bias
Published	09/30/2024	Two types of activation function
Published	09/30/2024	How is output of a given hidden layer node calculated?
Published	09/30/2024	Loss
Published	09/30/2024	Mean squared error
Published	09/30/2024	Backpropagation
Published	09/30/2024	Gradient
Published	09/30/2024	Difference between slope and gradient
Published	09/30/2024	Derivatives used for backpropagation
Published	09/30/2024	How do we calculate how much to change weights and biases?
Published	09/30/2024	Complications with added layers
Published	09/30/2024	Vanishing gradient problem
Published	09/30/2024	Causes of vanishing gradient problem (3)
Published	09/30/2024	Loss function
Published	09/30/2024	Epoch
Published	09/30/2024	Three main dataset categories
Published	09/30/2024	Hyperparameters
Published	09/30/2024	Two common hyperparameters
Published	09/30/2024	Implications of changing number of layers (3)
Published	09/30/2024	Implications of changing learning rate (2)
Published	09/30/2024	Goal of hyperparameter tuning (3)
Published	09/30/2024	How is hyperparameter tuning evaluated? (2)
Published	09/30/2024	Natural Language Processing (NLP)
Published	09/30/2024	NLP tasks (5)
Published	09/30/2024	Why are RNNs used over feed-forward NNs for NLP
Published	09/30/2024	Common use cases of RNNs (3)
Published	09/30/2024	Tokenization
Published	09/30/2024	Input-output pairs in NLP
Published	09/30/2024	Tokenizing and Encoding
Published	09/30/2024	How is hidden state updated?
Published	09/30/2024	Hidden state
Published	09/30/2024	Recurrent Neural Network (RNN)
Published	09/30/2024	Time Step
Published	09/30/2024	Process of RNN (one time step) (4)
Published	09/30/2024	Embedding Layer
Published	09/30/2024	Embedding layer
Published	09/30/2024	Backpropagation through time (BPTT)
Published	09/30/2024	Standard BP vs BPTT
Published	09/30/2024	Vanishing gradient problem in RNNs (3)
Published	09/30/2024	Advantages of RNNs
Published	09/30/2024	Disadvantages of RNNs (4)
Published	09/30/2024	Long short-term memory (LSTM) network
Published	09/30/2024	LSTM Cell - Cell State
Published	09/30/2024	LSTM Cell - Input gate
Published	09/30/2024	LSTM Cell - Forget gate
Published	09/30/2024	LSTM Cell - Output gate
Published	09/30/2024	Components of an LSTM Cell (4)
Published	09/30/2024	Difference between hidden state and cell state in LSTM
Published	09/30/2024	How does LSTM address vanishing gradient problem?
Published	09/30/2024	Introduction of First TNN
Published	09/30/2024	Transformer Neural Network (TNN)
Published	09/30/2024	Mechanisms of a TNN (3)
Published	09/30/2024	Typical TNN architecture (5)
Published	09/30/2024	Architecture of TNN encoder (6)
Published	09/30/2024	Self-attention mechanism
Published	09/30/2024	How are attention weights calculated?
Published	09/30/2024	Residual Connections (3)
Published	09/30/2024	Advantages of TNNs over RNNs (2)
Published	09/30/2024	Large Language Models (LLMs)
Published	09/30/2024	Computational Capacity
Published	09/30/2024	Memory Resources
Published	09/30/2024	Efficiency and Speed
Published	09/30/2024	Three main tasks in developing an LLM
Published	09/30/2024	Types of preprocessing (4)
Published	09/30/2024	Bag-of-Words algorithm steps (3)
Published	09/30/2024	Advantages of BOW (4)
Published	09/30/2024	Disadvantages of BOW (3)
Published	09/30/2024	Advantages of Graphical Processing Unit (GPU) for NN tasks (3)
Published	09/30/2024	Tensor Processing Unit (TPU)
Published	09/30/2024	Advantages of TPUs (5)
Published	09/30/2024	Applications of TPUs (3)
Published	09/30/2024	Summary of GPUs vs TPUs
Published	09/30/2024	Example of TPU outperforming GPU
Published	09/30/2024	Advantages of clustering (5)
Published	09/30/2024	Disadvantages of clustering (3)
Published	09/30/2024	Factors that affect processing power required for training
Published	09/30/2024	Factors that affect processing power required for deployment
Published	09/30/2024	Real vs Synthetic data
Published	09/30/2024	Advantages/Disadvantages of real data
Published	09/30/2024	Advantages/Disadvantages of synthetic data
Published	09/30/2024	Confirmation Bias
Published	09/30/2024	Historical Bias
Published	09/30/2024	Labelling Bias
Published	09/30/2024	Linguistic Bias
Published	09/30/2024	Sampling Bias
Published	09/30/2024	Selection Bias
Published	09/30/2024	Factors affecting latency
Published	09/30/2024	How does training dataset affect latency? (3)
Published	09/30/2024	Critical Path Algorithm (3)
Published	09/30/2024	Methods to optimize critical pass
Published	09/30/2024	Natural Language Understanding (NLU)
Published	09/30/2024	Typical NLP pipeline
Published	09/30/2024	Advantages of NLU (3)
Published	09/30/2024	Five stages of NLP
Published	09/30/2024	Lexical Analysis
Published	09/30/2024	Syntactic Analysis (Parsing)
Published	09/30/2024	Semantic Analysis
Published	09/30/2024	Discourse Integration
Published	09/30/2024	Pragmatic Analysis
Published	09/30/2024	How can we ensure data privacy and security? (3)
Published	09/30/2024	How can we ensure bias and fairness? (3)
Published	09/30/2024	How can we ensure accountability and responsibility? (3)
Published	09/30/2024	How can we ensure transparency? (3)
Published	09/30/2024	How can we prevent misinformation and manipulation? (3)
Published	09/30/2024	Requirements of good dataset
Published	09/30/2024	Stemming
Published	09/30/2024	Lemmatization
Published	09/30/2024	Part of Speech Tagging
Published	09/30/2024	Named Entity Recognition
Published	09/30/2024	List of names to drop
Published	09/30/2024	Natural Language Generation
Published	09/30/2024	Examples of NLG (3)
Published	09/30/2024	High/low entropy NLG
Published	09/30/2024	Techniques to reduce latency (2)
Status	Last Update	Fields