Entropy and cross-entropy
why entropy is defined as H(X)=−∑p(x)log(p(x)) Entropy, as defined by the formula H(X) = -∑p(x)log(p(x)), might seem complex at first, but it has a deep and intuitive connection to information…
ML workflow and pipeline orchestration
Kale – Aims at simplifying the Data Science experience of deploying Kubeflow Pipelines workflows. Flyte – Easy to create concurrent, scalable, and maintainable workflows for machine learning. MLRun – Generic mechanism for data…
responsible AI
General intro https://github.com/alexandrainst/responsible-ai https://ai.google/responsibilities/responsible-ai-practices/ https://www.tensorflow.org/responsible_ai Open source implementation https://github.com/microsoft/responsible-ai-toolbox https://www.tensorflow.org/responsible_ai/api_docs https://opendatascience.com/15-open-source-responsible-ai-toolkits-and-projects-to-use-today/ Responsible AI Toolkits for AI Ethics & Privacy TensorFlow Privacy TensorFlow Privacy is a Python library that includes implementations…
Bias vs Variance in ML
Somehow even wiki https://en.wikipedia.org/wiki/Bias%E2%80%93variance_tradeoff seems not clearly explained what it is due to un-cleary math denotion. Here we refer to: model/algorithm’s bias and variance ( not the data itself ).…
optimization theory, lagrange, dual function, dual problem, KKT
Theory background min: f0(x) ==> p * s.t.: fi(x) <= 0 i = 1, … m hi(x) = 0 , j= 1 … m define lagrange function:…
webassembly and web audio worklet
Some notes: web assembly: a cool technology allows you to compile c/c++/rust and other languages into wasm, expose API to javascript world. Web audio worklet/worker: allows developer to intercept audio…
How to learn pytorch from scratch
Pytoch is a quite powerful, flexible and yet popular deep learning framework. The learning curve could be steep if you do not have much deep learning background. So what is…
how to prevent nvidia GPU hangup on ( debian 10)
debian 10 have nvidia GPU driver, cuda 9 etc, it is a good thing for deep learning ( keras or pytorch). but if let it running for some time (…
fp-tree and fp-growth in plain english
The normal use case is to discover interesting relations between variables in large databases, e.g: i(t) 1 ABDE 2 BCE 3 ABDE 4 ABCE 5 ABCDE 6 BCD the above…
K-means clustering and Bisecting K-means in Plain English
K-means clustering is unsupervised machine learning algorithm. Wikipedia has a great demo as below on how it works: Demonstration of the standard algorithm 1. k initial “means” (in this case…
SVM ( support vecotr machine) in Plain English
(1) Maximum the margin SVM is very easy to understand on the graph,, we just need to find the a separate plane which maximum the margin. see the graph below: (2)…
