【2018Update_0803】 2机器学习、自然语言处理相关教程机器学习研究会

使用深度学习构建您的第一个人群计数模型 Introduction 人工智能和机器学习将成为我们未来十年的最大帮手! 今天早上,我正在阅读一篇文章,该文章报道了一个人工智能系统赢得了20名律师的支持,而律师们实际上很高兴人工智能能够处理重复的部分角色并帮助他们处理复杂的主题。 这些律师很高兴人工智能将使他们能够拥有更多充实的角色。 今天,我将分享一个类似的例子 - 如何使用深度学习和计算机视觉计算人群中的人数? 但是,在我们这样做之前 -... 阅读详情

Over 200 of the Best Machine Learning, NLP, and Python Tutorials — 2018 Edition

本文包含了迄今为止我发现的最好的一些教程内容。它绝不是网上每个ML相关教程的简单详尽列表(这个工作量无疑是十分巨大而又枯燥重复的),而是经过详细筛选后的结果。我的目标就是将我在机器学习和自然语言处理领域各个方面找到的我认为最好的教程整理出来。


本文分四个主题进行整理: 机器学习,自然语言处理,Python和数学。在每个主题中将包含一个例子和多个资源。

为了避免资源重复罗列,每个主题下只列出了5、6个教程。下面的每个链接都应该链接了和其他链接不同的资源,也会通过不同的方式(例如幻灯片代码段)或者不同的角度呈现出这些内容。

相关资源
 

作者Robbie Allen是以为科技作者和创业者、并自学AI并成为博士生。曾整理许多广为流传的机器学习相关资源。

1. 2017版教程资源 Over 150 ofthe Best Machine Learning, NLP, and Python Tutorials I’ve Found(150多个最好的与机器学习,自然语言处理和Python相关的教程)

2. My Curated List of AI and Machine LearningResources from Around the Web( 终极收藏AI领域你不能不关注的大牛、机构、课程、会议、图书)

  • 英文:

https://medium.com/machine-learning-in-practice/my-curated-list-of-ai-and-machine-learning-resources-from-around-the-web-9a97823b8524

  • 中文翻译:

http://www.sohu.com/a/168291972_473283
 

3. Cheat Sheet of Machine Learningand Python (and Math) Cheat Sheets

(值得收藏的27 个机器学习的小抄)

  • 英文:

https://medium.com/machine-learning-in-practice/cheat-sheet-of-machine-learning-and-python-and-math-cheat-sheets-a4afe4e791b6

目录

1.机器学习

1.1 激活函数与损失函数

1.2 偏差(bias)

1.3 感知机(perceptron)

1.4 回归(Regression)

1.5 梯度下降(Gradient Descent)

1.6 生成学习(Generative Learning)

1.7 支持向量机(Support Vector Machines)

1.8 反向传播(Backpropagation)

1.9 深度学习(Deep Learning)

1.10 优化与降维(Optimization and Dimensionality Reduction)

1.11 Long Short Term Memory (LSTM)

1.12 卷积神经网络 Convolutional Neural Networks (CNNs)

1.13 循环神经网络 Recurrent Neural Nets (RNNs)

1.14 强化学习 Reinforcement Learning

1.15 生产对抗模型 Generative Adversarial Networks (GANs)

1.16 多任务学习 Multi-task Learning

2. 自然语言处理 NLP

2.1 深度学习与自然语言处理 Deep Learning and NLP

2.2 词向量 Word Vectors

2.3 编解码模型 Encoder-Decoder

3. Python

3.1 样例 Examples

3.2 Scipy and numpy教程

3.3 scikit-learn教程

3.4 Tensorflow教程

3.5 PyTorch教程

4. 数学基础教程

4.1 线性代数

4.2 概率论

4.3 微积分
 

1. 机器学习

https://www.kaggle.com/kanncaa1/machine-learning-tutorial-for-beginners

 

1.1 激活函数与损失函数
 

  • Sigmoidneurons (neuralnetworksanddeeplearning.com)

http://neuralnetworksanddeeplearning.com/chap1.html#sigmoid_neurons

  • What is the role of theactivation function in a neural network? (quora.com)

https://www.quora.com/What-is-the-role-of-the-activation-function-in-a-neural-network

  • Comprehensive list ofactivation functions in neural networks with pros/cons(stats.stackexchange.com)

https://stats.stackexchange.com/questions/115258/comprehensive-list-of-activation-functions-in-neural-networks-with-pros-cons

  • Activation functions and it’stypes-Which is better? (medium.com)

https://medium.com/towards-data-science/activation-functions-and-its-types-which-is-better-a9a5310cc8f

  • Making Sense of LogarithmicLoss (exegetic.biz)

http://www.exegetic.biz/blog/2015/12/making-sense-logarithmic-loss/

  • Loss Functions (StanfordCS231n)

http://cs231n.github.io/neural-networks-2/#losses

  • L1 vs. L2 Lossfunction (rishy.github.io)

http://rishy.github.io/ml/2015/07/28/l1-vs-l2-loss/

  • The cross-entropy costfunction (neuralnetworksanddeeplearning.com)

http://neuralnetworksanddeeplearning.com/chap3.html#the_cross-entropy_cost_function
 

1.2 偏差(bias)
 

  • Role of Bias in NeuralNetworks (stackoverflow.com)

https://stackoverflow.com/questions/2480650/role-of-bias-in-neural-networks/2499936#2499936

  • Bias Nodes in NeuralNetworks (makeyourownneuralnetwork.blogspot.com)

http://makeyourownneuralnetwork.blogspot.com/2016/06/bias-nodes-in-neural-networks.html

  • What is bias in artificialneural network? (quora.com)

https://www.quora.com/What-is-bias-in-artificial-neural-network

 

1.3 感知机(perceptron)
 

  • Perceptrons (neuralnetworksanddeeplearning.com)

http://neuralnetworksanddeeplearning.com/chap1.html#perceptrons

  • The Perception (natureofcode.com)

http://natureofcode.com/book/chapter-10-neural-networks/#chapter10_figure3

  • Single-layer Neural Networks(Perceptrons) (dcu.ie)

http://computing.dcu.ie/~humphrys/Notes/Neural/single.neural.html

  • From Perceptrons to DeepNetworks (toptal.com)

https://www.toptal.com/machine-learning/an-introduction-to-deep-learning-from-perceptrons-to-deep-networks


 

1.4 回归(Regression)

  • Introduction to linearregression analysis (duke.edu)

http://people.duke.edu/~rnau/regintro.htm

  • LinearRegression (ufldl.stanford.edu)

http://ufldl.stanford.edu/tutorial/supervised/LinearRegression/

  • LinearRegression (readthedocs.io)

http://ml-cheatsheet.readthedocs.io/en/latest/linear_regression.html

  • Logistic Regression (readthedocs.io)

http://ml-cheatsheet.readthedocs.io/en/latest/logistic_regression.html

  • Simple Linear RegressionTutorial for Machine Learning(machinelearningmastery.com)

http://machinelearningmastery.com/simple-linear-regression-tutorial-for-machine-learning/

  • Logistic Regression Tutorialfor Machine Learning(machinelearningmastery.com)

http://machinelearningmastery.com/logistic-regression-tutorial-for-machine-learning/

  • SoftmaxRegression (ufldl.stanford.edu)

http://ufldl.stanford.edu/tutorial/supervised/SoftmaxRegression/

 


 

1.5 梯度下降(Gradient Descent)

  • Learning with gradientdescent (neuralnetworksanddeeplearning.com)

http://neuralnetworksanddeeplearning.com/chap1.html#learning_with_gradient_descent

  • GradientDescent (iamtrask.github.io)

http://iamtrask.github.io/2015/07/27/python-network-part2/

  • How to understand GradientDescent algorithm (kdnuggets.com)

http://www.kdnuggets.com/2017/04/simple-understand-gradient-descent-algorithm.html


 

  • An overview of gradient descentoptimization algorithms(sebastianruder.com)

http://sebastianruder.com/optimizing-gradient-descent/

  • Optimization: StochasticGradient Descent (Stanford CS231n)

http://cs231n.github.io/optimization-1/
 

1.6 生成学习(Generative Learning)

  • Generative LearningAlgorithms (Stanford CS229)

http://cs229.stanford.edu/notes/cs229-notes2.pdf

  • A practical explanation of aNaive Bayes classifier (monkeylearn.com)

https://monkeylearn.com/blog/practical-explanation-naive-bayes-classifier/

 

1.7 支持向量机(Support Vector Machines)

  • An introduction to SupportVector Machines (SVM) (monkeylearn.com)

https://monkeylearn.com/blog/introduction-to-support-vector-machines-svm/

  • Support VectorMachines (Stanford CS229)

http://cs229.stanford.edu/notes/cs229-notes3.pdf

  • Linear classification: SupportVector Machine, Softmax (Stanford 231n)

http://cs231n.github.io/linear-classify/

 

1.8 反向传播(Backpropagation)
 

  • Yes you should understandbackprop (medium.com/@karpathy)

https://medium.com/@karpathy/yes-you-should-understand-backprop-e2f06eab496b

  • Can you give a visualexplanation for the back propagation algorithm for neural networks? (github.com/rasbt)

https://github.com/rasbt/python-machine-learning-book/blob/master/faq/visual-backpropagation.md

  • How the backpropagationalgorithm works(neuralnetworksanddeeplearning.com)

http://neuralnetworksanddeeplearning.com/chap2.html

  • Backpropagation Through Timeand Vanishing Gradients (wildml.com)

http://www.wildml.com/2015/10/recurrent-neural-networks-tutorial-part-3-backpropagation-through-time-and-vanishing-gradients/

  • A Gentle Introduction toBackpropagation Through Time(machinelearningmastery.com)

http://machinelearningmastery.com/gentle-introduction-backpropagation-time/

  • Backpropagation,Intuitions (Stanford CS231n)

http://cs231n.github.io/optimization-2/


 

1.9 深度学习(Deep Learning)

  • A Guide to Deep Learning byYN² (yerevann.com)

http://yerevann.com/a-guide-to-deep-learning/

  • Deep Learning Papers ReadingRoadmap (github.com/floodsung)

https://github.com/floodsung/Deep-Learning-Papers-Reading-Roadmap

  • Deep Learning in aNutshell (nikhilbuduma.com)

http://nikhilbuduma.com/2014/12/29/deep-learning-in-a-nutshell/

  • A Tutorial on DeepLearning (Quoc V. Le)

http://ai.stanford.edu/~quocle/tutorial1.pdf

  • What is DeepLearning? (machinelearningmastery.com)

http://machinelearningmastery.com/what-is-deep-learning/

  • What’s the Difference BetweenArtificial Intelligence, Machine Learning, and Deep Learning? (nvidia.com)

https://blogs.nvidia.com/blog/2016/07/29/whats-difference-artificial-intelligence-machine-learning-deep-learning-ai/

  • Deep Learning—TheStraight Dope (gluon.mxnet.io)

https://gluon.mxnet.io/

 

1.10 优化与降维(Optimization and Dimensionality Reduction)

  • Seven Techniques for DataDimensionality Reduction (knime.org)

https://www.knime.org/blog/seven-techniques-for-data-dimensionality-reduction
 

  • Principal componentsanalysis (Stanford CS229)

http://cs229.stanford.edu/notes/cs229-notes10.pdf

  • Dropout: A simple way toimprove neural networks (Hinton @ NIPS 2012)

http://videolectures.net/site/normal_dl/tag=741100/nips2012_hinton_networks_01.pdf

  • How to train your Deep NeuralNetwork (rishy.github.io)

http://rishy.github.io/ml/2017/01/05/how-to-train-your-dnn/

 

1.11 Long Short Term Memory (LSTM)

  • A Gentle Introduction to LongShort-Term Memory Networks by the Experts(machinelearningmastery.com)

http://machinelearningmastery.com/gentle-introduction-long-short-term-memory-networks-experts/

  • Understanding LSTMNetworks (colah.github.io)

http://colah.github.io/posts/2015-08-Understanding-LSTMs/

  • Exploring LSTMs (echen.me)

http://blog.echen.me/2017/05/30/exploring-lstms/

  • Anyone Can Learn To Code anLSTM-RNN in Python (iamtrask.github.io)

http://iamtrask.github.io/2015/11/15/anyone-can-code-lstm/

 

1.12 卷积神经网络 Convolutional Neural Networks (CNNs)

  • Introducing convolutionalnetworks (neuralnetworksanddeeplearning.com)

http://neuralnetworksanddeeplearning.com/chap6.html#introducing_convolutional_networks
 

  • Deep Learning and ConvolutionalNeural Networks(medium.com/@ageitgey)

https://medium.com/@ageitgey/machine-learning-is-fun-part-3-deep-learning-and-convolutional-neural-networks-f40359318721

  • Conv Nets: A ModularPerspective (colah.github.io)

http://colah.github.io/posts/2014-07-Conv-Nets-Modular/

  • UnderstandingConvolutions (colah.github.io)

http://colah.github.io/posts/2014-07-Understanding-Convolutions/

 

1.13 循环神经网络 Recurrent Neural Nets (RNNs)

  • Recurrent Neural NetworksTutorial (wildml.com)

http://www.wildml.com/2015/09/recurrent-neural-networks-tutorial-part-1-introduction-to-rnns/

  • Attention and AugmentedRecurrent Neural Networks (distill.pub)

http://distill.pub/2016/augmented-rnns/

  • The Unreasonable Effectivenessof Recurrent Neural Networks(karpathy.github.io)

http://karpathy.github.io/2015/05/21/rnn-effectiveness/

  • A Deep Dive into RecurrentNeural Nets (nikhilbuduma.com)

http://nikhilbuduma.com/2015/01/11/a-deep-dive-into-recurrent-neural-networks/

 

1.14 强化学习 Reinforcement Learning

  • Simple Beginner’s guide toReinforcement Learning & its implementation(analyticsvidhya.com)

https://www.analyticsvidhya.com/blog/2017/01/introduction-to-reinforcement-learning-implementation/

  • A Tutorial for ReinforcementLearning (mst.edu)

https://web.mst.edu/~gosavia/tutorial.pdf

  • Learning ReinforcementLearning (wildml.com)

http://www.wildml.com/2016/10/learning-reinforcement-learning/

  • Deep Reinforcement Learning:Pong from Pixels (karpathy.github.io)

http://karpathy.github.io/2016/05/31/rl/

 

1.15 生产对抗模型 Generative Adversarial Networks (GANs)
 

  • Adversarial MachineLearning (aaai18adversarial.github.io)

https://aaai18adversarial.github.io/slides/AML.pptx

  • What’s a Generative AdversarialNetwork? (nvidia.com)

https://blogs.nvidia.com/blog/2017/05/17/generative-adversarial-network/

  • Abusing Generative AdversarialNetworks to Make 8-bit Pixel Art(medium.com/@ageitgey)

https://medium.com/@ageitgey/abusing-generative-adversarial-networks-to-make-8-bit-pixel-art-e45d9b96cee7
 

  • An introduction to GenerativeAdversarial Networks (with code in TensorFlow) (aylien.com)

http://blog.aylien.com/introduction-generative-adversarial-networks-code-tensorflow/
 

  • Generative Adversarial Networksfor Beginners (oreilly.com)

https://www.oreilly.com/learning/generative-adversarial-networks-for-beginners

 

1.16 多任务学习 Multi-task Learning
 

  • An Overview of Multi-TaskLearning in Deep Neural Networks(sebastianruder.com)

http://sebastianruder.com/multi-task/index.html

2. 自然语言处理 NLP

  • Natural Language Processing isFun! (medium.com/@ageitgey)

https://medium.com/@ageitgey/natural-language-processing-is-fun-9a0bff37854e
 

  • A Primer on Neural NetworkModels for Natural LanguageProcessing (Yoav Goldberg)

http://u.cs.biu.ac.il/~yogo/nnlp.pdf
 

  • The Definitive Guide to NaturalLanguage Processing (monkeylearn.com)

https://monkeylearn.com/blog/the-definitive-guide-to-natural-language-processing/
 

  • Introduction to NaturalLanguage Processing (algorithmia.com)

https://blog.algorithmia.com/introduction-natural-language-processing-nlp/
 

  • Natural Language Processing Tutorial (vikparuchuri.com)

http://www.vikparuchuri.com/blog/natural-language-processing-tutorial/
 

  • Natural Language Processing(almost) from Scratch (arxiv.org)

https://arxiv.org/pdf/1103.0398.pdf

 

2.1 深度学习与自然语言处理 Deep Learning and NLP

  • Deep Learning applied toNLP (arxiv.org)

https://arxiv.org/pdf/1703.03091.pdf
 

  • Deep Learning for NLP (withoutMagic) (Richard Socher)

https://nlp.stanford.edu/courses/NAACL2013/NAACL2013-Socher-Manning-DeepLearning.pdf
 

  • Understanding ConvolutionalNeural Networks for NLP (wildml.com)

http://www.wildml.com/2015/11/understanding-convolutional-neural-networks-for-nlp/
 

  • Deep Learning, NLP, andRepresentations (colah.github.io)

http://colah.github.io/posts/2014-07-NLP-RNNs-Representations/
 

  • Embed, encode, attend, predict:The new deep learning formula for state-of-the-art NLPmodels (explosion.ai)

https://explosion.ai/blog/deep-learning-formula-nlp

  • Understanding Natural Languagewith Deep Neural Networks Using Torch(nvidia.com)

https://devblogs.nvidia.com/parallelforall/understanding-natural-language-deep-neural-networks-using-torch/

 

  • Deep Learning for NLP withPytorch (pytorich.org)

http://pytorch.org/tutorials/beginner/deep_learning_nlp_tutorial.html

 

2.2 词向量 Word Vectors

 

  • Bag of Words Meets Bags ofPopcorn (kaggle.com)

https://www.kaggle.com/c/word2vec-nlp-tutorial
 

 

  • The amazing power of wordvectors (acolyer.org)

https://blog.acolyer.org/2016/04/21/the-amazing-power-of-word-vectors/
 

  • word2vec Parameter LearningExplained (arxiv.org)

https://arxiv.org/pdf/1411.2738.pdf
 

  • Word2Vec Tutorial—TheSkip-Gram Model, Negative Sampling(mccormickml.com)

http://mccormickml.com/2016/04/19/word2vec-tutorial-the-skip-gram-model/

 

2.3 编解码模型 Encoder-Decoder

 

  • Attention and Memory in DeepLearning and NLP (wildml.com)

http://www.wildml.com/2016/01/attention-and-memory-in-deep-learning-and-nlp/
 

  • Sequence to SequenceModels (tensorflow.org)

https://www.tensorflow.org/tutorials/seq2seq
 

  • Sequence to Sequence Learningwith Neural Networks (NIPS 2014)

https://papers.nips.cc/paper/5346-sequence-to-sequence-learning-with-neural-networks.pdf
 

  • Machine Learning is Fun Part 5:Language Translation with Deep Learning and the Magic ofSequences (medium.com/@ageitgey)

https://medium.com/@ageitgey/machine-learning-is-fun-part-5-language-translation-with-deep-learning-and-the-magic-of-sequences-2ace0acca0aa
How to use an Encoder-DecoderLSTM to Echo Sequences of Random Integers(machinelearningmastery.com)

http://machinelearningmastery.com/how-to-use-an-encoder-decoder-lstm-to-echo-sequences-of-random-integers/

  • tf-seq2seq (google.github.io)

https://google.github.io/seq2seq/

 

3. Python

 

  • Machine Learning CrashCourse (google.com)

https://developers.google.com/machine-learning/crash-course/
 

  • Awesome MachineLearning (github.com/josephmisiti)

https://github.com/josephmisiti/awesome-machine-learning#python
 

  • 7 Steps to Mastering MachineLearning With Python (kdnuggets.com)

http://www.kdnuggets.com/2015/11/seven-steps-machine-learning-python.html
 

  • An example machine learningnotebook (nbviewer.jupyter.org)

http://nbviewer.jupyter.org/github/rhiever/Data-Analysis-and-Machine-Learning-Projects/blob/master/example-data-science-notebook/Example%20Machine%20Learning%20Notebook.ipynb
 

  • Machine Learning withPython (tutorialspoint.com)

https://www.tutorialspoint.com/machine_learning_with_python/machine_learning_with_python_quick_guide.htm

 

3.1 样例 Examples


 

  • How To Implement The PerceptronAlgorithm From Scratch In Python(machinelearningmastery.com)

http://machinelearningmastery.com/implement-perceptron-algorithm-scratch-python/
 

  • Implementing a Neural Networkfrom Scratch in Python (wildml.com)

http://www.wildml.com/2015/09/implementing-a-neural-network-from-scratch/
 

  • A Neural Network in 11 lines ofPython (iamtrask.github.io)

http://iamtrask.github.io/2015/07/12/basic-python-network/
 

  • Implementing Your Own k-NearestNeighbour Algorithm Using Python(kdnuggets.com)

http://www.kdnuggets.com/2016/01/implementing-your-own-knn-using-python.html
 

  • ML fromScatch (github.com/eriklindernoren)

https://github.com/eriklindernoren/ML-From-Scratch
 

  • Python Machine Learning (2ndEd.) Code Repository (github.com/rasbt)

https://github.com/rasbt/python-machine-learning-book-2nd-edition

 

3.2 Scipy and numpy教程

 

  • Scipy LectureNotes (scipy-lectures.org)

http://www.scipy-lectures.org/
 

  • Python NumpyTutorial (Stanford CS231n)

http://cs231n.github.io/python-numpy-tutorial/
 

  • An introduction to Numpy andScipy (UCSB CHE210D)

https://engineering.ucsb.edu/~shell/che210d/numpy.pdf

 

  • A Crash Course in Python forScientists (nbviewer.jupyter.org)

http://nbviewer.jupyter.org/gist/rpmuller/5920182#ii.-numpy-and-scipy

 

3.3 scikit-learn教程

  • PyCon scikit-learn TutorialIndex (nbviewer.jupyter.org)

http://nbviewer.jupyter.org/github/jakevdp/sklearn_pycon2015/blob/master/notebooks/Index.ipynb
 

  • scikit-learn ClassificationAlgorithms (github.com/mmmayo13)

https://github.com/mmmayo13/scikit-learn-classifiers/blob/master/sklearn-classifiers-tutorial.ipynb

  • scikit-learnTutorials (scikit-learn.org)

http://scikit-learn.org/stable/tutorial/index.html
 

  • Abridged scikit-learnTutorials (github.com/mmmayo13)

https://github.com/mmmayo13/scikit-learn-beginners-tutorials

 

3.4 Tensorflow教程

  • Tensorflow Tutorials (tensorflow.org)

https://www.tensorflow.org/tutorials/
 

  • Introduction to TensorFlow—CPUvs GPU (medium.com/@erikhallstrm)

https://medium.com/@erikhallstrm/hello-world-tensorflow-649b15aed18c
 

  • TensorFlow: Aprimer (metaflow.fr)

https://blog.metaflow.fr/tensorflow-a-primer-4b3fa0978be3
 

  • RNNs inTensorflow (wildml.com)

http://www.wildml.com/2016/08/rnns-in-tensorflow-a-practical-guide-and-undocumented-features/
 

  • Implementing a CNN for TextClassification in TensorFlow (wildml.com)

http://www.wildml.com/2015/12/implementing-a-cnn-for-text-classification-in-tensorflow/
 

  • How to Run Text Summarizationwith TensorFlow (surmenok.com)

http://pavel.surmenok.com/2016/10/15/how-to-run-text-summarization-with-tensorflow/
 

3.5 PyTorch教程
 

  • PyTorchTutorials (pytorch.org)

http://pytorch.org/tutorials/
 

  • A Gentle Intro toPyTorch (gaurav.im)

http://blog.gaurav.im/2017/04/24/a-gentle-intro-to-pytorch/
 

  • Tutorial: Deep Learning inPyTorch (iamtrask.github.io)

https://iamtrask.github.io/2017/01/15/pytorch-tutorial/
 

  • PyTorch Examples (github.com/jcjohnson)

https://github.com/jcjohnson/pytorch-examples
 

  • PyTorchTutorial (github.com/MorvanZhou)

https://github.com/MorvanZhou/PyTorch-Tutorial
 

  • PyTorch Tutorial for DeepLearning Researchers (github.com/yunjey)

https://github.com/yunjey/pytorch-tutorial

 

4. 数学基础教程

  • Math for MachineLearning (ucsc.edu)

https://people.ucsc.edu/~praman1/static/pub/math-for-ml.pdf
Math for MachineLearning (UMIACS CMSC422)

http://www.umiacs.umd.edu/~hal/courses/2013S_ML/math4ml.pdf

 


 

4.1 线性代数


 

  • An Intuitive Guide to LinearAlgebra (betterexplained.com)

https://betterexplained.com/articles/linear-algebra-guide/
 

  • A Programmer’s Intuition forMatrix Multiplication (betterexplained.com)

https://betterexplained.com/articles/matrix-multiplication/
 

  • Understanding the Cross Product (betterexplained.com)

https://betterexplained.com/articles/cross-product/
 

  • Understanding the DotProduct (betterexplained.com)

https://betterexplained.com/articles/vector-calculus-understanding-the-dot-product/
 

  • Linear Algebra for MachineLearning (U. of Buffalo CSE574)

http://www.cedar.buffalo.edu/~srihari/CSE574/Chap1/LinearAlgebra.pdf
 

  • Linear algebra cheat sheet fordeep learning (medium.com)

https://medium.com/towards-data-science/linear-algebra-cheat-sheet-for-deep-learning-cd67aba4526c
 

  • Linear Algebra Review andReference (Stanford CS229)

http://cs229.stanford.edu/section/cs229-linalg.pdf


 

4.2 概率论


 

  • Understanding Bayes TheoremWith Ratios (betterexplained.com)

https://betterexplained.com/articles/understanding-bayes-theorem-with-ratios/
 

  • Review of ProbabilityTheory (Stanford CS229)

http://cs229.stanford.edu/section/cs229-prob.pdf

 


 

  • Probability Theory Review forMachine Learning (Stanford CS229)

https://see.stanford.edu/materials/aimlcs229/cs229-prob.pdf
 

  • Probability Theory (U. ofBuffalo CSE574)

http://www.cedar.buffalo.edu/~srihari/CSE574/Chap1/Probability-Theory.pdf
 

  • Probability Theory for MachineLearning (U. of Toronto CSC411)

http://www.cs.toronto.edu/~urtasun/courses/CSC411_Fall16/tutorial1.pdf

 

4.3 微积分

  • How To Understand Derivatives:The Quotient Rule, Exponents, and Logarithms (betterexplained.com)

https://betterexplained.com/articles/how-to-understand-derivatives-the-quotient-rule-exponents-and-logarithms/

  • How To Understand Derivatives:The Product, Power & Chain Rules(betterexplained.com)

https://betterexplained.com/articles/derivatives-product-power-chain/

  • Vector Calculus: Understandingthe Gradient (betterexplained.com)

https://betterexplained.com/articles/vector-calculus-understanding-the-gradient/
DifferentialCalculus (Stanford CS224n)

http://web.stanford.edu/class/cs224n/lecture_notes/cs224n-2017-review-differential-calculus.pdf
CalculusOverview (readthedocs.io)

http://ml-cheatsheet.readthedocs.io/en/latest/calculus.html

 

原文链接:

https://medium.com/machine-learning-in-practice/over-200-of-the-best-machine-learning-nlp-and-python-tutorials-2018-edition-dd8cf53cb7dc

 

Scan QR Code via WeChat 
to join tech group

 

【信息科学与工程学】【数据中心】【智算中心】第二十六篇 计费系统篇02 在云计算与电信网络深度融合的背景下,云服务商(如阿里云、腾讯云、UCloud等)与电信运营商(中国电信、移动、联通)通过创新联合计费模式,显著降低了企业用云成本。这些模式主要围绕展开。 阅读详情

相关推荐

2018汇总自然语言处理篇

隐马尔可夫分词双数组Trie树高效构建有向无环图AC自动机+trie树实现高效多模式匹配字典同义词相似度可以怎样计算怎样衡量两个字符串的相似度(编辑距离动态规划求解)怎样...

seaboat——a free boat on the sea.(公众号:远洋号) 489

教你如何运用可视化理解卷积神经网络(CNNs)的指南

https://www.toutiao.com/a6697405298581176843/ 2019-06-01 12:51:59 全文共4327字,预计学习时长20分钟或更长 “人类的神经网络是如何运行的?”这个问题让很多数据科学家感到困惑。解释某个简单神经网络的工作机制非常容易,但是当某个计算机视觉项目中的层数增加1000倍时,该怎么办呢? 终端用户想要了解模型是如何...

喜欢打酱油的老鸟 8441

Fundamentals of Deep Learning 无水印pdf

Fundamentals of Deep Learning 英文无水印pdf pdf所有页面使用FoxitReader和PDF-XChangeViewer测试都可以打开 本资源转载自网络,如有侵权,请联系上传者或csdn删除 本资源转载自网络,如有侵权,请联系上传者或csdn删除

CSC321 神经网络语言模型 RNN-LSTM

主要两个方面 Probabilistic modeling 概率建模,神经网络模型尝试去预测一个概率分布 Cross-entropy作为误差函数使得我们可以对于观测到的数据 给予较高的概率值 同时可以解决saturation的问题 前面提到的线性隐层的降维作用(减少训练参数)     这是一个最初版的神经网络语言模型    选取什么要的loss funct...

weixin_34138521的博客 282

利用MATLAB 4f光学系统,在Python中进行弗劳恩霍夫衍射和傅里叶面滤波——用镜头模拟光学图像处理。.zip

1.版本:matlab2014a/2019b/2024b 2.附赠案例数据可直接运行。 3.代码特点:参数化编程、参数可方便更改、代码编程思路清晰、注释明细。 4.适用对象:计算机,电子信息工程、数学等专业的大学生课程设计、期末大作业和毕业设计。

工业互联网工控安全与工业质检AI大模型建设方案.pptx

工业互联网工控安全与工业质检AI大模型建设方案.pptx

推荐|近期热点机器学习git项目

No1: InterpretML by Microsoft——Machine Learning Interpretability github地址:https://github.com/microsoft/interpret 可解释性是目前机器学习中的一个重要问题。能够理解模型如何产生它所输出的内容,这是每个机器学习项目的关键。 Interpretml是微软的一个开...

TensorFlowNews 523

通信行业CentOS 7内核网络栈优化:高并发连接下UDP/TCP性能调优与系统资源管理

内容概要:本文聚焦于CentOS 7系统在通信行业高并发场景下的性能调优实践,重点围绕内核网络栈优化展开,涵盖UDP/TCP缓冲区调整、文件句柄与连接跟踪表扩容、TIME_WAIT状态复用、软中断分布优化及tuned工具的自动化调优。通过具体配置参数和实际案例(如VoIP软交换系统)深入解析各项调优措施的设计原理与实施效果,有效解决高CPS下丢包、连接失败等问题,并展望了向云化、eBPF等动态智能调优方向的发展趋势。; 适合人群:从事通信系统运维、网络开发或Linux系统性能优化的技术人员,具备一定操作系统和网络基础知识,工作经验1年以上的中初级工程师。; 使用场景及目标:①应用于软交换、媒体网关、信令网关等高并发通信设备的系统调优;②解决UDP丢包、conntrack表满、TCP连接队列溢出等典型性能瓶颈;③提升系统在小包高频、低时延要求场景下的稳定性和吞吐能力。; 阅读建议:建议结合实际生产环境或测试平台同步验证文中配置,重点关注参数背后的物理意义(如BDP、softirq、conntrack机制),并配合ss、conntrack、dmesg等命令进行调优前后对比分析,确保安全可控地实施变更。

深度学习基础(二)Backpropagation Algorithm 分类: ...

我们知道神经网络有forward propagation,很自然会想那有没有Backpropagation,结果还真有。 forward progation相当于神经网络额一次初始化,但是这个神经网络还缺少训练,而Backpropagation Algorithm就是用来训练神经网络的。 假设现在又m组训练集 代价函数为: 单个神经元的 神经网络...

dengxundong1074的博客 257

2024 《计算机网络》实验教学指导书.doc

2024 《计算机网络》实验教学指导书.doc

不平衡电网下自抗扰顺序模型预测PWM整流器控制仿真模型(Simulink仿真实现)

内容概要:本文围绕面向城市空中交通的多无人机路径规划问题展开研究,提出了一套融合全局规划、动态避障与局部协同调整的综合路径规划方法。研究内容涵盖基于改进RRT算法与图论的全局路径规划、基于动态风险场和动态窗口法(DWA)的模型预测控制实现动态避障,以及基于分布式协同控制的多无人机局部路径协同策略。通过Matlab平台构建仿真环境,在多种典型城市交通场景下对所提方法进行了系统性验证,结果表明该方法在路径安全性、编队稳定性与任务效率方面表现优异。文章还深入探讨了算法的创新点与未来研究方向,为复杂城市环境下多无人机系统的自主协同提供了理论支撑与技术路径。; 适合人群:具备自动化、控制理论、计算机科学或相关领域基础知识,从事无人机系统、智能交通、路径规划、多智能体协同控制等方向研究的研究生、科研人员及工程技术人员。; 使用场景及目标:①为城市空中交通系统中的多无人机安全、高效飞行提供可靠的路径规划解决方案;②支持在复杂、动态的城市场景中开展无人机自主导航、编队飞行与协同控制的技术研究与仿真验证。; 阅读建议:建议结合提供的Matlab代码进行实践操作,重点关注算法的具体实现细节、参数配置对性能的影响以及不同仿真场景下的实验设计,以深入理解各模块的集成逻辑与实际应用效果。

收藏 | 200个精选ML、NLP、Python及数学最佳教程(附链接)

来源:专知本文多资源,建议阅读收藏。本文列出了一系列包含四个主题的相关资源教程列表,一起来充电学习吧~[ 导读 ]近年来,机器学习等新最新技术层出不穷,如何跟踪最新的热点...

数据派THU 955

【选址和定容】模拟退火改进多目标粒子群算法在分布式电源选址和定容中的应用【IEEE69节点】(Matlab代码实现)

内容概要:本文研究了模拟退火改进多目标粒子群算法在分布式电源选址和定容中的应用,以IEEE69节点配电系统为算例进行仿真分析。通过融合模拟退火算法的强全局搜索能力与粒子群算法的高效局部收敛特性,构建了一种改进的多目标优化算法,用于解决分布式电源在配电网中的最优位置选择与容量配置问题。研究旨在实现多重优化目标,包括最小化网络有功损耗、提升节点电压质量、增强系统运行的经济性与稳定性。文中详细阐述了多目标优化模型的数学构建、算法的改进机制与实现流程,并基于Matlab平台完成了算法编程与仿真验证,结果表明所提方法在求解质量和收敛性能上均优于传统算法。; 适合人群:具备电力系统分析、优化理论基础及Matlab编程能力,从事配电网规划、分布式能源系统优化、智能优化算法应用等相关领域的科研人员、工程师以及高校研究生。; 使用场景及目标:①解决高比例分布式电源接入背景下配电网的科学规划问题;②为新型电力系统中源网协调设计提供有效的优化工具;③为相关领域的科研工作提供可复现、可拓展的算法模型与仿真代码实例,支持进一步的算法对比与功能升级。; 阅读建议:建议读者结合提供的Matlab代码与IEEE69节点标准数据,动手复现实验结果,深入理解算法的参数设置、迭代过程与多目标折衷分析方法,并可根据实际研究需求修改目标函数或引入新的约束条件以适应不同的应用场景。

小白也能弄懂的卷积神经网络(Convolutional Neural Networks )之初识

点击蓝字关注我本系列主要是讲解卷积神经网络 - Convolutional Neural Networks 的系列知识,本系列主要帮助大家入门,我相信这是所有入门深度学习的初学者都必须学...

哆啦A梦爱学习的博客 886

解决com.kingbase8.util.KSQLException: This _connection has been closed.

一个消息管理系统,系统采用kingbase8数据库,数据库采用单体模式,后台应用也采用springboot单体模式。系统正式上线后,出现几个JDBC响应的异常信息: com.kingbase8.util.KSQLException: An I/O error occurred while sending to the backend. java.net.SocketTimeoutException: Read timed out.

qq_38127559的博客 2756

基于ENVI5.3的Landsat条带去除、辐射定标、大气校正

基于ENVI5.3的Landsat条带去除、辐射定标、大气校正坏带修复辐射定标大气校正 坏带修复 1.下载landsat_gapfill插件,放入“安装目录\Exelis\ENVI53\extensions”,重启ENVI 2. 加载拟处理文件(MTL.txt格式) 3.打开landsat_gapfill 4.选择存放位置并命名文件 5.选择处理文件 辐射定标 1.选择工具Radiometric Calibration 2.选择已修复坏带文件 3.修改参数,选择输出位置及命名文件 大气校正 1

u010198950的博客 1万+

CSC321: Intro to Neural Network and Machine Learning 笔记一

课程地址:http://www.cs.toronto.edu/~rgrosse/courses/csc321_2018/第二课 线性回归问题定义:1、模型(model):使用循环来进行计算:向量化表示:(在GPU上,矩阵计算速度更快)向量化计算训练集的均值误差:2、损失函数(loss function):使用均方误差(square error):用来衡量哪个模型更好,即如果预测的y和目标t很接近的...

smilelulin的博客 758

从URDF到仿真动画:基于Simulink、Simscape与S-Function的机械臂一体化建模与控制

本文详细介绍了从URDF文件到高保真仿真动画的一体化机械臂建模与控制流程。通过整合Simulink、Simscape与S-Function,构建了包含物理特性的虚拟机械臂模型,并实现了自适应滑模等高级控制算法的嵌入与验证。该流程打通了从机械设计到控制算法验证的闭环,为机器人开发提供了高效的仿真平台。

cnn8visionary的博客 696

一步一步分析讲解神经网络基础-backpropagation algorithm

backpropagation算法 neutral network的基础。需要要掌握的基础知识。理解地方。我用红色字体输出。The project describes teaching process of multi-layer neural network employing backpropagation algorithm. To illustrate this process the th

凡难事必作于细的博客 1599

UVM对象实例化及覆盖的几种方法

UVM对象实例化的方法有多种,以下以object为例: 1)第一种:直接利用new函数进行实例化 trans t1; t1 = new("t1");//利用new函数进行实例化 2)第二种:uvm_component_registry中提供的方法type_id::create,此种方法也是最常使用的方法 trans t2; t2 = trans::type_id::create("t2",this); 3)第三种:uvm_factory中提供的方法creat_object_by_type trans t

沧月九流的博客 3375

嵌入式NuttX RTOS面试题及参考答案

NuttX 的板级支持包(BSP)是一组软件组件,用于将 NuttX 操作系统适配到特定的硬件平台上。BSP 提供了硬件抽象层,使得 NuttX 能够与硬件进行交互,包括初始化硬件设备、提供设备驱动程序等。BSP 的主要作用是隐藏硬件细节,为上层应用程序和操作系统内核提供统一的接口,从而提高软件的可移植性和可维护性。开发 NuttX 的 BSP 通常需要以下步骤:硬件分析:首先需要对目标硬件平台进行详细的分析,了解硬件的架构、处理器类型、外设接口等信息。

大模型大数据攻城狮的专栏 1300
上一篇: shell基于日常工作需要 【黏贴即用】
下一篇: 虚拟机网络连接方式或parallels Desktop
Debug_Snail
博客等级 码龄12年 96粉丝 50原创
评论
成就一亿技术人!
拼手气红包6.0元
还能输入1000个字符
 
 条评论被折叠 查看
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付:10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值