Machine Learning Lecture Notes

1 Introduction

1.1 Machine Learning v.s Statistics

Definition

  • Machine Learning : a field that takes an algorithmic approach to data analysis, processing and prediction.

  • Algorithmic :produces good predictions or extracts useful information from data to solve a practical problem

Venn diagram: Statictics\data science\AI

Figure 1 Venn Diagram

1.2 Applications

Supervised Learning

  • Definition:
    Automate decision-making processes by generalising from input-output pairs ( x i , y i ) (x_i , y_i ) (xi,yi), i ∈ i ∈ i { 1 , . . . N 1, . . . N 1,...N} for some N ∈ N N ∈ \N NN
  • Drawback
    Creating a dataset of inputs and outputs is often a laborious manual process.
  • Advantage
    Supervised learning algorithms are well-understood and their performance is easy to measure
  • Example(train tickets pricing by distance)

Unsupervised Learning

  • Definition
    Only the input data is known, and no known output data is given to the algorithm.
  • Drawback
    Harder to understand and evaluate than SL.
  • Advantage
    Only the input data is needed and there is no process of “creating input-output pairs” involved.
  • Example(trade portfolio)

Data & Tasks & Algorithms

  1. data(explain with case)
    - data point
    - feature
    - feature extraction/engineering

  2. task(figure: overview of ml tasks)
    - regression
    - classification
    - clustering
    - dimensonality reduction
    < Different tasks have different loss functions, refer to 1.3–Function >

  3. algorithm
    - supportvectormachines(SVMs)
    - nearestneighbours
    - random forest
    - k means
    - matrix factorisaion/autoencoder
    -

1.3 Deep Learning

Definition(supervised & unsupervised)

Deep learning solves Problems by employing neural networks(artificial neural networks), functions constructed by composing alternatingly affine and (simple) non-linear functions.

Task

  • prediction
  • classification
  • image recognition
  • speech recognition and synthesis
  • simulation
  • optimal decision making

  • Task of MAchine Learning

Applications in Finance

  • detect fraud
  • machine read cheques
  • perform credit scoring

Limits

  • limited explainability of deep learning
  • black-box nature of neural networks

Function

f = ( f 1 , . . . , f O ) : R I → R O f =(f_1,...,f_O):R^I →R^O f=(f1,...,fO):RIRO

  • inputs
    x 1 , . . . , x I x_1,...,x_I x1
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值